Recognises an empty population reported as a pass
A check whose population is empty — the table did not load, the filter matches nothing, the expression errored — reporting 100 % or no failures. The dashboard is green exactly where nothing was looked at.
Can AI do this?
AI does this partly Some of the tested AI models master this; others do not show it. 2 of 4 models in the current benchmark master it.
| Model | Tier | Probability of mastery | Status |
|---|---|---|---|
| gemini-4-argon | Flagship | 90% | Not shown |
| gemini-3.5-flash-lite | Low cost | 91% | Mastered |
| gpt-6-luna | Low cost | 90% | Mastered |
| claude-haiku-5-5 | Low cost | 90% | Not shown |
Mastered means a probability of at least 90% that the model has this knobit, estimated from its graded answers. “Not shown” means the answers do not settle it either way. How the models are tested.
What it looks like in practice
Expected result: The empty population and the failure to report instead
How it is assessed: Flags the deficient case and passes the acceptable one. Deficient: A completeness check on today's payment rows reports 100 % on a day the payment feed failed and loaded nothing Acceptable: The runner reports an empty population as its own outcome, not as a pass; a timeliness or volume check on the same table catches the missing load
Also known as: Empty population reported as a pass (data quality rule)
Related knobits
Builds on
All 30 knobits of Derive data quality rules.
Source: Review checklist 03-dq-rules (data-quality), row 26; Loshin 2011; this skill; formerly data-modelling K-726