Recognises a gap in a partition of cases
A set of rules divides a concept into cases and the cases do not cover it. The uncovered case silently has no rule.
Can AI do this?
People still lead Few or none of the tested AI models showed they master this. 1 of 10 models master it.
| Model | Tier | Probability of mastery | Status |
|---|---|---|---|
| gemini-4-argon | Flagship | 80% | Not shown |
| gemini-3.1-pro-preview | Flagship | 1% | Not shown |
| gpt-6-astra | Flagship | 6% | Not shown |
| claude-fable-5-1 | Flagship | 82% | Not shown |
| gemini-3.8-flash | Mid tier | 0% | Not shown |
| gpt-6.1-sol | Mid tier | 6% | Not shown |
| claude-sonnet-5-5 | Mid tier | 100% | Mastered |
| gemini-3.5-flash-lite | Low cost | 22% | Not shown |
| gpt-6-luna | Low cost | 15% | Not shown |
| claude-haiku-5-5 | Low cost | 1% | Not shown |
Mastered means a probability of at least 90% that the model has this knobit, estimated from its graded answers. “Not shown” means the answers do not settle it either way. How the models are tested.
What it looks like in practice
Expected result: The case no rule covers
How it is assessed: Flags the deficient case and passes the acceptable one. Deficient: Rules for status OPN and CLS, while the value set also allows DOR and BLK Acceptable: A rule per value, or one rule over the whole value set, so adding a value forces a decision
Also known as: Gap in a partition (data rule)
Related knobits
Builds on
All 28 knobits of Document data rules as SBVR fact types and rule statements.
Source: Review checklist 03-data-rules, row 9