Recognises an absolute statement with its exception unasked
every, always, never, exactly one, all stated with nobody having asked when it is not true. Usually the optional side has been assumed mandatory because the sample data always had a value.
Can AI do this?
AI does this partly Some of the tested AI models master this; others do not show it. 6 of 10 models master it.
| Model | Tier | Probability of mastery | Status |
|---|---|---|---|
| gemini-4-argon | Flagship | 100% | Mastered |
| gemini-3.1-pro-preview | Flagship | 84% | Not shown |
| gpt-6-astra | Flagship | 100% | Mastered |
| claude-fable-5-1 | Flagship | 100% | Mastered |
| gemini-3.8-flash | Mid tier | 100% | Mastered |
| gpt-6.1-sol | Mid tier | 100% | Mastered |
| claude-sonnet-5-5 | Mid tier | 81% | Not shown |
| gemini-3.5-flash-lite | Low cost | 34% | Not shown |
| gpt-6-luna | Low cost | 31% | Not shown |
| claude-haiku-5-5 | Low cost | 100% | Mastered |
Mastered means a probability of at least 90% that the model has this knobit, estimated from its graded answers. “Not shown” means the answers do not settle it either way. How the models are tested.
What it looks like in practice
Expected result: The absolute and the case it may not hold for
How it is assessed: Flags the deficient case and passes the acceptable one. Deficient: "Every account has one account holder." Acceptable: "Every sole account has exactly one account holder. A joint account has at least two." (both sourced, or the second as an open_question)
Also known as: Absolute without the exception (data requirement)
Related knobits
Builds on
All 47 knobits of Capture data requirements.
Source: Review checklist 01-requirements, row 11; Stage 1 (hunt for the exceptions); 29148 5.2.5 (correct)