Resolves contradicting rules by adding the missing condition
Repairs a contradiction by finding the case each rule was written for and restricting it to that case.
Can AI do this?
AI does this well Most of the tested AI models master this. 7 of 10 models master it.
| Model | Tier | Probability of mastery | Status |
|---|---|---|---|
| gemini-4-argon | Flagship | 100% | Mastered |
| gemini-3.1-pro-preview | Flagship | 83% | Not shown |
| gpt-6-astra | Flagship | 100% | Mastered |
| claude-fable-5-1 | Flagship | 100% | Mastered |
| gemini-3.8-flash | Mid tier | 100% | Mastered |
| gpt-6.1-sol | Mid tier | 100% | Mastered |
| claude-sonnet-5-5 | Mid tier | 100% | Mastered |
| gemini-3.5-flash-lite | Low cost | 30% | Not shown |
| gpt-6-luna | Low cost | 32% | Not shown |
| claude-haiku-5-5 | Low cost | 100% | Mastered |
Mastered means a probability of at least 90% that the model has this knobit, estimated from its graded answers. “Not shown” means the answers do not settle it either way. How the models are tested.
What it looks like in practice
Expected result: Rules restricted by the condition under which each holds
How it is assessed: The contradiction is resolved by a condition such as a subtype; neither rule is deleted and neither is kept unchanged
Related knobits
Builds on
All 28 knobits of Document data rules as SBVR fact types and rule statements.
Source: Graded on its own by the stage 3 skill-tests task; no review-checklist row names it