Recognises colliding data principles with no precedence
Two principles that a realistic case puts in opposite directions, with nothing saying which wins. Every such case becomes a council agenda item.
Can AI do this?
Not settled yet The benchmark tested this, but the models' answers do not settle yet whether they master it. 0 of 4 models in the current benchmark master it.
| Model | Tier | Probability of mastery | Status |
|---|---|---|---|
| gemini-4-argon | Flagship | 60% | Not shown |
| gemini-3.5-flash-lite | Low cost | 48% | Not shown |
| gpt-6-luna | Low cost | 60% | Not shown |
| claude-haiku-5-5 | Low cost | 59% | Not shown |
Mastered means a probability of at least 90% that the model has this knobit, estimated from its graded answers. “Not shown” means the answers do not settle it either way. How the models are tested.
What it looks like in practice
Expected result: The pair and the case where they collide
How it is assessed: Flags the deficient case and passes the acceptable one. Deficient: DP-003 Data is shared by default across the bank and DP-004 Access to customer data is granted on a need-to-know basis, no precedence Acceptable: Narrow one ("...internal, non-personal data is shared by default") or set precedence and an implication: "Where personal data is involved, DP-004 prevails."
Also known as: Contradicting principles with no precedence
Related knobits
Builds on
Usually followed by
All 25 knobits of Set the data strategy and principles.
Source: Review checklist 01-strategy-principles, row 12 (TOGAF; 38505 conformance)