Recognises a decision against a policy with no exception
The decision departs from an approved policy or standard and policy_exception is null. The policy is now wrong or the decision is unauthorised.
Can AI do this?
AI does this well Most of the tested AI models master this. 3 of 4 models in the current benchmark master it.
| Model | Tier | Probability of mastery | Status |
|---|---|---|---|
| gemini-4-argon | Flagship | 92% | Mastered |
| gemini-3.5-flash-lite | Low cost | 11% | Not shown |
| gpt-6-luna | Low cost | 92% | Mastered |
| claude-haiku-5-5 | Low cost | 91% | Mastered |
Mastered means a probability of at least 90% that the model has this knobit, estimated from its graded answers. “Not shown” means the answers do not settle it either way. How the models are tested.
What it looks like in practice
Expected result: The decision, the policy and the exception needed
How it is assessed: Flags the deficient case and passes the acceptable one. Deficient: GI-014 decided: keep erased customers' transaction data indefinitely for fraud analytics — against PO-004 / ST-008 Acceptable: An exception (EX-nnn) granted by the exception authority, or the policy changed by its approver, or the decision reversed
Also known as: Decision contradicts a policy, no exception
Related knobits
Builds on
All 20 knobits of Manage and escalate governance issues.
Source: Review checklist 05-issue-management, row 12 (DCAM; 38505 conformance)