Recognises a definition dispute citing no terms
A dispute about meaning that cites no glossary terms; nobody can find the definitions at stake.
Can AI do this?
AI does this partly Some of the tested AI models master this; others do not show it. 2 of 4 models in the current benchmark master it.
| Model | Tier | Probability of mastery | Status |
|---|---|---|---|
| gemini-4-argon | Flagship | 90% | Mastered |
| gemini-3.5-flash-lite | Low cost | 85% | Not shown |
| gpt-6-luna | Low cost | 90% | Not shown |
| claude-haiku-5-5 | Low cost | 91% | Mastered |
Mastered means a probability of at least 90% that the model has this knobit, estimated from its graded answers. “Not shown” means the answers do not settle it either way. How the models are tested.
What it looks like in practice
Expected result: The issue and the terms at stake
How it is assessed: Flags the deficient case and passes the acceptable one. Deficient: GI-018 "Hold means different things in core banking and the app", terms: [] Acceptable: terms: [BT-107]
Also known as: Definition dispute with no terms
Related knobits
Builds on
All 20 knobits of Manage and escalate governance issues.
Source: Review checklist 05-issue-management, row 16 (DMBOK)