Recognises a missing or wrong requirement trace
A confirmed must requirement that no business term (stage 2) and, later, no physical column realises: the business asked, everyone agreed, nothing was built. Also a terms link to a term that does not realise the requirement, which passes every script check and traces the need to the wrong thing.
Can AI do this?
AI does this partly Some of the tested AI models master this; others do not show it. 4 of 10 models master it.
| Model | Tier | Probability of mastery | Status |
|---|---|---|---|
| gemini-4-argon | Flagship | 0% | Not mastered |
| gemini-3.1-pro-preview | Flagship | 9% | Not shown |
| gpt-6-astra | Flagship | 0% | Not mastered |
| claude-fable-5-1 | Flagship | 100% | Mastered |
| gemini-3.8-flash | Mid tier | 100% | Mastered |
| gpt-6.1-sol | Mid tier | 10% | Not shown |
| claude-sonnet-5-5 | Mid tier | 100% | Mastered |
| gemini-3.5-flash-lite | Low cost | 8% | Not shown |
| gpt-6-luna | Low cost | 10% | Not mastered |
| claude-haiku-5-5 | Low cost | 100% | Mastered |
Mastered means a probability of at least 90% that the model has this knobit, estimated from its graded answers. “Not shown” means the answers do not settle it either way. How the models are tested.
What it looks like in practice
Expected result: The confirmed requirement nothing realises, or the wrong trace
How it is assessed: Flags the deficient case and passes the acceptable one. Deficient: DR-004 (disputes specialist), must, confirmed, terms: []. DR-002 (settlement currency) citing BT-002 Payment Payment Value Date Acceptable: DR-004 citing the Disputes Specialist term, carried through to a column, or deliberately deferred with a reason. DR-002 citing BT-007 Settlement Currency.
Also known as: Trace missing or wrong (data requirement)
Related knobits
Builds on
All 47 knobits of Capture data requirements.
Source: Review checklist 01-requirements, row 33; REQ-008, TRC-001