Explains the definition of a measure and its population
Formula, source holding the data, numerator and denominator with a population that keeps its meaning, and readings the formula can produce (ISO/IEC 25024).
Can AI do this?
AI does this well Most of the tested AI models master this. 3 of 4 models in the current benchmark master it.
| Model | Tier | Probability of mastery | Status |
|---|---|---|---|
| gemini-4-argon | Flagship | 100% | Mastered |
| gemini-3.5-flash-lite | Low cost | 99% | Not shown |
| gpt-6-luna | Low cost | 100% | Mastered |
| claude-haiku-5-5 | Low cost | 100% | Mastered |
Mastered means a probability of at least 90% that the model has this knobit, estimated from its graded answers. “Not shown” means the answers do not settle it either way. How the models are tested.
What it looks like in practice
Expected result: Formula, source holding the data, numerator and denominator with a population that keeps its meaning, and readings the formula can produce (ISO/IEC 25024).
How it is assessed: Answers a written question on the measure definition and population correctly
Related knobits
Needed for
- G-604 Recognises a governance metric with no source
- G-611 Recognises a metric source unable to produce it
- G-613 Recognises an impossible metric reading
- Q-703 Recognises a quality trend read without its population change
- Q-752 Explains deriving a scorecard headline from its critical lines
All 21 knobits of Build the governance scorecard.
Source: Practice the stage 6 reference and review checklist rest on