Explains the components of a metric definition
Numerator and denominator each with its population, time semantics (point in time, period sum, period average), currency, rounding and owner (DMBOK2 ch. 11; ISO/IEC 11179-4).
Can AI do this?
AI does this well Most of the tested AI models master this. 3 of 4 models in the current benchmark master it.
| Model | Tier | Probability of mastery | Status |
|---|---|---|---|
| gemini-4-argon | Flagship | 100% | Mastered |
| gemini-3.5-flash-lite | Low cost | 100% | Mastered |
| gpt-6-luna | Low cost | 100% | Mastered |
| claude-haiku-5-5 | Low cost | 100% | Not shown |
Mastered means a probability of at least 90% that the model has this knobit, estimated from its graded answers. “Not shown” means the answers do not settle it either way. How the models are tested.
What it looks like in practice
Expected result: Numerator and denominator each with its population, time semantics (point in time, period sum, period average), currency, rounding and owner (DMBOK2 ch. 11; ISO/IEC 11179-4).
How it is assessed: Answers a written question on the metric definition correctly
Related knobits
Needed for
- W-201 Recognises a ratio over mismatched populations
- W-202 Recognises point in time and period confused
- W-206 Recognises two definitions of one KPI
- W-208 Recognises a metric with no owner
- W-231 Reconciles two values of one KPI into quantified effects
- W-505 Recognises a report metric outside the catalogue
- W-533 Cites a catalogue metric for every panel
All 19 knobits of Define metrics and KPIs.
Source: Practice the stage 2 reference and review checklist rest on