Explains like-for-like trends of quality measures
A trend compares results over the same population; when the population changes (a migration, a new product, a closed channel) the line says so and shows the like-for-like series (ISO/IEC 25024:2015).
Can AI do this?
People still lead Few or none of the tested AI models showed they master this. 0 of 4 models in the current benchmark master it.
| Model | Tier | Probability of mastery | Status |
|---|---|---|---|
| gemini-4-argon | Flagship | 93% | Not shown |
| gemini-3.5-flash-lite | Low cost | 89% | Not shown |
| gpt-6-luna | Low cost | 93% | Not shown |
| claude-haiku-5-5 | Low cost | 94% | Not shown |
Mastered means a probability of at least 90% that the model has this knobit, estimated from its graded answers. “Not shown” means the answers do not settle it either way. How the models are tested.
What it looks like in practice
Expected result: A trend compares results over the same population; when the population changes (a migration, a new product, a closed channel) the line says so and shows the like-for-like series (ISO/IEC 25024:2015).
How it is assessed: Answers a written question on the quality measure trend correctly
Related knobits
Builds on
- Q-453 Explains ISO/IEC 25024 data quality measures
- Q-1901 Explains a pooled rate as the weighted mean of its population rates
Needed for
All 10 knobits of Set data quality service levels and the scorecard.
Source: Practice the stage 7 reference and review checklist rest on