Recognises a migration default inventing a fact
A missing source value replaced by a business value.
Can AI do this?
AI does this partly Some of the tested AI models master this; others do not show it. 2 of 4 models in the current benchmark master it.
| Model | Tier | Probability of mastery | Status |
|---|---|---|---|
| gemini-4-argon | Flagship | 90% | Mastered |
| gemini-3.5-flash-lite | Low cost | 9% | Not shown |
| gpt-6-luna | Low cost | 90% | Not shown |
| claude-haiku-5-5 | Low cost | 90% | Mastered |
Mastered means a probability of at least 90% that the model has this knobit, estimated from its graded answers. “Not shown” means the answers do not settle it either way. How the models are tested.
What it looks like in practice
Expected result: The defect named on the missing value replaced by a business value, and its fix or the question for its owner
How it is assessed: Flags the deficient case and passes the acceptable one. Deficient: MM-004 missing interest rate set to 0 Acceptable: Rejected for the owner to decide
Also known as: Default that invents a fact
Related knobits
Builds on
All 15 knobits of Plan and prove a data migration.
Source: Review checklist 05-data-migration, row 10 (DMBOK)