Analyse the impact of a change
The outcome: finds every object a change reaches, the effect on it and whom to tell.
Builds on: Describe the catalogue entries, Trace column-level lineage.
Which AI model is best at analyse the impact of a change?
| Model | Provider | Tier | Test score | Knobits mastered (expected) | Cost per test run |
|---|---|---|---|---|---|
| gemini-4-argon | Flagship | – | 90% | $0.021 | |
| gemini-3.5-flash-lite | Low cost | – | 80% | $0.003 | |
| gpt-6-luna | OpenAI | Low cost | – | 77% | $0.002 |
| claude-haiku-5-5 | Anthropic | Low cost | – | 88% | $0.006 |
Test score: mean rubric score on the test tasks for this activity. Knobits mastered: expected share of the activity's knobits the model masters. Cost: mean API cost of one test run at list prices, half price for answers sent as a batch. Method and caveats.
The 9 knobits of this activity
1 that AI does well, 0 it does partly, and 8 where people still lead.
| ID | Knobit | Type | AI exposure (models mastering) |
|---|---|---|---|
| M-601 | Recognises a downstream report missed through a view | Skill | People still lead 0/4 |
| M-602 | Recognises an impacted object with no owner to notify | Skill | People still lead 0/4 |
| M-603 | Recognises an impacted object missed through a manual step | Skill | People still lead 0/4 |
| M-604 | Recognises a semantic change assessed as a schema change | Skill | People still lead 0/4 |
| M-605 | Recognises an impacted object with no action | Skill | People still lead 0/4 |
| M-606 | Recognises an unreached object listed in an impact analysis | Skill | People still lead 0/4 |
| M-651 | Explains impact analysis as the downstream closure of lineage | Knowledge | People still lead 0/4 |
| M-652 | Explains the kinds of data change and their reach | Knowledge | People still lead 0/4 |
| M-653 | Explains change enablement for data changes | Knowledge | AI does this well 3/4 |