State the metadata requirements and strategy
The outcome: states metadata requirements as use cases with users, sources and achievable freshness.
Which AI model is best at state the metadata requirements and strategy?
| Model | Provider | Tier | Test score | Knobits mastered (expected) | Cost per test run |
|---|---|---|---|---|---|
| gemini-4-argon | Flagship | – | 72% | $0.021 | |
| gemini-3.5-flash-lite | Low cost | – | 0% | $0.003 | |
| gpt-6-luna | OpenAI | Low cost | – | 43% | $0.002 |
| claude-haiku-5-5 | Anthropic | Low cost | – | 71% | $0.006 |
Test score: mean rubric score on the test tasks for this activity. Knobits mastered: expected share of the activity's knobits the model masters. Cost: mean API cost of one test run at list prices, half price for answers sent as a batch. Method and caveats.
The 13 knobits of this activity
1 that AI does well, 1 it does partly, and 11 where people still lead.