Describe the catalogue entries
The outcome: describes each catalogued object so a stranger can use it and knows whom to call.
Builds on: Design the metamodel, Define business terms in the glossary.
Which AI model is best at describe the catalogue entries?
| Model | Provider | Tier | Test score | Knobits mastered (expected) | Cost per test run |
|---|---|---|---|---|---|
| gemini-4-argon | Flagship | – | 90% | $0.021 | |
| gemini-3.5-flash-lite | Low cost | – | 48% | $0.003 | |
| gpt-6-luna | OpenAI | Low cost | – | 80% | $0.002 |
| claude-haiku-5-5 | Anthropic | Low cost | – | 79% | $0.006 |
Test score: mean rubric score on the test tasks for this activity. Knobits mastered: expected share of the activity's knobits the model masters. Cost: mean API cost of one test run at list prices, half price for answers sent as a batch. Method and caveats.
The 12 knobits of this activity
0 that AI does well, 1 it does partly, and 11 where people still lead.