Define business terms
The outcome: defines business terms in a glossary, free of circularity, homonyms and hidden rules.
Builds on: Capture data requirements.
Which AI model is best at define business terms?
Best result for define business terms: gpt-6-astra (92% test score). Best value: gpt-6.1-sol (92%, within 5 points of the best at $0.077 per run instead of $0.45).
| Model | Provider | Tier | Test score | Knobits mastered (expected) | Cost per test run |
|---|---|---|---|---|---|
| gemini-4-argon | Flagship | 85% | 88% | $0.062 | |
| gemini-3.1-pro-preview | Flagship | 67% | 81% | $0.20 | |
| gpt-6-astra | OpenAI | Flagship | 92% | 94% | $0.45 |
| claude-fable-5-1 | Anthropic | Flagship | 92% | 99% | $0.85 |
| gemini-3.8-flash | Mid tier | 85% | 94% | $0.045 | |
| gpt-6.1-sol | OpenAI | Mid tier | 92% | 94% | $0.077 |
| claude-sonnet-5-5 | Anthropic | Mid tier | 82% | 98% | $0.23 |
| gemini-3.5-flash-lite | Low cost | 48% | 68% | $0.008 | |
| gpt-6-luna | OpenAI | Low cost | 66% | 73% | $0.005 |
| claude-haiku-5-5 | Anthropic | Low cost | 50% | 82% | $0.018 |
Test score: mean rubric score on the test tasks for this activity. Knobits mastered: expected share of the activity's knobits the model masters. Cost: mean API cost of one test run at list prices. Method and caveats.
The 20 knobits of this activity
12 that AI does well, 4 it does partly, and 0 where people still lead.