Skilirium

Define business terms in the glossary

Activity 3 of 6 in Metadata management · Occupation: Metadata manager

The outcome: defines business terms in a glossary, free of circularity, homonyms and hidden rules.

Builds on: Design the metamodel.

Which AI model is best at define business terms in the glossary?

Best result for define business terms in the glossary: gemini-4-argon (95% test score).

ModelProviderTierTest scoreKnobits mastered (expected)Cost per test run
gemini-4-argonGoogleFlagship95% 92%$0.021
gemini-3.1-pro-preview*GoogleFlagship67% 81%$0.20
gpt-6-astra*OpenAIFlagship92% 94%$0.45
claude-fable-5-1*AnthropicFlagship92% 99%$0.85
gemini-3.8-flash*GoogleMid tier85% 94%$0.045
gpt-6.1-sol*OpenAIMid tier92% 94%$0.077
claude-sonnet-5-5*AnthropicMid tier82% 98%$0.23
gemini-3.5-flash-liteGoogleLow cost48% 46%$0.003
gpt-6-lunaOpenAILow cost80% 60%$0.002
claude-haiku-5-5AnthropicLow cost50% 74%$0.006

* From the earlier benchmark of 2026-10: 10 data-modelling test tasks, 3 runs per task, graded by claude-opus-5-5. These models have not taken the current 123 tasks yet; the two methods differ, so compare their figures with care. They are left out of the “most models” counts and the best-model picks.

Test score: mean rubric score on the test tasks for this activity. Knobits mastered: expected share of the activity's knobits the model masters. Cost: mean API cost of one test run at list prices, half price for answers sent as a batch. Method and caveats.

The 18 knobits of this activity

5 that AI does well, 5 it does partly, and 8 where people still lead.

IDKnobitTypeAI exposure (models mastering)
M-301Recognises a definition circular within itselfSkillPeople still lead 0/4
M-302Recognises terms defined by each otherSkillAI does this partly 2/4
M-303Recognises a negative definitionSkillPeople still lead 0/4
M-304Recognises a definition too broad for its conceptSkillPeople still lead 0/4
M-305Recognises a definition too narrow for its conceptSkillPeople still lead 1/4
M-306Recognises a general concept tied to one subject fieldSkillPeople still lead 0/4
M-307Recognises a part concept tied to one wholeSkillAI does this partly 2/4
M-308Recognises an incomplete extensional definitionSkillAI does this well 3/4
M-309Recognises a hidden definition of a second conceptSkillPeople still lead 0/4
M-310Recognises a definition without a superordinate conceptSkillPeople still lead 0/4
M-311Recognises a definition carrying non-defining contentSkillPeople still lead 1/4
M-312Recognises a definition failing the substitution testSkillAI does this partly 2/4
M-352Explains the substitution principle for definitionsKnowledgeAI does this well 3/4
M-354Explains extensional definitions and their completenessKnowledgeAI does this well 3/4
M-355Explains circularity in definitions and concept systemsKnowledgeAI does this partly 2/4
M-356Explains essential and delimiting characteristicsKnowledgeAI does this well 3/4
M-357Explains subject fields and field-specific conceptsKnowledgeAI does this partly 2/4
M-313Writes an intensional definition of a business termSkillAI does this well 3/4