Skilirium

Explains extensional definitions and their completeness

M-354 · Knowledge knobit · Activity: Define business terms in the glossary · Competence: Metadata management

A definition listing all and only the members, and when a list belongs in a note or a value set.

Can AI do this?

AI does this well Most of the tested AI models master this. 3 of 4 models in the current benchmark master it.

ModelTierProbability of masteryStatus
gemini-4-argonFlagship 98%Mastered
gemini-3.1-pro-preview*Flagship 100%Mastered
gpt-6-astra*Flagship 100%Mastered
claude-fable-5-1*Flagship 100%Mastered
gemini-3.8-flash*Mid tier 100%Mastered
gpt-6.1-sol*Mid tier 100%Mastered
claude-sonnet-5-5*Mid tier 100%Mastered
gemini-3.5-flash-liteLow cost 96%Mastered
gpt-6-lunaLow cost 98%Mastered
claude-haiku-5-5Low cost 65%Not shown

* From the earlier benchmark of 2026-10: 10 data-modelling test tasks, 3 runs per task, graded by claude-opus-5-5. These models have not taken the current 123 tasks yet; the two methods differ, so compare their figures with care. They are left out of the “most models” counts and the best-model picks.

Mastered means a probability of at least 90% that the model has this knobit, estimated from its graded answers. “Not shown” means the answers do not settle it either way. How the models are tested.

What it looks like in practice

Expected result: A definition listing all and only the members, and when a list belongs in a note or a value set

How it is assessed: Decides for sample definitions whether the list is complete and what to do if not

Related knobits

Needed for

All 18 knobits of Define business terms in the glossary.

Source: Data-management practice used by the stage 3 reference and review checklist; formerly data-modelling K-254