Skilirium

Recognises a definition too broad for its concept

M-304 · Skill knobit · Activity: Define business terms in the glossary · Competence: Metadata management

A delimiting characteristic is missing, so the definition covers things that are not instances of the concept.

Can AI do this?

People still lead Few or none of the tested AI models showed they master this. 0 of 4 models in the current benchmark master it.

ModelTierProbability of masteryStatus
gemini-4-argonFlagship 90%Not shown
gemini-3.1-pro-preview*Flagship 90%Not shown
gpt-6-astra*Flagship 100%Mastered
claude-fable-5-1*Flagship 100%Mastered
gemini-3.8-flash*Mid tier 100%Mastered
gpt-6.1-sol*Mid tier 100%Mastered
claude-sonnet-5-5*Mid tier 100%Mastered
gemini-3.5-flash-liteLow cost 18%Not shown
gpt-6-lunaLow cost 10%Not shown
claude-haiku-5-5Low cost 89%Not shown

* From the earlier benchmark of 2026-10: 10 data-modelling test tasks, 3 runs per task, graded by claude-opus-5-5. These models have not taken the current 123 tasks yet; the two methods differ, so compare their figures with care. They are left out of the “most models” counts and the best-model picks.

Mastered means a probability of at least 90% that the model has this knobit, estimated from its graded answers. “Not shown” means the answers do not settle it either way. How the models are tested.

What it looks like in practice

Expected result: A non-instance the definition admits and the missing characteristic

How it is assessed: Flags the deficient case and passes the acceptable one. Deficient: account: record the bank keeps for a customer (also covers customer contact records and card records) Acceptable: account: contract between the bank and one or more parties under which money is held, lent or repaid, identified by an IBAN

Also known as: Too broad (business term)

Related knobits

Builds on

Usually followed by

All 18 knobits of Define business terms in the glossary.

Source: Review checklist 03-business-glossary (metadata-management), row 4; formerly data-modelling K-204