Skilirium

Recognises free text where a vocabulary is needed

C-303 · Skill knobit · Activity: Define the content metadata schema · Competence: Document and content management

An element ruled or filtered on, captured as free text.

Can AI do this?

Not settled yet The benchmark tested this, but the models' answers do not settle yet whether they master it. 0 of 4 models in the current benchmark master it.

ModelTierProbability of masteryStatus
gemini-4-argonFlagship 56%Not shown
gemini-3.5-flash-liteLow cost 51%Not shown
gpt-6-lunaLow cost 54%Not shown
claude-haiku-5-5Low cost 54%Not shown

Mastered means a probability of at least 90% that the model has this knobit, estimated from its graded answers. “Not shown” means the answers do not settle it either way. How the models are tested.

What it looks like in practice

Expected result: The element and its controlled list

How it is assessed: Flags the deficient case and passes the acceptable one. Deficient: ME-004 document_type free text Acceptable: Controlled list per class

Also known as: Free text where a vocabulary is needed

Related knobits

Builds on

All 15 knobits of Define the content metadata schema.

Source: Review checklist 03-content-metadata, row 3 (23081-2; DC)