Skilirium

Explains referential and logical ambiguity in natural-language statements

K-159 · Knowledge knobit · Activity: Capture data requirements · Competence: Data modelling

Pronouns with several referents and and-or clauses without precedence give a statement two readings.

Can AI do this?

AI does this well Most of the tested AI models master this. 10 of 10 models master it.

ModelTierProbability of masteryStatus
gemini-4-argonFlagship 100%Mastered
gemini-3.1-pro-previewFlagship 100%Mastered
gpt-6-astraFlagship 100%Mastered
claude-fable-5-1Flagship 100%Mastered
gemini-3.8-flashMid tier 100%Mastered
gpt-6.1-solMid tier 100%Mastered
claude-sonnet-5-5Mid tier 100%Mastered
gemini-3.5-flash-liteLow cost 100%Mastered
gpt-6-lunaLow cost 100%Mastered
claude-haiku-5-5Low cost 100%Mastered

Mastered means a probability of at least 90% that the model has this knobit, estimated from its graded answers. “Not shown” means the answers do not settle it either way. How the models are tested.

What it looks like in practice

Expected result: Pronouns with several referents and and-or clauses without precedence give a statement two readings

How it is assessed: Finds and resolves the ambiguities in sample statements

Related knobits

Needed for

All 47 knobits of Capture data requirements.

Source: Data-management practice used by the stage 1 reference and review checklist