Skilirium

Recognises a check unable to fail

K-709 · Skill knobit · Activity: Derive data quality rules · Competence: Data modelling

A check of something the database already guarantees on that target — completeness of a NOT NULL column on Postgres, uniqueness of an enforced primary key — or of a definitional rule that no data can break. It always passes, inflates the quality score, and teaches people that DQ results are decoration.

Can AI do this?

AI does this well Most of the tested AI models master this. 8 of 10 models master it.

ModelTierProbability of masteryStatus
gemini-4-argonFlagship 99%Mastered
gemini-3.1-pro-previewFlagship 98%Mastered
gpt-6-astraFlagship 99%Mastered
claude-fable-5-1Flagship 99%Mastered
gemini-3.8-flashMid tier 99%Mastered
gpt-6.1-solMid tier 99%Mastered
claude-sonnet-5-5Mid tier 100%Mastered
gemini-3.5-flash-liteLow cost 46%Not shown
gpt-6-lunaLow cost 66%Not shown
claude-haiku-5-5Low cost 99%Mastered

Mastered means a probability of at least 90% that the model has this knobit, estimated from its graded answers. “Not shown” means the answers do not settle it either way. How the models are tested.

What it looks like in practice

Expected result: The check and its removal or rescoping

How it is assessed: Flags the deficient case and passes the acceptable one. Deficient: DQ-002: IBAN present, account_identifier NOT NULL on Postgres, threshold 100 %, green forever Acceptable: Removed; or, where the constraint is enforced on one target and not another, scoped in its comment to the target that needs it. A stored derivation is checked as a stored column (row 4), not as a definition

Also known as: Check that cannot fail (data quality rule)

Related knobits

Builds on

All 31 knobits of Derive data quality rules.

Source: Review checklist 07-dq-rules, row 9; Witt 2012; DAMA UK 2013