Skilirium

Recognises a critical data element with no service level

Q-706 · Skill knobit · Activity: Set data quality service levels and the scorecard · Competence: Data quality

A CDE missing from the scorecard.

Can AI do this?

AI does this partly Some of the tested AI models master this; others do not show it. 2 of 4 models in the current benchmark master it.

ModelTierProbability of masteryStatus
gemini-4-argonFlagship 90%Mastered
gemini-3.5-flash-liteLow cost 89%Not shown
gpt-6-lunaLow cost 90%Mastered
claude-haiku-5-5Low cost 90%Not shown

Mastered means a probability of at least 90% that the model has this knobit, estimated from its graded answers. “Not shown” means the answers do not settle it either way. How the models are tested.

What it looks like in practice

Expected result: The service level and scorecard line for the element

How it is assessed: Flags the deficient case and passes the acceptable one. Deficient: CD-008 forbearance_flag Acceptable: SL and SC lines for CD-008

Also known as: Critical element with no service level

Related knobits

Builds on

All 10 knobits of Set data quality service levels and the scorecard.

Source: Review checklist 07-sla-scorecard, row 6 (BCBS 239 P4; DMBOK)