Knobit of Data modelling · K-725 · Skill

Recognises an aggregate hiding a total failure

What it means

A pass rate over the whole table that hides a part of it failing completely: one source system, one load, one region, one new product. 98 % overall can be 0 % for everything loaded since Tuesday.

How it is assessed

Flags the deficient case and passes the acceptable one. Deficient: Completeness of `customer_segment_code` measured over twelve million rows; a new source sends none for a week, the rate falls from 99.1 % to 98.9 %, and nothing alerts Acceptable: Measured per load batch or per source (`population` or a grouping in the `set` query), or a second check scoped to the latest load

Builds on

Explains segmented data quality reportingK-757 · Knowledge

Needed by

None