Skilirium

Stage 7: Derive data quality rules

Knobit of Data modelling · K-721 · Skill

Recognises disagreeing severity, threshold and failure action

What it means

`severity`, `threshold` and `on_failure` telling different stories: a `warning` that rejects rows, an `error` that only reports, a threshold below 100 % on a check that rejects every failing row anyway. Somebody disagreed and nobody decided.

How it is assessed

Flags the deficient case and passes the acceptable one. Deficient: `severity: warning`, `on_failure: reject` Acceptable: `severity: error`, `on_failure: quarantine`, threshold 100 %; or `severity: warning`, `on_failure: flag`, threshold at the agreed rate (`DQR-015`, `DQR-026`)

Builds on

Needed by

  • None