Stage 7: Derive data quality rules
Knobit of Data modelling · K-722 · Skill
Recognises a rejection destroying more than it protects
What it means
`on_failure: reject` on a row whose loss does more damage than its defect: a payment rejected for a malformed optional reference field, a parent rejected so that every child in the batch is orphaned, a whole batch halted by one row. A deletion anomaly caused by the quality process.
How it is assessed
Flags the deficient case and passes the acceptable one. Deficient: `DQ-031: phone number format`, `on_failure: reject` on `party`; a party with a foreign number is rejected and its three accounts fail integrity Acceptable: `on_failure: flag` for defects in optional descriptive fields; `quarantine` with a repair route for defects that matter; `reject` only where loading the row would corrupt something downstream
Builds on
- Explains severity, threshold and failure actionK-755 · Knowledge
Needed by
- None