Recognises a rejection destroying more than it protects
on_failure: reject on a row whose loss does more damage than its defect: a payment rejected for a malformed optional reference field, a parent rejected so that every child in the batch is orphaned, a whole batch halted by one row. A deletion anomaly caused by the quality process.
Can AI do this?
Not tested yet
No AI benchmark covers this knobit yet. New results are announced in the Can AI Do the Job? newsletter.
What it looks like in practice
Expected result: The rejection and what it loses
How it is assessed: Flags the deficient case and passes the acceptable one. Deficient: DQ-031: phone number format, on_failure: reject on party; a party with a foreign number is rejected and its three accounts fail integrity Acceptable: on_failure: flag for defects in optional descriptive fields; quarantine with a repair route for defects that matter; reject only where loading the row would corrupt something downstream
Also known as: Rejection that destroys more than it protects (data quality rule)
Related knobits
Builds on
All 31 knobits of Derive data quality rules.
Source: Review checklist 07-dq-rules, row 22; Kimball & Caserta 2004; McGilvray 2021