Recognises a drop script used as a rollback
99_drop_tables.sql in a release runbook's rollback step. It drops the tables in reverse dependency order, which is a rollback for a greenfield deploy into a scratch or CI database. Anywhere else it is a data-loss procedure with a reassuring filename.
Can AI do this?
AI does this partly Some of the tested AI models master this; others do not show it. 3 of 10 models master it.
| Model | Tier | Probability of mastery | Status |
|---|---|---|---|
| gemini-4-argon | Flagship | 100% | Mastered |
| gemini-3.1-pro-preview | Flagship | 25% | Not shown |
| gpt-6-astra | Flagship | 100% | Mastered |
| claude-fable-5-1 | Flagship | 27% | Not shown |
| gemini-3.8-flash | Mid tier | 25% | Not shown |
| gpt-6.1-sol | Mid tier | 100% | Mastered |
| claude-sonnet-5-5 | Mid tier | 27% | Not shown |
| gemini-3.5-flash-lite | Low cost | 27% | Not shown |
| gpt-6-luna | Low cost | 25% | Not shown |
| claude-haiku-5-5 | Low cost | 27% | Not shown |
Mastered means a probability of at least 90% that the model has this knobit, estimated from its graded answers. “Not shown” means the answers do not settle it either way. How the models are tested.
What it looks like in practice
Expected result: The data it would remove and the real rollback
How it is assessed: Flags the deficient case and passes the acceptable one. Deficient: The runbook for a fact_payment change says "on failure, run 99_drop_tables.sql and redeploy"; run against the warehouse it removes four years of payments and every dimension they pointed at Acceptable: 99_drop_tables.sql used only to rebuild the CI scratch database. The migration's rollback is written with the migration, and the runbook names the restore point for every step that cannot be reversed
Also known as: Drop script used as a migration rollback (generated DDL)
Related knobits
Builds on
All 33 knobits of Generate and review DDL.
Source: Review checklist 08-ddl, row 23; this skill (08-ddl.md); Humble & Farley 2010