Explains design and operating effectiveness of controls
Design testing shows a control exists; operating testing shows it ran, with results; supervisors test operation (ECB guide on RDARR, 2024).
Can AI do this?
Not settled yet The benchmark tested this, but the models' answers do not settle yet whether they master it. 0 of 4 models in the current benchmark master it.
| Model | Tier | Probability of mastery | Status |
|---|---|---|---|
| gemini-4-argon | Flagship | 86% | Not shown |
| gemini-3.5-flash-lite | Low cost | 60% | Not shown |
| gpt-6-luna | Low cost | 57% | Not shown |
| claude-haiku-5-5 | Low cost | 88% | Not shown |
Mastered means a probability of at least 90% that the model has this knobit, estimated from its graded answers. “Not shown” means the answers do not settle it either way. How the models are tested.
What it looks like in practice
Expected result: Design testing shows a control exists; operating testing shows it ran, with results; supervisors test operation (ECB guide on RDARR, 2024).
How it is assessed: Answers a written question on the design and operating effectiveness correctly
Related knobits
Needed for
All 21 knobits of Map BCBS 239 to controls.
Source: Practice the stage 4 reference and review checklist rest on