Skilirium

Recognises overlapping rules alerting twice

N-608 · Skill knobit · Activity: Set event thresholds and alerts · Competence: Data integration and interoperability

Two rules raising separate alerts for one event with no correlation.

Can AI do this?

AI does this partly Some of the tested AI models master this; others do not show it. 2 of 4 models in the current benchmark master it.

ModelTierProbability of masteryStatus
gemini-4-argonFlagship 98%Mastered
gemini-3.5-flash-liteLow cost 26%Not shown
gpt-6-lunaLow cost 8%Not shown
claude-haiku-5-5Low cost 97%Mastered

Mastered means a probability of at least 90% that the model has this knobit, estimated from its graded answers. “Not shown” means the answers do not settle it either way. How the models are tested.

What it looks like in practice

Expected result: The rules and one correlated case

How it is assessed: Flags the deficient case and passes the acceptable one. Deficient: ER-001 and ER-005 both alert on every transfer over EUR 15 000 to a new payee Acceptable: One correlated case

Also known as: Overlapping rules alerting twice

Related knobits

Builds on

All 15 knobits of Set event thresholds and alerts.

Source: Review checklist 06-event-thresholds, row 8 (27002 8.16)