Skilirium

Recognises non-production linked to production

O-207 · Skill knobit · Activity: Plan environments and capacity · Competence: Data storage and operations

Shared credentials or network paths: a test can change production.

Can AI do this?

AI does this partly Some of the tested AI models master this; others do not show it. 2 of 4 models in the current benchmark master it.

ModelTierProbability of masteryStatus
gemini-4-argonFlagship 97%Mastered
gemini-3.5-flash-liteLow cost 20%Not shown
gpt-6-lunaLow cost 97%Mastered
claude-haiku-5-5Low cost 24%Not shown

Mastered means a probability of at least 90% that the model has this knobit, estimated from its graded answers. “Not shown” means the answers do not settle it either way. How the models are tested.

What it looks like in practice

Expected result: The defect named on the non-production using production credentials or links, and its fix or the question for its owner

How it is assessed: Flags the deficient case and passes the acceptable one. Deficient: EV-004 uses the production service account Acceptable: Separate credentials and network zones

Also known as: Non-production linked to production

Related knobits

Builds on

All 15 knobits of Plan environments and capacity.

Source: Review checklist 02-environments-capacity, row 7 (27002 8.31)