Specifies firewall rules from classifier output
Rules stating which classes are blocked, challenged or allowed, and at which threshold
Can AI do this?
Not tested yet
No AI benchmark covers this knobit yet. New results are announced in the Can AI Do the Job? newsletter.
What it looks like in practice
Expected result: Rules stating which classes are blocked, challenged or allowed, and at which threshold
How it is assessed: Verified crawlers are never blocked, each rule has a rollback, and the false-positive rate on human visitors is stated
Related knobits
Builds on
- E-1902 Evaluates a classifier on held-out labelled examples
- E-2051 Explains the deployment of a classifier into a decision pipeline
- E-1952 Explains precision and recall of a classifier
All 3 knobits of Develop data processing applications.
Source: ESCO skill 'develop data processing applications' (ESCO v1.2.1); DO process activities P4.4; CRISP-DM 1.0; Kohavi, Tang and Xu, Trustworthy Online Controlled Experiments (2020); the assessment criterion is this register's own and is in no reference text