Testing your helper's safeguards: a test suite and an accuracy report

The scenario runs dozens of unsafe and harmless test cases through your safeguards, calculates the accuracy and emails you the report.

  • It tests several kinds of risk, not just one
  • It catches both misses and false alarms
  • The result is a concrete accuracy figure, not a feeling
  • A report broken down by category arrives by email