SeedSweep

Guides

Each guide explains a check your own team can run on the numbers behind an AI system or its data.

Support chatbots

  • Containment rate vs resolution rate

    Containment rate is the share of chatbot conversations that ended without reaching a person. Resolution rate is the share the vendor counts as resolved, under a rule the vendor writes.

Benchmarks and AI models

  • How to check if a benchmark score can be trusted

    Before you trust a benchmark score, check that its grader accepts correct answers and rejects wrong ones, that its tasks are clear and that the model shows no sign of having seen them during training.