Eval Set Builder

Build an evaluation set from real traffic and check whether it is large enough to support the error budget being claimed. Use when someone wants to measure model accuracy, certify an error rate, decide if a model is safe to deploy, or asks "how many test cases do we need". Refuses to certify a budget the sample cannot support.

ityaadiii Updated

File contents

ityaadiii/skills-that-say-i-dont-know commit 04b2ee3849

Frequently asked questions

npx get-skill add ityaadiii/eval-set-builder