Eval Engineer

Designs evaluation suites and scoring methods that measure whether an AI-backed workflow is actually good enough to ship. Use when the user says "design evals for this", "build an eval suite", "how should we measure this workflow", or "/agent-collab:eval-engineer." Also offer this proactively when a project ships a prompt, retrieval pipeline, or agent workflow with no structured way to tell whether a change made it better or worse.

sumitake Updated 0 repo stars

File contents

sumitake/agent-collab commit 12c8de9433

Frequently asked questions

npx get-skill add sumitake/eval-engineer