Diagnose Eval Failure

Explain WHY a model scored low on an eval — read the judge's reasons and the agent's trajectory, compare against the task rubric, and produce a rationale (capability gap vs. task/rubric problem). Distinct from infrastructure failures. Invoke when someone asks "why did the model fail this task?", "why is OutcomeValidity low?", "explain this low score", or "did the agent actually do the work?".

kubernetes-sigs Updated

File contents

kubernetes-sigs/devops-bench commit 191e7377c6

Frequently asked questions

npx get-skill add kubernetes-sigs/diagnose-eval-failure