Debug Evals

Debug haiku.rag evaluation runs in Logfire. Use when asked to look at Logfire for an eval run, find failing or low-scoring eval cases, compare runs, check citation quality (cited_map) or judge pass rate (answer_equivalent), or explain why an eval case failed. Drives the Logfire MCP against the `evals` service, or the Logfire HTTP query API when the MCP is not loaded. Also covers monitoring a run that is still in flight.

ggozad Updated

File contents

ggozad/haiku.rag commit 5fc6ebc79f

Frequently asked questions

npx get-skill add ggozad/debug-evals