Eval Harness

Automated evaluation harness for measuring agent and LLM performance, preventing regressions, and enabling eval-driven development. Use when setting up systematic quality gates for AI-assisted workflows or when you need measurable pass/fail criteria for non-deterministic outputs. Distinguishes itself through pass@k/pass^k metrics, LLM-as-judge patterns, cost tracking per eval run, and CI/CD integration with coverage mapping.

k1lgor Updated 9 repo stars
Mega-Mind Skills System — a glowing circuit brain orchestrating a ring of skill nodes

File contents

k1lgor/mega-mind-skills commit f88ebc17cd

Frequently asked questions

npx get-skill add k1lgor/eval-harness