Eval Creator

[Beta] Creates permanent eval cases from promoted learnings and runs regression checks against them. Turns failures into test cases that prevent silent regression. This is the outer loop's regress-test step. Use when a learning is promoted and has a clear pass/fail condition, or on cadence to verify promoted rules still hold.

pskoett Updated 31 repo stars

File contents

pskoett/measuring-ai-proficiency commit e91a54f410

Frequently asked questions

npx get-skill add pskoett/eval-creator