Eval Generator

Generates eval test cases for AI agents from an eval suite plan (output of /eval-suite-planner) or a plain-English agent description. Supports both single-response and conversation (multi-turn) evaluation modes. Outputs a test set table, a CSV file in the Copilot Studio import format (single-response only - used here as the primary worked example; trivially adaptable to any harness that accepts tabular test cases), and a docx report for human review.

varunk130 Updated 7 repo stars
AI Eval Skills — Plan, generate, run, interpret, and triage evaluations for any AI agent

File contents

varunk130/AI-Eval-Skills commit ee91a06339

Frequently asked questions

npx get-skill add varunk130/eval-generator