Prompt Regression Suite

Design a regression test suite that catches an LLM feature getting worse when the prompt, model, or context changes. Use when asked to stop prompt changes breaking production, set up golden tests or CI gates for an LLM feature, or test a model/prompt upgrade before shipping it. Produces a golden case set, per-case pass criteria, CI gate thresholds, and a triage protocol for failures. For designing first-time evaluation of a new feature use ai-eval-plan instead.

Mohit Aggarwal Updated 1.6k repo stars
PM Skills: the senior colleague's notes for any AI assistant. A request in plain words loads the right skill: a deposit dispute, a PRD, a Chinese weekly report,

File contents

mohitagw15856/pm-claude-skills commit 730a189c96

Frequently asked questions

npx get-skill add mohitagw15856/prompt-regression-suite-2