# Regression-test prompts, agents, and RAG outputs before shipping changes

> Use promptfoo when an agent needs to evaluate prompt, agent, or RAG behavior against saved assertions before a change goes live. The value here is the repeatable evaluation workflow, not a generic AI tooling catalog entry.

- Skill: `agentskillexchange/regression-test-prompts-agents-and-rag-outputs-before-shippi` (Agent Skill)
- Install (CLI): `npx skillmds@latest add agentskillexchange/regression-test-prompts-agents-and-rag-outputs-before-shippi`
- Raw SKILL.md: https://api.skillmd.com/api/skills/agentskillexchange/regression-test-prompts-agents-and-rag-outputs-before-shippi/raw
- Safety review: pending (external: skill-scanner PASS, skillspector PASS)
- Works with: Claude Code, Claude.ai, OpenAI Codex
- Category: AI & ML
- Author: agentskillexchange (https://skillmd.com/u/agentskillexchange)
- Updated: 2026-09-08
- Page: https://skillmd.com/skills/agentskillexchange/regression-test-prompts-agents-and-rag-outputs-before-shippi

---


# Regression-test prompts, agents, and RAG outputs before shipping changes

Use promptfoo when an agent needs to evaluate prompt, agent, or RAG behavior against saved assertions before a change goes live. The value here is the repeatable evaluation workflow, not a generic AI tooling catalog entry.

## Prerequisites

Node.js, CI pipeline, model provider credentials

## Installation

Use the upstream install or setup path that matches your environment:
- npm install -g promptfoo
- Also available via brew install promptfoo and pip install promptfoo. You can also use npx promptfoo@latest to run any command without installing.

Requirements and caveats from upstream:
- Requires [Node.js](https://nodejs.org/en/download) ^20.20.0 or >=22.22.0 for npm and npx usage.
- Most LLM providers require an API key. Set yours as an environment variable:
- [Node.js Package](https://www.promptfoo.dev/docs/usage/node-package/)

Basic usage or getting-started notes:
- <a href="https://www.promptfoo.dev/docs/getting-started/">Getting Started</a> ·
- sh
- promptfoo init --example getting-started

- Source: https://github.com/promptfoo/promptfoo
- Extracted from upstream docs: https://raw.githubusercontent.com/promptfoo/promptfoo/HEAD/README.md

## Documentation

- https://www.promptfoo.dev/docs/intro/

## Source

- [Agent Skill Exchange](https://agentskillexchange.com/skills/regression-test-prompts-agents-and-rag-outputs-before-shipping-changes/)