# Promptfoo Config

> promptfoo configuration patterns for prompt regression testing, multi-provider comparison, and assertion-based validation. Use when setting up prompt testing, comparing LLM providers, or creating eval pipelines.

- Skill: `vanman2024/promptfoo-config` (Agent Skill, multi-file: 4 files)
- Install (CLI): `npx skillmds add vanman2024/promptfoo-config`
- Raw SKILL.md: https://api.skillmd.com/api/skills/vanman2024/promptfoo-config/raw
- Safety review: pending
- Works with: Claude Code, Claude.ai, OpenAI Codex
- Category: AI & ML
- Author: vanman2024 (https://skillmd.com/u/vanman2024)
- Updated: 2026-09-10
- Page: https://skillmd.com/skills/vanman2024/promptfoo-config

---


# promptfoo Configuration

Skill for configuring promptfoo prompt evaluation and testing.

## Overview

promptfoo enables:

- Prompt regression testing
- Multi-provider comparison
- Assertion-based validation
- HTML report generation

## Use When

This skill is automatically invoked when:

- Setting up prompt testing
- Comparing LLM providers
- Creating evaluation pipelines
- Defining test assertions

## Available Scripts

| Script                      | Description                  |
| --------------------------- | ---------------------------- |
| `scripts/init-promptfoo.sh` | Initialize promptfoo project |
| `scripts/run-eval.sh`       | Run evaluation with output   |

## Available Templates

| Template                         | Description         |
| -------------------------------- | ------------------- |
| `templates/promptfooconfig.yaml` | Basic configuration |
| `templates/multi-provider.yaml`  | Provider comparison |
| `templates/assertions.yaml`      | Assertion examples  |

## Best Practices

1. Use YAML anchors for repeated config
2. Store prompts in separate files
3. Use variables for dynamic tests
4. Set appropriate thresholds