Commerce Agent Evals

Ship a non-deterministic commerce agent with snapshot evals instead of conversation simulation. Covers constructing test state directly and grading the final state and response, why simulated-user evals are a poor measurement tool and what they are good for, testing from long messy contradictory histories, the five coverage areas for commerce agents, and how to select a CI suite when many teams share one agent. Use when building an eval suite, when deciding what to run per pull request, or when an agent regresses in production without any test catching it.

uygnoey Updated 4 repo stars

File contents

uygnoey/skills-from-claude-blog commit f2c9cea515

Frequently asked questions

npx get-skill add uygnoey/commerce-agent-evals