Openai Evals

LLM evaluation framework and registry (OpenAI Evals). Framework for evaluating LLMs and LLM-based systems with a registry of community-contributed eval templates. Supports model-graded evals, classification, simple completion matching, and custom completion functions. Use for systematic LLM quality testing, regression detection, and prompt engineering validation.

mkurman Updated 327 repo stars
Picture from the README

File contents

mkurman/zorai commit cbd88eae89

Frequently asked questions

npx get-skill add mkurman/openai-evals