Cost Quality Frontier

Adds cost (input + output tokens × model price) and latency (p50, p95) to eval results, plots model options on a Pareto frontier, and produces a quality-per-dollar composite score so production model selection is grounded in trade-offs, not just quality. Use when: model comparison, cost-aware evals, latency budget, quality-per-dollar, Pareto frontier, model selection, eval economics, picking a model for production.

varunk130 Updated 7 repo stars
AI Eval Skills — Plan, generate, run, interpret, and triage evaluations for any AI agent

File contents

varunk130/AI-Eval-Skills commit a5e7fb6dc5

Frequently asked questions

npx get-skill add varunk130/cost-quality-frontier