Agent Evaluation

Use this when you need to EVALUATE OR IMPROVE or OPTIMIZE an existing LLM agent's output quality - including improving tool selection accuracy, answer quality, reducing costs, or fixing issues where the agent gives wrong/incomplete responses. Evaluates agents systematically using MLflow evaluation with datasets, scorers, and tracing. IMPORTANT - Always also load the instrumenting-with-mlflow-tracing skill before starting any work. Covers end-to-end evaluation workflow or individual components (tracing setup, dataset creation, scorer definition, evaluation execution).

mlflow Updated
MLflow Skills

File contents

mlflow/skills commit f5fb8dce06 Runs: mlflow/instrumenting-with-mlflow-tracingmlflow/build-a-scorer

Frequently asked questions

npx get-skill add mlflow/agent-evaluation