Langsmith Evaluator

INVOKE THIS SKILL when building evaluation pipelines for LangSmith. Covers three core components: (1) Creating Evaluators - LLM-as-Judge, custom code; (2) Defining Run Functions - how to capture outputs and trajectories from your agent; (3) Running Evaluations - locally with evaluate() or auto-run via LangSmith. Uses the langsmith CLI tool.

langchain-ai Updated

File contents

langchain-ai/langsmith-skills commit 871932a997

Frequently asked questions

npx get-skill add langchain-ai/langsmith-evaluator