Langsmith Evaluator

INVOKE THIS SKILL when building evaluation pipelines for LangSmith. Covers three core components: (1) Creating Evaluators - LLM-as-Judge, custom code; (2) Defining Run Functions - how to capture outputs and trajectories from your agent; (3) Running Evaluations - locally with evaluate() or auto-run via LangSmith. Uses the langsmith CLI tool.

build-with-dhiraj Updated 5 repo stars

File contents

build-with-dhiraj/ai-workflow-framework-portability-kit commit eadd000864

Frequently asked questions

npx get-skill add build-with-dhiraj/langsmith-evaluator