Nemo Evals

NeMo Helix Evals SDK-first rubric-to-eval guide for BYOB (Bring Your Own Benchmark): parse domain expert rubrics, choose composable evaluation primitives, generate human-reviewable eval configs/artifacts, and run reproducible exact, numeric, LLM-as-judge, code/custom, composite, RAG/agentic, and tool-calling evaluations. Use when a task involves questions/rubrics/responses files, rubric criteria, benchmark scoring, evaluator primitive selection, or reusable evaluation artifacts.

NVIDIA NeMo Updated 2.3k repo stars

File contents

nvidia-nemo/nemo-platform commit 0064ff1100

Frequently asked questions

npx get-skill add nvidia-nemo/nemo-evals