Nemo Evaluator Sdk

Evaluates LLMs across 100+ benchmarks from 18+ harnesses (MMLU, HumanEval, GSM8K, safety, VLM) with multi-backend execution. Use when needing scalable evaluation on local Docker, Slurm HPC, or cloud platforms. NVIDIA's enterprise-grade platform with container-first architecture for reproducible benchmarking.

synthetic-sciences Updated 4.4k repo stars
An OpenScience session comparing EGFR inhibitor potency: the trace shows the search, the written files, the analysis run and the answer with a results table

File contents

synthetic-sciences/openscience commit 0c9125dff7

Frequently asked questions

npx get-skill add synthetic-sciences/nemo-evaluator-sdk