Add Benchmark

Guide for adding a new benchmark or training environment to NeMo-Gym. Use when the user asks to add, create, or integrate a benchmark, evaluation, training environment, or resources server into NeMo-Gym. Also use when wrapping an existing 3rd-party benchmark library. Covers the full workflow: data preparation, resources server implementation, agent wiring, YAML config, testing, and reward profiling (baselining). Triggered by: "add benchmark", "new resources server", "integrate benchmark", "wrap benchmark", "add training environment", "add eval".

NVIDIA NeMo Updated 2.3k repo stars
NeMo Gym Product Overview

File contents

nvidia-nemo/gym commit ebe7fecfa3

Frequently asked questions

npx get-skill add nvidia-nemo/add-benchmark