How do I install the Benchmark Execution skill?

Run npx skillmds@latest add nvidia-nemo/benchmark-execution in your terminal (requires Node.js), paste this page's agent-chat prompt into Claude, Cursor, or any MCP-connected agent, or download the SKILL.md file and copy it into your agent's skills directory.

Is Benchmark Execution safe to use?

This skill has not completed SkillMD's automated safety review yet. SkillMD never runs a skill's scripts for you; review the SKILL.md before installing.

Which AI agents work with Benchmark Execution?

This skill is tagged as working with Claude Code, Claude.ai, OpenAI Codex. SKILL.md is an open format, so most agents that read a skills directory can load it too.

Is Benchmark Execution free to use?

Yes. Installing skills from SkillMD is free, and the skill stays under its author's original license.

Who published Benchmark Execution?

NVIDIA NeMo (@nvidia-nemo) published this skill. Their other Agent Skills are listed on their SkillMD profile.

Benchmark Execution by nvidia-nemo — Agent Skill

Name: Benchmark Execution
Author: NVIDIA NeMo

Benchmark Execution

Benchmark task execution contract: complete every numbered requirement, execute tool calls directly (never plan-only), and verify final state with a direct retrieve/list before responding. Use for every agentic-use benchmark task.

NVIDIA NeMo 9665233 1.3 KB Updated Sep 17, 2026

File contents

Benchmark execution contract

This skill defines the execution requirements that every nemo-studio-assistant run under tests/agentic-use/ must satisfy so the canonical gate (tests/agentic-use/passrate_token_policy_gate.py) can score the run on verifier pass-rate and token totals. See tests/agentic-use/README.md for the full Run -> Gate -> Optimize loop these tasks plug into.

Treat instruction.md as the task contract: finish all numbered requirements.
Execute tool calls yourself; do not end with a plan-only response.
Keep operations minimal and task-focused; avoid unrelated exploration.
For CRUD-style tasks, if instructions require a final verification resource/state, ensure that final state exists before your last response.
Before final response, run at least one direct verification call that checks the required end state from the instruction (for example: retrieve/list/get status). Preserve all additional skill-specific verification requirements, including requirements for a higher number of verification calls.

Frequently asked questions