Eagle3 New Model

Add a new model to the EAGLE3 offline pipeline. Generates an hf_offline_eagle3.yaml launcher config for a new model checkpoint, choosing the right hidden state dump backend (TRT-LLM / HF / vLLM) and GPU configuration. Use when user wants to run EAGLE3 on a model that does not yet have a YAML in tools/launcher/examples/ or asks how to configure the pipeline for a new checkpoint.

NVIDIA Updated 23k repo stars
Banner image

File contents

nvidia/model-optimizer commit 65a34bdacf

Frequently asked questions

npx get-skill add nvidia/eagle3-new-model