Edge LLM Convert Model

Convert and run one supported Hugging Face checkpoint with TensorRT Edge-LLM. Use for quantization, checkpoint-to-ONNX export, `llm_build`/`visual_build`/`audio_build`, C++ `llm_inference`, the experimental checkpoint-direct `trtedge build`, engine profile sizing, or copying ONNX artifacts to an Edge target. Do not use for HTTP serving (edge-llm-serve), implementing a new architecture (edge-llm-add-model), installation (edge-llm-install), or accuracy triage (edge-llm-few-layer-test).

NVIDIA Updated 23k repo stars

File contents

nvidia/tensorrt-edge-llm commit 27f413f351

Frequently asked questions

npx get-skill add nvidia/edge-llm-convert-model