Edge LLM Add Model

Implement TensorRT Edge-LLM support for a new Hugging Face checkpoint or model family. Use for a new `model_type`, architecture, text/vision/audio/action component, checkpoint tensor layout, speculative draft, model-specific custom operation, or runtime artifact. Starts from checkpoint inspection and the provider reference, finds the closest existing family, chooses the smallest supported frontend surface, and requires reference-to-export-to-engine-to-inference evidence. Do not use merely to convert an already supported checkpoint (edge-llm-convert-model), serve it (edge-llm-serve), or develop a standalone plugin/kernel (edge-llm-plugin-extension, edge-llm-cutedsl-kernel).

NVIDIA Updated 23k repo stars

File contents

nvidia/tensorrt-edge-llm commit 0f58841f04

Frequently asked questions

npx get-skill add nvidia/edge-llm-add-model