Edge LLM Install

Select, install, verify, update, or remove TensorRT Edge-LLM, and install this repository's agent skills into Claude Code or Codex. Inspects revision, CPU architecture, GPU or SoC, JetPack/DriveOS, CUDA, TensorRT, and Python, rejects unsupported combinations before changing anything, then picks exactly one route - published wheel, local wheel, C++ source for the ONNX workflow, or Python source for the experimental checkpoint-direct builder and server - and proves it with a per-route gate. Use when asked to install, set up, build from source, cross-compile, pip install tensorrt-edgellm, upgrade the installed package or build in place, uninstall, fix a CMake or wheel-load failure, or install, update, or remove the edge-llm skills. Do not use for running a model (use edge-llm-serve or edge-llm-convert-model), writing or selecting tests (edge-llm-e2e-test, edge-llm-cpp-test), accuracy debugging (edge-llm-few-layer-test, edge-llm-accuracy-debugging), or release-to-release migration (edge-llm-version-migration).

NVIDIA Updated 23k repo stars

File contents

nvidia/tensorrt-edge-llm commit b11f02f6ed

Frequently asked questions

npx get-skill add nvidia/edge-llm-install