Edge LLM Feature Combinations

List the supported combinations a change reaches and verify them before the change is submitted. Use before coding a change to quantization or checkpoint parsing, checkpoint loading, the lm_head, KV cache, a speculative decoding method or draft, shared linear or attention code, either engine frontend (ONNX exporter or checkpoint-direct builder), a kernel or TensorRT plugin, tensor parallelism, or a C++ feature guard. Skip it for documentation, CI, test-only, and server-protocol changes, and for a fix that stays inside one model family on one frontend and does not touch quantized weight loading.

NVIDIA Updated 23k repo stars

File contents

nvidia/tensorrt-edge-llm commit 02354852f3

Frequently asked questions

npx get-skill add nvidia/edge-llm-feature-combinations