Edge LLM Few Layer Test

Add or repair a few-layer numeric validation case, which compares the first N decoder layers of a checkpoint against a PyTorch golden. Covers when a change needs one, choosing the checkpoint, setting a cosine gate that is measured rather than tuned, and triaging a failure. Apply when adding a model architecture, layer type, quantization recipe, or kernel, or when a few-layer case fails.

NVIDIA Updated 23k repo stars

File contents

nvidia/tensorrt-edge-llm commit 9be2907f54

Frequently asked questions

npx get-skill add nvidia/edge-llm-few-layer-test