Ptq

Use when the user asks to "quantize a model", "run PTQ", "post-training quantization", "NVFP4 quantization", "FP8 quantization", "INT8 quantization", "INT4 AWQ", "quantize LLM", "quantize MoE", "quantize VLM", or needs to produce a quantized HuggingFace checkpoint from a pretrained model using ModelOpt. Do NOT use for multi-candidate recipe exploration or optimization (use quant-recipe-search).

NVIDIA Updated 23k repo stars
Banner image

File contents

nvidia/model-optimizer commit afa5f6ca9f Runs: nvidia/common

Frequently asked questions

npx get-skill add nvidia/ptq