Add Export Format

Add a new model export format to AutoRound (e.g., auto_round, auto_gptq, auto_awq, gguf, llm_compressor). Use when implementing a new quantized model serialization format, adding a new packing method, or extending export compatibility for deployment frameworks like vLLM, SGLang, or llama.cpp.

intel Updated 122 repo stars
AutoRound Overview

File contents

intel/auto-round commit 5c98e43fb1

Frequently asked questions

npx get-skill add intel/add-export-format