Ramp Adaptive Quantization

Learn optimal per-layer bit-width assignments for LLM quantization via RL, generalizing across models without retraining. Achieves superior compression under fixed bit budgets.

adu2021 Updated 7 repo stars

File contents

adu2021/skillxiv commit e43cdeef41

Frequently asked questions

npx get-skill add adu2021/ramp-adaptive-quantization