Uniql Quantization Pruning

Single cloud-side weight-sorting and fine-tuning supporting multiple on-device pruning rates via efficient SVD and MLP decomposition, achieving 4-5.7× memory reduction and 2.7-3.4× throughput across Transformers, SSMs, and hybrid architectures.

adu2021 Updated 7 repo stars

File contents

adu2021/skillxiv commit ba61108b9a

Frequently asked questions

npx get-skill add adu2021/uniql-quantization-pruning