Rocket Model Compression

Compress language models by formulating heterogeneous layer-wise allocation as a constrained knapsack problem. Measure per-layer compression error, solve via dynamic programming to minimize total error within target model size, and avoid pathological solutions where some layers are severely damaged.

adu2021 Updated 7 repo stars

File contents

adu2021/skillxiv commit 72ce5a566c

Frequently asked questions

npx get-skill add adu2021/rocket-model-compression