Dash Faster Shampoo Optimizer

Accelerate the Shampoo optimizer 4.8x using batched block-wise preconditioning and numerical approximations, enabling more frequent preconditioner updates without computational bottleneck.

adu2021 Updated 7 repo stars

File contents

adu2021/skillxiv commit 392192ebb5

Frequently asked questions

npx get-skill add adu2021/dash-faster-shampoo-optimizer