Mano Manifold Optimization

Improve LLM training efficiency through manifold-based optimization that projects momentum onto tangent spaces and constrains updates on rotational Oblique manifolds. Achieves 1.75× faster convergence than Muon with reduced memory.

adu2021 Updated 7 repo stars

File contents

adu2021/skillxiv commit 0853680076

Frequently asked questions

npx get-skill add adu2021/mano-manifold-optimization