Moe Routing Alignment

Prevents MoE router instability during RL training by recording and replaying inference-phase routing distributions back into training. Reduces training-inference routing divergence and KL divergence, enabling stable MoE RL scaling without sacrificing training speed.

adu2021 Updated 7 repo stars

File contents

adu2021/skillxiv commit f580217710

Frequently asked questions

npx get-skill add adu2021/moe-routing-alignment