Expert Threshold Routing

Improve MoE language model efficiency with causal threshold-based routing that eliminates auxiliary losses and enables dynamic per-token computation.

adu2021 Updated 7 repo stars

File contents

adu2021/skillxiv commit 4a1c938e18

Frequently asked questions

npx get-skill add adu2021/expert-threshold-routing