Mixture Of Experts Adaptive Capacity

Optimize Mixture-of-Experts efficiency by decoupling token-level expert activation from layer architecture. Use dynamic threshold routing where expert count per token varies by input complexity, and apply layer-wise capacity scheduling to match representational diversity patterns.

adu2021 Updated 7 repo stars

File contents

adu2021/skillxiv commit bb2dd1e2e8

Frequently asked questions

npx get-skill add adu2021/mixture-of-experts-adaptive-capacity