Omni Moe Atomic Experts

Scale mixture-of-experts models efficiently by decomposing experts into atomic vector pairs with Cartesian product routing and expert-centric scheduling. Achieves 10.9× speedup and 50% fewer parameters versus fine-grained baselines through system-algorithm codesign that converts scattered memory access into contiguous batched operations.

adu2021 Updated 7 repo stars

File contents

adu2021/skillxiv commit 4ac0ce92e7

Frequently asked questions

npx get-skill add adu2021/omni-moe-atomic-experts