Sparse Moe Agentic Intelligence

Deploy frontier-level reasoning with only 11B active parameters using sparse MoE with 288 routed experts plus shared expert. Use Metropolis Independence Sampling-Filtered Policy Optimization (MIS-PO) to stabilize RL training at scale, replacing continuous importance weighting with discrete filtering that ensures trust region stability.

adu2021 Updated 7 repo stars

File contents

adu2021/skillxiv commit 4494a89aa0

Frequently asked questions

npx get-skill add adu2021/sparse-moe-agentic-intelligence