Scalable Prompt Routing Moe

Route queries across frontier models using two-stage system: graph-based task discovery identifies ~332 latent task types via semantic similarity + preference patterns; MoE with task-specific adapters estimates quality for candidate models. Achieves <50% inference cost of strongest single model while exceeding its performance; applies when managing pools of frontier models with narrow capability gaps.

adu2021 Updated 7 repo stars

File contents

adu2021/skillxiv commit ace1cf5733

Frequently asked questions

npx get-skill add adu2021/scalable-prompt-routing-moe