Flexible Data Mixture Of Experts

Train language models where each expert learns independently on closed datasets, enabling flexible inference with selective data inclusion or exclusion. 41% performance improvement while allowing users to opt out of specific data sources without retraining.

adu2021 Updated 7 repo stars

File contents

adu2021/skillxiv commit 82ea763854

Frequently asked questions

npx get-skill add adu2021/flexible-data-mixture-of-experts