Data Efficacy Language Model Training

Boost language model performance by strategically ordering training data without changing content or model size. Uses learnability-quality scoring and folding schedules to improve convergence and knowledge retention, achieving consistent gains across all model scales.

adu2021 Updated 7 repo stars

File contents

adu2021/skillxiv commit b1650bbf21

Frequently asked questions

npx get-skill add adu2021/data-efficacy-language-model-training