Scaling Laws Code

Establish language-specific scaling laws for multilingual code pre-training across 7 programming languages (0.2B-14B models, 1T tokens). Show interpreted languages scale better than compiled, synergy gains depend on syntax similarity, and parallel pairing improves translation—enabling proportion-dependent token allocation outperforming uniform distribution.

adu2021 Updated 7 repo stars

File contents

adu2021/skillxiv commit a26ed98a0c

Frequently asked questions

npx get-skill add adu2021/scaling-laws-code