Modular Large Model Training

Train large models efficiently across heterogeneous hardware (GPUs, TPUs, Trainium) using strict encapsulation principles, achieving constant code complexity when adding features across hundreds of modules.

adu2021 Updated 7 repo stars

File contents

adu2021/skillxiv commit 208cdd4f58

Frequently asked questions

npx get-skill add adu2021/modular-large-model-training