Huggingface Accelerate

Simplest distributed training API. 4 lines to add distributed support to any PyTorch script. Unified API for DeepSpeed/FSDP/Megatron/DDP. Automatic device placement, mixed precision (FP16/BF16/FP8). Interactive config, single launch command. HuggingFace ecosystem standard.

bishal-pdMSFT Updated 0 repo stars

File contents

bishal-pdMSFT/msb-skills commit 0880da4e85

Frequently asked questions

npx get-skill add bishal-pdmsft/huggingface-accelerate