Results for “distributed-compute”
5 skillsMore results
ray
Scales AI and Python applications across clusters with distributed computing primitives for ML workloads.
1
huggingface-accelerate
Add distributed training support to any PyTorch script with minimal code changes using a unified API for DDP, DeepSpeed, FSDP, and mixed precision.
10.4k · bundle
ray
Scales Python ML workloads across clusters using Ray's distributed tasks, actors, data, and serving capabilities.
567 · bundle
deepspeed
Provides expert guidance for distributed training with DeepSpeed, covering ZeRO optimization stages, pipeline parallelism, FP16/BF16/FP8, 1-bit Adam, and sparse attention.
10.4k · bundle