Results for “happyhorse”
3 skillsnemo-mbridge-perf-cpu-offloading
Configure and validate CPU offloading for Megatron Bridge training, including activation offloading and optimizer state offloading with HybridDeviceOptimizer.
2.2k · bundle
huggingface-accelerate
Add distributed training support to any PyTorch script with minimal code changes using a unified API for DDP, DeepSpeed, FSDP, and mixed precision.
10.4k · bundle
pytorch
Provides guidance on using PyTorch for deep learning, covering tensors, autograd, nn.Module, DataLoaders, and best practices.
1