Results for “pytorch-lightning”
18 skillsMore results
orchestra-research Pytorch Lightning
Organizes PyTorch code with a Trainer class, automatic distributed training (DDP/FSDP/DeepSpeed), callbacks, and minimal boilerplate. Scales from laptop to supercomputer with the same code.
10.4k · bundle
neuralblitz Pytorch
Provides guidance on using PyTorch for deep learning, covering tensors, autograd, nn.Module, DataLoaders, and best practices.
1
orchestra-research Optimizing Attention Flash
Optimizes transformer attention with Flash Attention for 2-4x speedup and 10-20x memory reduction. Supports PyTorch native SDPA, flash-attn library, H100 FP8, and sliding window attention.
10.4k · bundle
affaan-m Pytorch Patterns
Provides idiomatic PyTorch patterns and best practices for building robust, efficient, and reproducible deep learning applications, covering model architecture, training loops, data pipelines, and checkpointing.
226k
smith6jt-cop Pytorch Common Pitfalls
Fixes common PyTorch bugs including percentile calculations, LayerNorm for Conv1d, and buffer edge cases in reinforcement learning and neural network code.
3
orchestra-research Ml Training Recipes
Provides battle-tested PyTorch training recipes for LLMs, vision, diffusion, and biomedical domains, covering training loops, optimizer selection, LR scheduling, mixed precision, and debugging.
10.4k · bundle
nvidia Tao Train Image Classification
Train, evaluate, distill, quantize, export, and run inference for PyTorch-based TAO image classification models with support for multiple backbones.
2.2k · bundle
nvidia Nemo Mbridge Multi Node Slurm
Convert single-node PyTorch distributed scripts into multi-node Slurm sbatch jobs and debug common multi-node failures, covering srun-native and torch.distributed approaches, container setup, NCCL timeouts, and interactive allocation.
2.2k · bundle
k-dense-ai Transformers
Load pre-trained models from Hugging Face Hub, run pipeline inference, generate text, and fine-tune models on NLP, vision, audio, and multimodal tasks using the Transformers library.
30.2k · bundle
orchestra-research Pyvene Interventions
Perform causal interventions on PyTorch models using pyvene's declarative framework for causal tracing, activation patching, and interchange intervention training.
10.4k · bundle
k-dense-ai Torchdrug
Build and train graph neural networks for drug discovery, protein modeling, and molecular science using PyTorch-native tools.
30.2k · bundle
orchestra-research Nanogpt
Train and experiment with a minimal GPT implementation in ~300 lines of PyTorch, from character-level Shakespeare to GPT-2 scale.
10.4k · bundle
orchestra-research Distributed LLM Pretraining Torchtitan
Pretrains large language models from scratch using PyTorch-native distributed training with 4D parallelism (FSDP2, TP, PP, CP) and Float8 support on H100 GPUs.
10.4k · bundle
orchestra-research Torchforge Rl Training
Train reinforcement learning models using torchforge, Meta's PyTorch-native RL library for scalable, algorithm-focused experimentation with GRPO, DAPO, and custom loss functions.
10.4k · bundle
qhjqhj00 Distributed LLM Pretraining Torchtitan
Pretrains large language models at scale using PyTorch-native torchtitan with 4D parallelism, Float8, and distributed checkpointing.
3 · bundle
orchestra-research Huggingface Accelerate
Add distributed training support to any PyTorch script with minimal code changes using a unified API for DDP, DeepSpeed, FSDP, and mixed precision.
10.4k · bundle
orchestra-research Experiment Tracking Swanlab
Track ML experiments with open-source run logging, local or self-hosted dashboards, and media visualization using SwanLab.
10.4k · bundle