Results for “memory-efficient”
4 skills
orchestra-research optimizing-attention-flash
Optimizes transformer attention with Flash Attention for 2-4x speedup and 10-20x memory reduction. Supports PyTorch native SDPA, flash-attn library, H100 FP8, and sliding window attention.
10.4k · bundle
orchestra-research rwkv-architecture
Use RWKV, a linear-time RNN-Transformer hybrid, for efficient long-context inference and training with constant memory usage.
10.4k · bundle
More results
lord1egypt peft-fine-tuning
Fine-tune large language models by training less than 1% of parameters using LoRA, QLoRA, and 25+ adapter methods, enabling efficient adaptation on limited GPU memory.
2
affaan-m pytorch-patterns
Provides idiomatic PyTorch patterns and best practices for building robust, efficient, and reproducible deep learning applications, covering model architecture, training loops, data pipelines, and checkpointing.
226k