Model Training & Fine-tuning
- orchestra-research BundleFine Tuning Serving Openpi
Fine-tune and serve Physical Intelligence OpenPI models (pi0, pi0-fast, pi0.5) using JAX or PyTorch backends for robot policy inference across ALOHA, DROID, and LIBERO environments.
14.5k - orchestra-research BundleFine Tuning Openvla Oft
Fine-tunes and evaluates OpenVLA-OFT and OpenVLA-OFT+ policies for robot action generation with continuous action heads, LoRA adaptation, and FiLM conditioning on LIBERO simulation and ALOHA real-world setups.
14.5k - orchestra-research BundleTorchforge Rl Training
Train reinforcement learning models using torchforge, Meta's PyTorch-native RL library for scalable, algorithm-focused experimentation with GRPO, DAPO, and custom loss functions.
14.5k - orchestra-research BundleImplementing Llms Litgpt
Train, fine-tune, and deploy LLMs using LitGPT's clean implementations of 20+ architectures like Llama, Gemma, and Phi.
14.5k - orchestra-research BundleNanogpt
Train and experiment with a minimal GPT implementation in ~300 lines of PyTorch, from character-level Shakespeare to GPT-2 scale.
Audited 14.5k - orchestra-research BundleLlama Cpp
Run LLM inference on CPU, Apple Silicon, and consumer GPUs without NVIDIA hardware. Use for edge deployment, M1/M2/M3 Macs, AMD/Intel GPUs, or when CUDA is unavailable. Supports GGUF quantization (1.5-8 bit) for reduced memory and 4-10× speedup vs PyTorch on CPU.
Audited 14.5k - orchestra-research BundleDistributed LLM Pretraining Torchtitan
Pretrains large language models from scratch using PyTorch-native distributed training with 4D parallelism (FSDP2, TP, PP, CP) and Float8 support on H100 GPUs.
14.5k - orchestra-research BundleLong Context
Extend context windows of transformer models using RoPE, YaRN, ALiBi, and position interpolation techniques for processing long documents and implementing efficient positional encodings.
Audited 14.5k - orchestra-research BundleNnsight Remote Interpretability
Run interpretability experiments on neural network internals using nnsight, with optional NDIF remote execution for massive models.
14.5k - lord1egypt SkillHuggingface Hub
Operate Hugging Face Hub repositories, models, datasets, and Spaces via the hf CLI, including downloads, uploads, authentication, and compute jobs.
3 - scoheart BundleHf CLI
Manage Hugging Face Hub resources via the `hf` CLI: download and upload models, datasets, and spaces; manage buckets, cache, collections, discussions, and inference endpoints; run SQL queries on datasets.
2 - qhjqhj00 BundleHqq Quantization
Quantize LLMs to 8/4/3/2/1-bit precision without calibration data, using multiple backends and HuggingFace/vLLM integration.
3 - antigravity SkillHf Mem
Estimates GPU memory required to load Safetensors or GGUF model weights for inference from the Hugging Face Hub using HTTP Range requests, without downloading weights locally.
49.7k - k-dense-ai BundleModal
Deploy and serve AI/ML models on Modal's serverless cloud platform with on-demand GPUs, autoscaling containers, persistent storage, and scheduled jobs.
57.3k - k-dense-ai BundlePymoo
Solve single and multi-objective optimization problems using NSGA-II/III, MOEA/D, and other evolutionary algorithms with customizable operators, constraint handling, and benchmark problems.
Audited 57.3k - k-dense-ai BundlePufferlib
Train reinforcement learning agents at millions of steps per second using optimized PPO, vectorized environments, and multi-agent support.
57.3k - k-dense-ai BundleTorchdrug
Build and train graph neural networks for drug discovery, protein modeling, and molecular science using PyTorch-native tools.
Audited 57.3k - orchestra-research BundleMlflow
Track ML experiments, manage model registry with versioning, deploy models to production, and reproduce experiments with MLflow.
Audited 14.5k - orchestra-research BundleVerl Rl Training
Train LLMs with reinforcement learning using verl (Volcano Engine RL), supporting RLHF, GRPO, PPO, and other algorithms for scalable post-training with flexible infrastructure backends.
14.5k - orchestra-research BundleAxolotl
Provides expert guidance for fine-tuning LLMs with Axolotl, covering YAML configs, LoRA/QLoRA, DPO/KTO/ORPO/GRPO, and multimodal support.
Audited 14.5k - orchestra-research BundleSimpo Training
Train language models with SimPO, a reference-free preference optimization method that outperforms DPO without needing a reference model.
14.5k - orchestra-research BundleModal Serverless Gpu
Run ML workloads on Modal's serverless GPU cloud platform with auto-scaling, pay-per-second pricing, and Python-native infrastructure.
Audited 14.5k - orchestra-research BundleWeights And Biases
Track ML experiments with automatic logging, visualize training in real-time, optimize hyperparameters with sweeps, and manage model registry with W&B.
14.5k - orchestra-research BundleNemo Evaluator Sdk
Evaluates LLMs across 100+ benchmarks from 18+ harnesses (MMLU, HumanEval, GSM8K, safety, VLM) with multi-backend execution on local Docker, Slurm HPC, or cloud platforms.
14.5k - orchestra-research BundleEvaluating Llms Harness
Evaluates LLMs across 60+ academic benchmarks (MMLU, HumanEval, GSM8K, TruthfulQA, HellaSwag) using standardized prompts and metrics. Supports HuggingFace, vLLM, and API backends.
Audited 14.5k - orchestra-research BundleTraining Llms Megatron
Trains large language models (2B-462B parameters) using NVIDIA Megatron-Core with advanced parallelism strategies for maximum GPU efficiency.
14.5k - orchestra-research BundleSparse Autoencoder Training
Train and analyze Sparse Autoencoders (SAEs) using SAELens to decompose neural network activations into interpretable features for mechanistic interpretability research.
14.5k - orchestra-research BundleKnowledge Distillation
Compress large language models using knowledge distillation from teacher to student models, covering temperature scaling, soft targets, reverse KLD, logit distillation, and MiniLLM training strategies.
Audited 14.5k - lingxling SkillAI Ml
Orchestrates AI/ML workflows for building LLM applications, RAG systems, AI agents, and ML pipelines, covering design, integration, observability, and security.
Audited 331 - sakamoto-family-smile SkillMle Workflow
Turn model work into a production ML system with data contracts, reproducible training, quality gates, deployable artifacts, and monitoring.
Audited 0 - qhjqhj00 BundleQutip
Simulate open and closed quantum systems with QuTiP, covering master equations, Lindblad dynamics, decoherence, and quantum optics.
3 - k-dense-ai BundleScvelo
Estimate cell state transitions from unspliced/spliced mRNA dynamics using scVelo, infer trajectory directions, compute latent time, and identify driver genes in single-cell RNA-seq data.
57.3k - orchestra-research BundleMiles Rl Training
Train large-scale MoE models with FP8/INT4 low-precision RL, speculative decoding, and train-inference alignment using the miles framework.
14.5k - orchestra-research BundleSlime Rl Training
Post-train LLMs with reinforcement learning using the slime framework, which integrates Megatron-LM for training and SGLang for rollout generation.
14.5k - orchestra-research BundleOpenrlhf Training
Train large language models (7B-70B+) with RLHF using PPO, GRPO, DPO, and other algorithms, accelerated by Ray and vLLM for distributed multi-GPU setups.
14.5k - orchestra-research BundleLambda Labs Gpu Cloud
Manage and use Lambda Labs GPU cloud instances for ML training and inference with SSH access, persistent filesystems, and multi-node clusters.
14.5k