Model Training & Fine-tuning

k-dense-ai Bundle

Train reinforcement learning agents at millions of steps per second using optimized PPO, vectorized environments, and multi-agent support.

k-dense-ai Bundle

Build and train graph neural networks for drug discovery, protein modeling, and molecular science using PyTorch-native tools.

k-dense-ai Bundle

Provides deep generative models for single-cell omics analysis, including probabilistic batch correction, transfer learning, differential expression, and multi-modal integration.

k-dense-ai Bundle

Fit statistical models (OLS, GLM, ARIMA, mixed models) with detailed diagnostics, residuals, and inference for econometrics and time series analysis.

k-dense-ai Bundle

Load pre-trained models from Hugging Face Hub, run pipeline inference, generate text, and fine-tune models on NLP, vision, audio, and multimodal tasks using the Transformers library.

k-dense-ai Bundle

GPU-accelerate Python code using CuPy, Numba CUDA, Warp, cuDF, cuML, cuGraph, and other RAPIDS libraries for dramatic speedups on numerical, data, ML, graph, and simulation workloads.

k-dense-ai Bundle

Organize PyTorch code into LightningModules, configure Trainers for multi-GPU/TPU, implement data pipelines, callbacks, logging (W&B, TensorBoard, MLflow), and distributed training (DDP, FSDP, DeepSpeed) for scalable neural network training.

k-dense-ai Bundle

Train reinforcement learning agents using PPO, SAC, DQN, TD3, DDPG, and A2C algorithms with a scikit-learn-like API. Supports custom Gymnasium environments, vectorized environments, callbacks, and model persistence.

k-dense-ai Bundle

Analyze Neuropixels extracellular recordings end-to-end with SpikeInterface, covering loading, preprocessing, drift correction, spike sorting, quality metrics, and unit curation.

mukul975 Bundle

Detect poisoned training data and backdoored models across the ML pipeline using statistical analysis, activation clustering, and spectral signatures.

mukul975 Bundle

Detect model stealing, model inversion, and membership inference performed through inference-API abuse by monitoring query patterns, applying output perturbation, and red-teaming your own model's extractability.

mukul975 Bundle

Detects command-and-control (C2) communications tunneled through DNS protocol, including DNS tunneling tools, domain generation algorithms, and encoded payload delivery via TXT/CNAME records.

mukul975 Bundle

Detects AI-generated deepfake audio used in voice phishing (vishing) attacks by extracting spectral features and classifying samples with machine learning models.

mukul975 Bundle

Deploys anomaly detection for industrial control environments using machine learning models trained on OT network baselines, physics-based process models, and behavioral analysis of industrial protocol communications.

jeffallan Bundle

Designs and implements production-grade ML pipeline infrastructure: configures experiment tracking, creates orchestration DAGs, builds feature store schemas, deploys model registries, and automates retraining and validation workflows.

jeffallan Bundle

Fine-tune LLMs using LoRA, QLoRA, and PEFT with Hugging Face, including dataset preparation, hyperparameter tuning, evaluation, and deployment.

muratcankoylan Bundle

Convert books into supervised fine-tuning datasets and train style-transfer models that replicate an author's voice.

orchestra-research Bundle

Track ML experiments, manage model registry with versioning, deploy models to production, and reproduce experiments with MLflow.

orchestra-research Bundle

Track ML experiments with open-source run logging, local or self-hosted dashboards, and media visualization using SwanLab.

orchestra-research Bundle

Fine-tune large language models by training less than 1% of parameters using LoRA, QLoRA, and 25+ adapter methods, enabling efficient adaptation on consumer GPUs.

orchestra-research Bundle

Quantize large language models to 8/4/3/2/1-bit precision without calibration data, using multiple optimized backends for deployment with vLLM or HuggingFace Transformers.

orchestra-research Bundle

Quantize large language models to 4-bit with minimal accuracy loss using GPTQ, enabling deployment of 70B+ models on consumer GPUs with 4× memory reduction and 3-4× faster inference.

orchestra-research Bundle

Visualize training metrics, debug models with histograms, compare experiments, visualize model graphs, and profile performance using TensorBoard.

orchestra-research Bundle

Train LLMs with reinforcement learning using verl (Volcano Engine RL), supporting RLHF, GRPO, PPO, and other algorithms for scalable post-training with flexible infrastructure backends.

orchestra-research Bundle

Provides expert guidance for fine-tuning LLMs with Axolotl, covering YAML configs, LoRA/QLoRA, DPO/KTO/ORPO/GRPO, and multimodal support.

orchestra-research Bundle

Provides expert guidance for fast fine-tuning with Unsloth, including LoRA/QLoRA optimization, with 2-5x faster training and 50-80% less memory usage.

orchestra-research Bundle

Train language models with SimPO, a reference-free preference optimization method that outperforms DPO without needing a reference model.

orchestra-research Bundle

Post-train LLMs with reinforcement learning using the slime framework, which integrates Megatron-LM for training and SGLang for rollout generation.

orchestra-research Bundle

Run ML workloads on Modal's serverless GPU cloud platform with auto-scaling, pay-per-second pricing, and Python-native infrastructure.

orchestra-research Bundle

Train large language models (7B-70B+) with RLHF using PPO, GRPO, DPO, and other algorithms, accelerated by Ray and vLLM for distributed multi-GPU setups.

orchestra-research Bundle

Deploy and serve LLMs with high throughput using vLLM's PagedAttention and continuous batching. Supports OpenAI-compatible endpoints, quantization (GPTQ/AWQ/FP8), and tensor parallelism for production inference.

orchestra-research Bundle

Fine-tunes and evaluates OpenVLA-OFT and OpenVLA-OFT+ policies for robot action generation with continuous action heads, LoRA adaptation, and FiLM conditioning on LIBERO simulation and ALOHA real-world setups.

orchestra-research Bundle

Use RWKV, a linear-time RNN-Transformer hybrid, for efficient long-context inference and training with constant memory usage.

orchestra-research Bundle

Train and run Mamba state-space models with O(n) complexity, achieving faster inference and longer context than Transformers.

orchestra-research Bundle

Track ML experiments with automatic logging, visualize training in real-time, optimize hyperparameters with sweeps, and manage model registry with W&B.

orchestra-research Bundle

Train, fine-tune, and deploy LLMs using LitGPT's clean implementations of 20+ architectures like Llama, Gemma, and Phi.