Orchestra Research
- 114 skills
- 0 followers
- 10k repo stars
- 2 weeks ago last updated
- ▌ Compiler 2 · orchestra-research bundleUniversal ARA Compiler. Converts ANY research input — PDF papers, GitHub repositories, experiment logs, code directories, raw notes, or combinations thereof — into a complete Agent-Native Research Artifact (ARA): a structured, machine-executable knowledge package with a cognitive layer (claims, concepts, methods), an artifact layer (code/configs/data as the work warrants), an exploration graph (research DAG), and grounded evidence. Works across any research field — not only model-training research. TRIGGERS: compile, create ARA, generate artifact, convert paper, build artifact, compile paper, ARA from PDF, ARA from repo, ARA from code, structure research, extract knowledge, extract figure data, digitize plot, read chart, figure to data
- ▌ Submit Ara 2 · orchestra-research bundleARA Submitter. Takes a research directory, makes sure it is a valid Agent-Native Research Artifact (ARA) — compiling it with the `compiler` skill when it is not — guarantees it carries an interactive visualization (`research-visualizer`), then publishes it to the ARA Hub and hands back one link plus an update token. The token is stored in the artifact's own `.ara_env`, so the next submission of the same work REPLACES it in place instead of creating a second entry. Publishes through the user's GitHub account when they have one, and straight to the Hub when they do not — no account required either way. TRIGGERS: submit, submit ara, publish ara, upload ara, share ara, push ara to github, add to ara hub, submit-ara, publish artifact, make my ara public, submit to a conference, update my submission, resubmit
- ▌ Context Drop 2 · orchestra-research bundleContext Drop. Hands a file, a folder, or a set of notes to somebody else's agent as one URL. Uploads the path to the ARA Hub, then prints a share link plus a ready-to-paste prompt: the recipient's agent fetches the drop as a single Markdown document holding every text file, with binaries listed as URLs to pull on demand. Also the reader — given a drop link, it pulls the bundle and works from it. Replaces pushing a throwaway repo to GitHub or mailing a zip nobody's agent can open. TRIGGERS: context drop, drop, share this folder, share these files, send this directory, give this to my friend's agent, share context, make a link for this folder, upload this folder, share notes with an agent, read this drop, open a drop link, agenticresearch.sh/drop
- ▌ Rigor Reviewer 2 · orchestra-research bundleARA Seal Level 2: Semantic Epistemic Review. Acts as an objective research reviewer for Agent-Native Research Artifacts. Assumes Level 1 structural validation has already passed. Evaluates six dimensions of epistemic quality through semantic reasoning over the ARA's content. Produces a scored review with per-dimension strengths/weaknesses/suggestions, severity-ranked findings, and an overall epistemic-quality tier (Exemplary to Unsound). TRIGGERS: level2, seal level 2, verify level 2, epistemic audit, review ara, audit claims
- ▌ Research Fuzzer 2 · orchestra-research bundleTreat an open-ended investigation the way a fuzzer treats a program. After every action, reflect on two things a fuzzer always knows and an agent never does: did anything NEW happen, and where have I NOT been yet. Keeps an append-only notebook of predictions and outcomes; reports what you explored, the leads you saw but never followed, unexplained results, and a going-in-circles alarm. Use for ANY investigation without a known map: research experiments, debugging, data analysis, literature or market research, evaluations. Fire it (1) when starting an investigation, (2) after every action or batch of actions that returned results, (3) before stating any conclusion. Skip it for trivial single-step tasks.
- ▌ Research Manager 2 · orchestra-research bundleEnd-of-turn research process recorder with progressive crystallization. Invoked at the END of EVERY turn, after the user's current request has been fully addressed and before yielding control back to the user. Reviews what happened in the turn, extracts research-significant events, and writes them into the ara/ artifact through a three-stage pipeline: Context Harvester → Event Router → Maturity Tracker. Trace events (decisions, experiments, dead ends, pivots) are recorded immediately as journey facts. Knowledge events (claims, heuristics, concepts, constraints) are staged first and crystallize into typed layers ONLY when closure signals appear — topic abandonment, verbal affirmation, empirical resolution, or artifact commitment. NEVER mid-turn. All entries carry provenance tags (user / ai-suggested / ai-executed / user-revised). Also supports optional, user-triggered taste comments — free-form evaluative reactions to a claim, heuristic, or trace node — independent of the crystallization pipeline.
- ▌ Research Foresight 2 · orchestra-research bundleARA World Model — read-only reasoning engine over ONE Agent-Native Research Artifact (ARA), run LOCALLY with the coding agent itself as the LLM (no SDK, no API key). Given an ARA directory and a free-text query, it answers any question about the ARA — a forward "what if I change X", but equally why-did-this-work, what-should-I-try, is-this-sound, how-do-these-compare, or anything else — by retrieving precedent from the ARA's native files (references/RETRIEVE.md) and answering as the Predictor (references/PREDICT.md): a bold, grounded, falsifiable Answer shaped to what the question actually calls for. TRIGGERS: ask the world model, wm predict, predict with the world model, what if I change X, forecast the loss curve, will this help, why did this work, what should I try next, is this claim sound, compare these, retrieve precedent, what precedent surfaces.
- ▌ Research Visualizer 2 · orchestra-research bundleResearch Visualizer. Renders an existing Agent-Native Research Artifact (ARA) into ONE self-contained, interactive HTML file showing the AI scientist's step-by-step research process: a clickable process map of the exploration tree (branches and dead ends included) on the left, and a per-step drill-down on the right — what the step did (its narrative written in plain language a person can follow), why (the linked claim), the real result (verbatim grounded numbers + inline figures + tables), and the code/artifact pointer. Read-only consumer of the artifact — it never changes how research is done. When the ARA carries them, it also surfaces (each optional, only when present) the related-work dependency graph, the problem framing, a concepts glossary with in-text term popovers, and the solution recipes — reached from header disclosures without leaving the process map. Accepts either an existing ARA or raw research input (a paper, repo, run logs, or notes); when the input is not yet an ARA it is compiled into one
- ▌ Compiler · orchestra-research bundleUniversal ARA Compiler. Converts ANY research input — PDF papers, GitHub repositories, experiment logs, code directories, raw notes, or combinations thereof — into a complete Agent-Native Research Artifact (ARA): a structured, machine-executable knowledge package with a cognitive layer (claims, concepts, methods), an artifact layer (code/configs/data as the work warrants), an exploration graph (research DAG), and grounded evidence. Works across any research field — not only model-training research. TRIGGERS: compile, create ARA, generate artifact, convert paper, build artifact, compile paper, ARA from PDF, ARA from repo, ARA from code, structure research, extract knowledge, extract figure data, digitize plot, read chart, figure to data
- ▌ Submit Ara · orchestra-research bundleARA Submitter. Takes a research directory, makes sure it is a valid Agent-Native Research Artifact (ARA) — compiling it with the `compiler` skill when it is not — guarantees it carries an interactive visualization (`research-visualizer`), then publishes it to the ARA Hub and hands back one link plus an update token. The token is stored in the artifact's own `.ara_env`, so the next submission of the same work REPLACES it in place instead of creating a second entry. Publishes through the user's GitHub account when they have one, and straight to the Hub when they do not — no account required either way. TRIGGERS: submit, submit ara, publish ara, upload ara, share ara, push ara to github, add to ara hub, submit-ara, publish artifact, make my ara public, submit to a conference, update my submission, resubmit
- ▌ Context Drop · orchestra-research bundleContext Drop. Hands a file, a folder, or a set of notes to somebody else's agent as one URL. Uploads the path to the ARA Hub, then prints a share link plus a ready-to-paste prompt: the recipient's agent fetches the drop as a single Markdown document holding every text file, with binaries listed as URLs to pull on demand. Also the reader — given a drop link, it pulls the bundle and works from it. Replaces pushing a throwaway repo to GitHub or mailing a zip nobody's agent can open. TRIGGERS: context drop, drop, share this folder, share these files, send this directory, give this to my friend's agent, share context, make a link for this folder, upload this folder, share notes with an agent, read this drop, open a drop link, agenticresearch.sh/drop
- ▌ Rigor Reviewer · orchestra-research bundleARA Seal Level 2: Semantic Epistemic Review. Acts as an objective research reviewer for Agent-Native Research Artifacts. Assumes Level 1 structural validation has already passed. Evaluates six dimensions of epistemic quality through semantic reasoning over the ARA's content. Produces a scored review with per-dimension strengths/weaknesses/suggestions, severity-ranked findings, and an overall epistemic-quality tier (Exemplary to Unsound). TRIGGERS: level2, seal level 2, verify level 2, epistemic audit, review ara, audit claims
- ▌ Research Fuzzer · orchestra-research bundleTreat an open-ended investigation the way a fuzzer treats a program. After every action, reflect on two things a fuzzer always knows and an agent never does: did anything NEW happen, and where have I NOT been yet. Keeps an append-only notebook of predictions and outcomes; reports what you explored, the leads you saw but never followed, unexplained results, and a going-in-circles alarm. Use for ANY investigation without a known map: research experiments, debugging, data analysis, literature or market research, evaluations. Fire it (1) when starting an investigation, (2) after every action or batch of actions that returned results, (3) before stating any conclusion. Skip it for trivial single-step tasks.
- ▌ Research Manager · orchestra-research bundleEnd-of-turn research process recorder with progressive crystallization. Invoked at the END of EVERY turn, after the user's current request has been fully addressed and before yielding control back to the user. Reviews what happened in the turn, extracts research-significant events, and writes them into the ara/ artifact through a three-stage pipeline: Context Harvester → Event Router → Maturity Tracker. Trace events (decisions, experiments, dead ends, pivots) are recorded immediately as journey facts. Knowledge events (claims, heuristics, concepts, constraints) are staged first and crystallize into typed layers ONLY when closure signals appear — topic abandonment, verbal affirmation, empirical resolution, or artifact commitment. NEVER mid-turn. All entries carry provenance tags (user / ai-suggested / ai-executed / user-revised). Also supports optional, user-triggered taste comments — free-form evaluative reactions to a claim, heuristic, or trace node — independent of the crystallization pipeline.
- ▌ Research Foresight · orchestra-research bundleARA World Model — read-only reasoning engine over ONE Agent-Native Research Artifact (ARA), run LOCALLY with the coding agent itself as the LLM (no SDK, no API key). Given an ARA directory and a free-text query, it answers any question about the ARA — a forward "what if I change X", but equally why-did-this-work, what-should-I-try, is-this-sound, how-do-these-compare, or anything else — by retrieving precedent from the ARA's native files (references/RETRIEVE.md) and answering as the Predictor (references/PREDICT.md): a bold, grounded, falsifiable Answer shaped to what the question actually calls for. TRIGGERS: ask the world model, wm predict, predict with the world model, what if I change X, forecast the loss curve, will this help, why did this work, what should I try next, is this claim sound, compare these, retrieve precedent, what precedent surfaces.
- ▌ Research Visualizer · orchestra-research bundleResearch Visualizer. Renders an existing Agent-Native Research Artifact (ARA) into ONE self-contained, interactive HTML file showing the AI scientist's step-by-step research process: a clickable process map of the exploration tree (branches and dead ends included) on the left, and a per-step drill-down on the right — what the step did (its narrative written in plain language a person can follow), why (the linked claim), the real result (verbatim grounded numbers + inline figures + tables), and the code/artifact pointer. Read-only consumer of the artifact — it never changes how research is done. When the ARA carries them, it also surfaces (each optional, only when present) the related-work dependency graph, the problem framing, a concepts glossary with in-text term popovers, and the solution recipes — reached from header disclosures without leaving the process map. Accepts either an existing ARA or raw research input (a paper, repo, run logs, or notes); when the input is not yet an ARA it is compiled into one
- ▌ Brainstorming Research Ideas · orchestra-researchGuides researchers through structured ideation frameworks to discover high-impact research directions.
- ▌ Ara Research Manager · orchestra-research bundleRecords research provenance as a post-task epilogue, scanning conversation history to extract decisions, experiments, dead ends, claims, heuristics, and pivots, and writing them into the ara/ directory with provenance tags.
- ▌ Creative Thinking For Research · orchestra-researchApplies cognitive science frameworks for creative thinking to CS and AI research ideation, using combinatorial creativity, analogical reasoning, constraint manipulation, and other empirically grounded strategies.
- ▌ Implementing Llms Litgpt · orchestra-research bundleTrain, fine-tune, and deploy LLMs using LitGPT's clean implementations of 20+ architectures like Llama, Gemma, and Phi.
- ▌ Llama Factory · orchestra-research bundleProvides expert guidance for fine-tuning LLMs with LLaMA-Factory, covering WebUI no-code, 100+ models, 2/3/4/5/6/8-bit QLoRA, and multimodal support.
- ▌ Quantizing Models Bitsandbytes · orchestra-research bundleQuantize LLMs to 8-bit or 4-bit for 50-75% memory reduction with minimal accuracy loss using bitsandbytes. Supports INT8, NF4, FP4 formats, QLoRA training, and 8-bit optimizers.
- ▌ Nemo Evaluator Sdk · orchestra-research bundleEvaluates LLMs across 100+ benchmarks from 18+ harnesses (MMLU, HumanEval, GSM8K, safety, VLM) with multi-backend execution on local Docker, Slurm HPC, or cloud platforms.
- ▌ Sentence Transformers · orchestra-research bundleGenerate high-quality sentence and text embeddings for semantic similarity, clustering, and retrieval using 5000+ pre-trained models. Supports multilingual and domain-specific embeddings for RAG and semantic search.
- ▌ Nanogpt · orchestra-research bundleTrain and experiment with a minimal GPT implementation in ~300 lines of PyTorch, from character-level Shakespeare to GPT-2 scale.
- ▌ Sentencepiece · orchestra-research bundleTrain and use SentencePiece tokenizers for multilingual NLP, supporting BPE and Unigram algorithms with raw Unicode text.
- ▌ Lambda Labs Gpu Cloud · orchestra-research bundleManage and use Lambda Labs GPU cloud instances for ML training and inference with SSH access, persistent filesystems, and multi-node clusters.
- ▌ Llamaguard · orchestra-researchDeploy Meta's LlamaGuard moderation model to filter LLM inputs and outputs across 6 safety categories using HuggingFace, vLLM, or FastAPI.
- ▌ Llama Cpp · orchestra-research bundleRun LLM inference on CPU, Apple Silicon, and consumer GPUs without NVIDIA hardware. Use for edge deployment, M1/M2/M3 Macs, AMD/Intel GPUs, or when CUDA is unavailable. Supports GGUF quantization (1.5-8 bit) for reduced memory and 4-10× speedup vs PyTorch on CPU.
- ▌ Guidance · orchestra-research bundleControl LLM output with regex and grammars to guarantee valid JSON, XML, or code generation, enforce structured formats, and build multi-step workflows using Microsoft Research's Guidance framework.
- ▌ Outlines · orchestra-research bundleGuarantee valid JSON, XML, or code structure during text generation using Pydantic models for type-safe outputs, supporting local models (Transformers, vLLM, llama.cpp) and maximizing inference speed with structured generation.
- ▌ Segment Anything Model · orchestra-research bundleSegment any object in images using points, boxes, or masks as prompts, or automatically generate all object masks with zero-shot transfer.
- ▌ Stable Diffusion Image Generation · orchestra-research bundleGenerate images from text prompts, perform image-to-image translation, inpainting, and build custom diffusion pipelines using Stable Diffusion models via HuggingFace Diffusers.
- ▌ Nemo Curator · orchestra-research bundleGPU-accelerated data curation for LLM training, supporting text, image, video, and audio with fuzzy deduplication, quality filtering, semantic deduplication, PII redaction, and NSFW detection.
- ▌ Optimizing Attention Flash · orchestra-research bundleOptimizes transformer attention with Flash Attention for 2-4x speedup and 10-20x memory reduction. Supports PyTorch native SDPA, flash-attn library, H100 FP8, and sliding window attention.
- ▌ Distributed LLM Pretraining Torchtitan · orchestra-research bundlePretrains large language models from scratch using PyTorch-native distributed training with 4D parallelism (FSDP2, TP, PP, CP) and Float8 support on H100 GPUs.
- ▌ Fine Tuning With Trl · orchestra-research bundleFine-tune and align language models using reinforcement learning with TRL, including SFT, DPO, PPO, GRPO, and reward model training.
- ▌ Prompt Guard · orchestra-researchDetect prompt injections and jailbreak attempts in LLM applications using Meta's 86M parameter classifier. Filter user inputs, third-party data, and RAG documents with low latency and multilingual support.
- ▌ Instructor · orchestra-research bundleExtract structured data from LLM responses with Pydantic validation, automatic retries, and streaming support across multiple providers.
- ▌ Grpo Rl Training · orchestra-research bundleExpert guidance for implementing GRPO/RL fine-tuning with TRL for reasoning and task-specific model training.
- ▌ Deepspeed · orchestra-research bundleProvides expert guidance for distributed training with DeepSpeed, covering ZeRO optimization stages, pipeline parallelism, FP16/BF16/FP8, 1-bit Adam, and sparse attention.
- ▌ Ray Train · orchestra-research bundleScales machine learning training from single GPU to multi-node clusters with minimal code changes. Supports PyTorch, TensorFlow, and HuggingFace with built-in hyperparameter tuning, fault tolerance, and elastic scaling.
- ▌ Tensorrt LLM · orchestra-research bundleOptimizes LLM inference with NVIDIA TensorRT for maximum throughput and lowest latency on NVIDIA GPUs (A100/H100).
- ▌ Huggingface Accelerate · orchestra-research bundleAdd distributed training support to any PyTorch script with minimal code changes using a unified API for DDP, DeepSpeed, FSDP, and mixed precision.
- ▌ Nemo Guardrails · orchestra-researchAdd programmable safety guardrails to LLM applications at runtime, including jailbreak detection, input/output validation, fact-checking, hallucination detection, PII filtering, and toxicity detection.
- ▌ Ml Training Recipes · orchestra-research bundleProvides battle-tested PyTorch training recipes for LLMs, vision, diffusion, and biomedical domains, covering training loops, optimizer selection, LR scheduling, mixed precision, and debugging.
- ▌ Evaluating Llms Harness · orchestra-research bundleEvaluates LLMs across 60+ academic benchmarks (MMLU, HumanEval, GSM8K, TruthfulQA, HellaSwag) using standardized prompts and metrics. Supports HuggingFace, vLLM, and API backends.
- ▌ Long Context · orchestra-research bundleExtend context windows of transformer models using RoPE, YaRN, ALiBi, and position interpolation techniques for processing long documents and implementing efficient positional encodings.
- ▌ Moe Training · orchestra-research bundleTrain Mixture of Experts (MoE) models using DeepSpeed or HuggingFace, covering architectures, routing, load balancing, and expert parallelism.
- ▌ Model Merging · orchestra-research bundleMerge multiple fine-tuned models using mergekit to combine capabilities without retraining, covering SLERP, TIES-Merging, DARE, Task Arithmetic, linear merging, and production deployment strategies.
- ▌ Model Pruning · orchestra-research bundleCompress large language models by 40-60% with minimal accuracy loss using one-shot pruning techniques like Wanda and SparseGPT, enabling faster inference and deployment on constrained hardware.
- ▌ Ml Paper Writing · orchestra-research bundleDraft publication-ready ML/AI papers for top conferences (NeurIPS, ICML, ICLR, ACL, AAAI, COLM) by exploring research repositories, structuring arguments, verifying citations via APIs, and formatting submissions.
- ▌ Constitutional AI · orchestra-researchTrain AI models to be harmless through self-critique and AI feedback using a set of constitutional principles, without requiring human labels for harmful outputs.
- ▌ Training Llms Megatron · orchestra-research bundleTrains large language models (2B-462B parameters) using NVIDIA Megatron-Core with advanced parallelism strategies for maximum GPU efficiency.
- ▌ Pytorch Fsdp2 · orchestra-research bundleAdds PyTorch FSDP2 (fully_shard) to training scripts with correct init, sharding, mixed precision/offload config, and distributed checkpointing. Use when models exceed single-GPU memory or when you need DTensor-based sharding with DeviceMesh.
- ▌ Academic Plotting · orchestra-research bundleGenerates publication-quality figures for ML papers, including architecture diagrams via Gemini and data-driven charts via matplotlib/seaborn.
- ▌ Huggingface Tokenizers · orchestra-research bundleFast tokenization for NLP using Rust-based tokenizers supporting BPE, WordPiece, and Unigram algorithms, with training, alignment tracking, and padding/truncation.
- ▌ Pyvene Interventions · orchestra-research bundlePerform causal interventions on PyTorch models using pyvene's declarative framework for causal tracing, activation patching, and interchange intervention training.
- ▌ Nnsight Remote Interpretability · orchestra-research bundleRun interpretability experiments on neural network internals using nnsight, with optional NDIF remote execution for massive models.
- ▌ Sparse Autoencoder Training · orchestra-research bundleTrain and analyze Sparse Autoencoders (SAEs) using SAELens to decompose neural network activations into interpretable features for mechanistic interpretability research.
- ▌ Evaluating Code Models · orchestra-research bundleEvaluates code generation models across HumanEval, MBPP, MultiPL-E, and 15+ benchmarks with pass@k metrics. Use when benchmarking code models, comparing coding abilities, testing multi-language support, or measuring code generation quality.
- ▌ Pytorch Lightning · orchestra-research bundleOrganizes PyTorch code with a Trainer class, automatic distributed training (DDP/FSDP/DeepSpeed), callbacks, and minimal boilerplate. Scales from laptop to supercomputer with the same code.
- ▌ Systems Paper Writing · orchestra-research bundleProvides paragraph-level structural blueprints for writing systems papers targeting OSDI, SOSP, ASPLOS, NSDI, and EuroSys, including page allocation, writing patterns, and venue-specific checklists.
- ▌ Ara Compiler · orchestra-research bundleCompiles research inputs—PDFs, code, logs, notes—into structured Agent-Native Research Artifacts with cognitive and physical layers.
- ▌ Speculative Decoding · orchestra-research bundleAccelerate LLM inference using speculative decoding, Medusa multiple heads, and lookahead decoding techniques for 1.5-3.6× speedup without quality loss.
- ▌ Knowledge Distillation · orchestra-research bundleCompress large language models using knowledge distillation from teacher to student models, covering temperature scaling, soft targets, reverse KLD, logit distillation, and MiniLLM training strategies.
- ▌ Presenting Conference Talks · orchestra-research bundleGenerates conference presentation slides (Beamer LaTeX PDF and editable PPTX) from a compiled paper with speaker notes and talk script.
- ▌ Transformer Lens Interpretability · orchestra-research bundleInspect and manipulate transformer internals via HookPoints and activation caching for mechanistic interpretability research.
- ▌ Ara Rigor Reviewer · orchestra-research bundlePerforms a semantic epistemic review of Agent-Native Research Artifacts, scoring six dimensions and producing a constructive report with a recommendation.
- ▌ Faiss · orchestra-research bundleEnables fast similarity search and clustering of dense vectors using FAISS, supporting billions of vectors, GPU acceleration, and various index types.
- ▌ Chroma · orchestra-research bundleStore and query embeddings with metadata filtering, vector search, and full-text search using an open-source database that scales from notebooks to production.
- ▌ Qdrant Vector Search · orchestra-research bundleBuild production RAG and semantic search systems with a high-performance vector database written in Rust, supporting hybrid search, filtering, and horizontal scaling.
- ▌ Mlflow · orchestra-research bundleTrack ML experiments, manage model registry with versioning, deploy models to production, and reproduce experiments with MLflow.
- ▌ Pinecone · orchestra-research bundleProvides code examples and best practices for using Pinecone, a managed vector database for production RAG, recommendation, and semantic search applications.
- ▌ Experiment Tracking Swanlab · orchestra-research bundleTrack ML experiments with open-source run logging, local or self-hosted dashboards, and media visualization using SwanLab.
- ▌ Crewai Multi Agent · orchestra-research bundleBuild teams of autonomous AI agents that collaborate to solve complex tasks using role-based delegation, memory, and sequential or hierarchical execution.
- ▌ Autogpt Agents · orchestra-research bundleBuild, deploy, and manage continuous AI agents using a visual workflow editor or development toolkit.
- ▌ Evolving AI Agents · orchestra-research bundleOptimize AI agents through automated evolution cycles using LLM-driven mutation of prompts, skills, and memory against measurable benchmarks.
- ▌ Clip · orchestra-research bundleEnables zero-shot image classification, image-text matching, and cross-modal retrieval using OpenAI's CLIP model.
- ▌ Peft Fine Tuning · orchestra-research bundleFine-tune large language models by training less than 1% of parameters using LoRA, QLoRA, and 25+ adapter methods, enabling efficient adaptation on consumer GPUs.
- ▌ Awq Quantization · orchestra-research bundleQuantize large language models to 4-bit using activation-aware weight quantization, achieving ~3x speedup with minimal accuracy loss for deployment on limited GPU memory.
- ▌ Hqq Quantization · orchestra-research bundleQuantize large language models to 8/4/3/2/1-bit precision without calibration data, using multiple optimized backends for deployment with vLLM or HuggingFace Transformers.
- ▌ Langchain · orchestra-research bundleBuild LLM-powered applications with agents, chains, and RAG using a framework that supports multiple providers and 500+ integrations.
- ▌ Llava · orchestra-research bundleEnables visual instruction tuning and image-based conversations using open-source vision-language models. Supports multi-turn image chat, visual question answering, and image understanding tasks.
- ▌ Autoresearch · orchestra-research bundleOrchestrates end-to-end autonomous AI research projects using a two-loop architecture for rapid experimentation and synthesis, producing papers and presentations.
- ▌ Gguf Quantization · orchestra-research bundleConvert and quantize models to GGUF format for efficient CPU/GPU inference with llama.cpp, supporting 2-8 bit quantization and Apple Silicon acceleration.
- ▌ Gptq · orchestra-research bundleQuantize large language models to 4-bit with minimal accuracy loss using GPTQ, enabling deployment of 70B+ models on consumer GPUs with 4× memory reduction and 3-4× faster inference.
- ▌ Tensorboard · orchestra-research bundleVisualize training metrics, debug models with histograms, compare experiments, visualize model graphs, and profile performance using TensorBoard.
- ▌ Llamaindex · orchestra-research bundleConnects LLMs with user data for RAG applications, document Q&A, and knowledge retrieval using 300+ data connectors and vector indices.
- ▌ Blip 2 Vision Language · orchestra-research bundleGenerate image captions, answer visual questions, and perform image-text retrieval using BLIP-2's Q-Former architecture with frozen vision encoders and LLMs.
- ▌ Fine Tuning Serving Openpi · orchestra-research bundleFine-tune and serve Physical Intelligence OpenPI models (pi0, pi0-fast, pi0.5) using JAX or PyTorch backends for robot policy inference across ALOHA, DROID, and LIBERO environments.
- ▌ Verl Rl Training · orchestra-research bundleTrain LLMs with reinforcement learning using verl (Volcano Engine RL), supporting RLHF, GRPO, PPO, and other algorithms for scalable post-training with flexible infrastructure backends.
- ▌ Whisper · orchestra-research bundleTranscribe and translate speech across 99 languages using OpenAI's Whisper model, with support for multiple model sizes, batch processing, and subtitle generation.
- ▌ Axolotl · orchestra-research bundleProvides expert guidance for fine-tuning LLMs with Axolotl, covering YAML configs, LoRA/QLoRA, DPO/KTO/ORPO/GRPO, and multimodal support.
- ▌ Unsloth · orchestra-research bundleProvides expert guidance for fast fine-tuning with Unsloth, including LoRA/QLoRA optimization, with 2-5x faster training and 50-80% less memory usage.
- ▌ Miles Rl Training · orchestra-research bundleTrain large-scale MoE models with FP8/INT4 low-precision RL, speculative decoding, and train-inference alignment using the miles framework.
- ▌ Simpo Training · orchestra-research bundleTrain language models with SimPO, a reference-free preference optimization method that outperforms DPO without needing a reference model.
- ▌ Slime Rl Training · orchestra-research bundlePost-train LLMs with reinforcement learning using the slime framework, which integrates Megatron-LM for training and SGLang for rollout generation.
- ▌ Modal Serverless Gpu · orchestra-research bundleRun ML workloads on Modal's serverless GPU cloud platform with auto-scaling, pay-per-second pricing, and Python-native infrastructure.
- ▌ Phoenix Observability · orchestra-research bundleTrace, evaluate, and monitor LLM applications with an open-source observability platform.