Results for “experiment-management”
15 skills
nvidia Nemo Rl Brev Etiquette
Provides storage and environment conventions for NeMo-RL agents on Brev instances, ensuring large experiment outputs go to /ephemeral and secrets are loaded from .env.
2.2k · bundle
orchestra-research Autoresearch
Orchestrates end-to-end autonomous AI research projects using a two-loop architecture for rapid experimentation and synthesis, producing papers and presentations.
10.4k · bundle
nvidia Nemo Rl Auto Research
Guides agents through the full lifecycle of NeMo-RL experiments: understanding recipes, launching reproducible runs, analyzing results, and preserving human oversight with git and TSV logs.
2.2k · bundle
More results
github Arize Dataset
Manage Arize datasets and examples using the ax CLI: create, list, get, export, and append datasets for evaluation and experimentation.
36.2k · bundle
github Arize Experiment
Creates, runs, and analyzes Arize experiments for evaluating and comparing model performance using the ax CLI.
36.2k · bundle
dylanckawalec Setup
Set up a new autoresearch experiment interactively. Collects domain, target file, eval command, metric, direction, and evaluator.
3
luokai0 Jpeng Ab Test
Manages A/B tests by running a Python script that processes input and produces JSON results.
10 · bundle
majiayu000 Ml
Guides machine learning development with experiment tracking, hyperparameter optimization, model registry, and MLOps pipeline integration.
567 · bundle
lambenthan Exp Design
Claim-driven 实验设计：界定目标 claims → 设计实验块（baseline/validation/ablation/robustness）→ 构建执行顺序 → 可选 Review LLM review → 写入 wiki
77
machenjie Test Data Management
`analysis-agent`/`task-agent`/`review-agent`: use when fixtures, factories, seeds, isolation, cleanup, or sensitive test-data rules change; skip when test data is unaffected.
4 · bundle
akillness Autoresearch
Run Karpathy-style autonomous ML search on a real training repo: choose the right mode (setup, program.md, bounded loop, results interpretation, or constrained-hardware adaptation), preserve the immutable prepare.py / 300-second / val_bpb contract, and route prompt/skill eval work away to LangSmith, Promptfoo, Braintrust, or skill-autoresearch.
42 · bundle
machenjie Test Strategy
`analysis-agent`/`task-agent`/`review-agent`: use to recommend a risk-to-test evidence portfolio and omissions; skip test implementation, fixed-command, and release-verdict work.
4 · bundle
k-dense-ai Arbor
Run autonomous optimization loops that iteratively improve artifacts against evaluators using hypothesis tree refinement, without overfitting.
30.2k · bundle
lingxling Arbor
Runs an autonomous optimization loop that iteratively improves an artifact against an objective and evaluator using Hypothesis Tree Refinement, with subagent executors in isolated git worktrees.
253 · bundle
orchestra-research Ara Research Manager
Records research provenance as a post-task epilogue, scanning conversation history to extract decisions, experiments, dead ends, claims, heuristics, and pivots, and writing them into the ara/ directory with provenance tags.
10.4k · bundle