Experiment Manager

Manage lightweight experiment runs by standardizing configs, run logs, metrics, and comparison summaries. Use for reproducible experiment tracking.

Lanma-ctrl Updated

File contents

Experiment Manager Skill

Use this skill when running repeated experiments or comparing variants.

Minimum experiment record

For each run, save:

  • run_id
  • date/time
  • config
  • metric(s)
  • notes

File convention

  • configs go in experiments/configs/
  • metrics go in experiments/results/metrics.csv
  • summaries go in experiments/reports/

Decision rule

Prefer simple CSV/JSON tracking first. Only introduce MLflow/W&B/etc. when the project needs it.

Lanma-ctrl/codex-skills-paper-repro-demo/tree/main/skills/experiment-manager commit 4afe14c267

Frequently asked questions

npx skillmds@latest add lanma-ctrl/experiment-manager