Experiment

Start a new experiment with hypothesis and success criteria Use when this capability is needed.

tomevault-io Updated

File contents

Before running the next experiment, document your plan:

  1. State your hypothesis — what you expect to happen and why
  2. Define success criteria — specific metrics and thresholds
  3. Describe the changes you'll make from the current baseline

After the experiment completes, append a line to .distillate/runs.jsonl:

{"$schema":"distillate/run/v1", "id":"run_NNN", "timestamp":"ISO8601", "status":"keep|discard|crash", "hypothesis":"...", "changes":"...", "hyperparameters":{...}, "results":{...}, "reasoning":"..."}

Set status to keep if results improved, discard if not, or crash on failure. Include reasoning to explain your decision.


Source: rlacombe/distillate — distributed by TomeVault.

tomevault-io/skills-registry/tree/main/rlacombe--distillate--distillate commit cfc9738034

Frequently asked questions

npx skillmds@latest add tomevault-io/experiment