closedloop-technologies Experiment Tree Analysis
Use this skill to analyze runs, attempts, failures, lineage, and recurring constraints.
Inputs
- Registry path
- Run IDs or all recent runs
- Attempt summaries
- Evaluations
- Costs
- Human decisions
- Lineage records
Procedure
- List runs and attempts from the registry.
- Group failures by command, policy surface, file area, and attempt lineage.
- Identify repeated failure causes and repeated successful patterns.
- Identify missing docs, weak tests, ambiguous policy, or expensive workflows.
- Distinguish product-code problems from ClimbHill-process problems.
- Produce issue proposals with evidence and acceptance criteria.
Outputs
- Failure pattern summary
- Useful resource and skill observations
- Attempt lineage notes
- GitHub issue proposals
Rubric
- Findings cite run IDs, attempt IDs, evaluations, or reports.
- Proposed issues are concrete and reviewable.
- The analysis does not invent causes unsupported by registry evidence.
- The next loop is clearer because of the analysis.