majiayu000 Planning Skill
Purpose
Take the selected hypothesis from ideation and produce a detailed experiment blueprint specifying datasets, baselines, evaluation metrics, and ablation groups.
Tools Required
None. This skill operates entirely through LLM reasoning over the ideation output.
Input
ideation_output: Path topapers/ideation_output.jsonproduced by the ideation skill
Process
- Parse the selected hypothesis and supporting literature from the ideation output
- Identify candidate datasets that are publicly available and appropriate for validating the hypothesis
- Select 2-4 baseline methods from the surveyed literature for comparison
- Define primary and secondary evaluation metrics aligned with the hypothesis
- Design ablation groups that isolate each novel component of the proposed approach
- Estimate computational requirements and timeline for each experiment
- Compile everything into a structured experiment blueprint
Output
Produces papers/experiment_blueprint.json containing:
- Selected hypothesis (carried forward)
- Dataset specifications (name, source, splits, preprocessing steps)
- Baseline methods with references
- Evaluation metrics and success criteria
- Ablation study design (groups, variables, expected outcomes)
- Resource estimates and experiment schedule