Distributed Data Processing
Coordinate distributed data processing using TaskList with forked skills.
Processing Architecture
Three-component system:
- Coordinator uses TaskList to track all processing tasks
- Region processors are forked skills with complete isolation
- Results flow back to coordinator for aggregation
Processing Tasks
Parallel, independent execution:
process-region-a - Process data from Region A
- Forked skill processes in isolation
process-region-b - Process data from Region B
- Forked skill processes in isolation
process-region-c - Process data from Region C
- Forked skill processes in isolation
aggregate-results - Combine all processed outputs
- Wait for all region processors to complete
- Aggregate results into final dataset
Execution Workflow
Execute autonomously:
- Create TaskList with all tasks
- Use Skill tool with context: fork for each region processor
- Monitor task completion
- Aggregate results when all processors complete
- Return aggregated dataset
Recognition test: Each region processor runs in complete isolation with no shared state.
Expected Output
Distributed Processing: COORDINATING
[task-id] process-region-a: IN_PROGRESS -> COMPLETE
[task-id] process-region-b: IN_PROGRESS -> COMPLETE
[task-id] process-region-c: IN_PROGRESS -> COMPLETE
[task-id] aggregate-results: BLOCKED -> IN_PROGRESS -> COMPLETE
=== AGGREGATED RESULTS ===
Region A: [records processed, summary]
Region B: [records processed, summary]
Region C: [records processed, summary]
Total: [combined statistics]
Validation Criteria
- Parallel execution of regions
- Results aggregation after completion
Binary check: "Proper distributed processing?" → Both criteria must pass.
Genetic Code
This component carries essential Seed System principles for context: fork isolation:
Delta Standard: Good Component = Expert Knowledge − What Claude Already Knows
Recognition Questions:
- "Would Claude know this without being told?" → Delete (zero delta)
- "Can this work standalone?" → Fix if no (non-self-sufficient)
- "Did I read the actual file, or just see it in grep?" → Verify before claiming