Pilot Map Reduce

Distributed map-reduce over agent swarms for parallel data processing. Use this skill when: 1. You need to process large datasets across multiple workers 2. You want parallel map phase followed by aggregating reduce phase 3. You have embarrassingly parallel tasks with combine step Do NOT use this skill when: - Tasks are not parallelizable (use single worker) - You need streaming results (use pilot-load-balancer)

TeoSlayer Updated 9 repo stars

File contents

TeoSlayer/pilot-skills commit 3525560025

Frequently asked questions

npx get-skill add teoslayer/pilot-map-reduce