LLM Council - Multi-Model Planning
Process
- Define the planning task clearly
- Send to 2-4 different models in parallel
- Each creates an independent plan
- Anonymize all plans (remove model names)
- Judge evaluates each plan on merits
- Judge selects best plan OR combines best elements
- Present final plan with reasoning
Judging Criteria
- Feasibility (can it actually be built?)
- Completeness (are all requirements covered?)
- Elegance (is it the simplest solution?)
- Scalability (will it work at 10x scale?)
- Security (are risks addressed?)
Rules
- Plans MUST be anonymized before judging
- Judge evaluates purely on quality, not model reputation
- Dissenting opinions are valuable — document them