aradotso LLM Council Decision Framework
Skill by ara.so — Claude Code Skills collection.
Overview
LLM Council is a decision-making framework that transforms a single question into five independent expert perspectives, followed by peer review and a synthesized final recommendation. Instead of getting one AI opinion, you get diverse viewpoints that challenge assumptions, reveal blind spots, and surface conflicts before you commit.
Based on Andrej Karpathy's LLM Council methodology. Originally built by Ole Lehmann.
Core Concept
The council operates in three phases:
- Independent Analysis: 5 advisors with distinct cognitive styles analyze your question
- Peer Review: Each advisor reviews the others' recommendations
- Synthesis: A chairman delivers a final verdict highlighting consensus, conflicts, and action items
When to Use the Council
Good Use Cases:
- Strategic decisions with high stakes (product direction, pricing, positioning)
- Evaluating multiple options where trade-offs aren't obvious
- Pressure-testing assumptions before major commitments
- Getting outside perspectives on plans you've already drafted
- Scenarios where you need to see blind spots
Poor Use Cases:
- Factual questions with single correct answers
- Creative generation tasks (writing, coding)
- Simple processing tasks (summarization, formatting)
- Decisions you've already committed to emotionally
Installation
The skill is designed to work in Claude Code and Claude Cowork environments.
Method 1: Direct Installation
Place the SKILL.md file in your Claude skills directory:
# For Claude Code
mkdir -p ~/.config/claude/skills
curl -o ~/.config/claude/skills/llm-council.md \
https://raw.githubusercontent.com/aiwithremy/claude-skills-llm-council/main/SKILL.md
# For Cursor
mkdir -p ~/.cursor/skills
curl -o ~/.cursor/skills/llm-council.md \
https://raw.githubusercontent.com/aiwithremy/claude-skills-llm-council/main/SKILL.md
Method 2: AI-Assisted Installation
In a new chat:
Please install this Claude skill:
https://github.com/aiwithremy/claude-skills-llm-council
Set it up so I can use it immediately.
The AI will fetch and configure the skill automatically.
Usage Patterns
Basic Invocation
Trigger the council with natural language:
council this: Should I launch a $97 workshop or a $497 course?
run the council on: Which of these 3 positioning angles is strongest?
[paste your options]
pressure-test this:
I'm thinking of pivoting from SaaS to info products. Here's my reasoning...
Context-Rich Questions
The council performs best with detailed context:
war room this decision:
Context: I run a B2B SaaS with 200 customers at $50/mo.
60% churn annually. I'm considering switching to annual-only pricing.
Options:
1. Move everyone to annual ($500/yr, ~15% discount)
2. Keep monthly but add annual option
3. New customers annual-only, grandfather existing monthly
Concerns:
- Will forcing annual increase initial friction?
- Do I have enough leverage with current value prop?
- How do I handle the 40 customers who just renewed monthly?
What should I do?
Decision Documentation
Use the council to document major decisions:
council this for the record:
We're choosing between Rails and Next.js for our MVP.
Rails pros: Faster to ship, better conventions, team knows it
Rails cons: Harder to find devs, frontend feels dated
Next.js pros: Modern stack, easier hiring, better DX
Next.js cons: More complexity, slower initial velocity
We're leaning Rails. Talk us out of it or confirm.
The Five Advisor Archetypes
Understanding the advisor perspectives helps you interpret results:
- The Analyst: Data-driven, risk-focused, wants proof
- The Visionary: Big-picture thinking, opportunity-focused, explores upside
- The Skeptic: Challenges assumptions, finds holes, plays devil's advocate
- The Pragmatist: Implementation-focused, asks "can we actually do this?"
- The Contrarian: Takes the opposite position, surfaces ignored alternatives
Interpreting Results
Strong Consensus
When all 5 advisors agree on direction (rare), confidence is high:
Example output:
"Unanimous recommendation: Annual-only pricing
All advisors agree your churn problem requires commitment mechanism.
Confidence: Very High
Risk: Low (at your stage)"
Productive Conflict
When advisors split but patterns emerge:
Example output:
"3 advisors recommend A, 2 recommend B
Split reflects genuine trade-off between speed (A) and sustainability (B)
Chairman recommendation: Hybrid approach
Start with A, transition to B at $X milestone"
Analysis Paralysis
If the council reveals too many variables, simplify your question:
Instead of: "Should I change my pricing, positioning, and product strategy?"
Ask: "Should I change my pricing from $X to $Y?"
Configuration Options
Custom Advisor Roles
For specialized domains, you can request custom archetypes:
run a council with these roles:
- Technical Architect
- Security Expert
- DevOps Engineer
- Product Manager
- Engineering Manager
Question: Should we migrate from monolith to microservices?
Weighted Perspectives
Emphasize certain viewpoints:
council this, but weight the Pragmatist's opinion 2x:
Should we build our own auth or use Auth0?
[We have limited eng resources]
Time-Bounded Decisions
Add urgency constraints:
emergency council - need decision by EOD:
Our API provider just 10x'd pricing. Do we:
1. Pay and pass costs to customers
2. Migrate to alternative (2 week timeline)
3. Build in-house (4 month timeline)
Advanced Patterns
Iterative Refinement
Use multiple council rounds:
# Round 1: Direction
council this: Should we focus on enterprise or SMB?
[review output]
# Round 2: Validation
council this: Based on last council recommendation for enterprise,
should we hire sales first or build features first?
# Round 3: Tactics
council this: For enterprise sales hire, agency recruiter or
internal search?
Pre-Mortem Analysis
Test a decision you've already made:
stress test this:
We decided to launch on Product Hunt next Tuesday.
What could go wrong? What are we not seeing?
Comparison Mode
Evaluate multiple options side-by-side:
run parallel councils on:
Option A: [details]
Option B: [details]
Option C: [details]
Give me separate council votes on each, then rank them.
Common Issues
"The advisors all agree too easily"
- Your question may be too obvious
- Add more context about constraints and trade-offs
- Try: "What am I missing?" or "What's the contrarian take?"
"The output is too long"
- Request executive summary: "council this, executive summary only"
- Or: "council this, key conflicts and recommendation only"
"The advisors don't understand my domain"
- Provide more context upfront
- Use custom roles specific to your field
- Include relevant metrics/benchmarks
"I got a good answer but want to dig deeper"
- Follow up: "Have the Skeptic and Analyst debate this specific point"
- Or: "Expand on where the Visionary and Pragmatist disagreed"
Integration with Workflows
In Documentation
## Decision Log: Pricing Change
**Decision**: Move to annual-only pricing
**Date**: 2024-01-15
**Council Vote**: 4-1 in favor (Analyst dissented on timing)
**Key Risk**: Customer pushback during transition
**Mitigation**: Grandfather existing monthly for 6 months
In Pull Requests
council this PR decision:
We're choosing between two approaches to rate limiting:
[paste technical options]
Add council output to PR description before merge.
In Product Specs
## Feature Spec: Multiplayer Mode
### Decision Framework
council: Should we build real-time or async multiplayer first?
[council output here]
### Rationale
Based on council recommendation, proceeding with async.
Real-time deferred to Q3 pending performance infrastructure.
Best Practices
- Be Specific: Vague questions get vague answers
- Show Your Work: Share what you've already considered
- Set Stakes: Explain why the decision matters
- Accept Conflict: Disagreement among advisors is valuable data
- Act Decisively: The council informs, you decide
- Document: Save council outputs for future reference
Example Session
User: council this decision:
Context: Bootstrapped SaaS, $15K MRR, 2 founders
Decision: Raise VC funding now vs grow bootstrapped another year
Raising now:
- $1-2M seed possible based on initial conversations
- Could hire 2-3 engineers, accelerate shipping
- Market window feels narrow (competitors growing)
Staying bootstrapped:
- Keep control and optionality
- Already profitable, could hit $50K MRR organically
- VC changes the game, can't undo
Leaning toward staying bootstrapped but FOMO is real.
---
[Council runs...]
Chairman Verdict:
Strong 4-1 recommendation: Stay bootstrapped for 12 more months
Consensus points:
- Your profitability is rare leverage - don't surrender it prematurely
- $15K→$50K is achievable with current trajectory
- Raising at $50K MRR gets better terms and more options
Key conflict:
- Visionary warns about market timing risk
- But Analyst + Pragmatist note: competitors with funding
haven't proven better product-market fit
Recommended action:
Set milestone: If you're not at $40K MRR by Q4, revisit funding
Until then, optimize for profitable growth
Red flags that would change this:
- Competitor raises $10M+ and targets your customers directly
- Key team member wants to leave due to resource constraints
- Major platform change requires immediate technical investment
Resources
- Original repo: https://github.com/aiwithremy/claude-skills-llm-council
- Methodology: https://github.com/karpathy/llm-council
- Creator: https://x.com/itsolelehmann
Troubleshooting
Skill not triggering:
- Verify skill file is in correct directory
- Restart Claude Code/Cowork
- Try explicit trigger: "run the council on:"
Unexpected output format:
- Restate: "Use the full LLM Council format with 5 advisors"
- Check you're using a supported Claude model
Performance issues:
- Council queries are token-intensive
- For faster results: "Quick council with 3 advisors"
- Or: "Skip peer review, just give me 5 perspectives"