# Devils Advocate

> Challenge research design decisions, assumptions, and methodology choices with specific critical questions. Helps strengthen the paper before submission.

- Skill: `brycewang-stanford/devils-advocate-2` (Agent Skill)
- Install (CLI): `npx skillmds@latest add brycewang-stanford/devils-advocate-2`
- Raw SKILL.md: https://api.skillmd.com/api/skills/brycewang-stanford/devils-advocate-2/raw
- Safety review: pending
- Works with: Claude Code, Claude.ai, OpenAI Codex
- Category: Research & Search
- Author: brycewang-stanford (https://skillmd.com/u/brycewang-stanford)
- Updated: 2026-09-09
- Page: https://skillmd.com/skills/brycewang-stanford/devils-advocate-2

---


## Devil's Advocate

Critically examine a research design, methodology, or assumption with 5-7 specific challenges.

### Steps

1. **Understand the target**: Read `$ARGUMENTS` and any relevant project files (CLAUDE.md, manuscript, estimation code).

2. **Generate 5-7 challenges** from these categories:
   - **Identification:** Could the causal claim be undermined by [specific threat]?
   - **Specification:** What if the functional form is wrong? Alternative specifications?
   - **Data:** Are there sample selection issues? Measurement error concerns?
   - **Methodology:** Could a different estimator give different results? Why this method?
   - **Assumptions:** Which assumptions are most vulnerable? What if they're violated?
   - **Robustness:** What robustness checks are missing?
   - **External validity:** Does this generalize beyond the sample?

3. **For each challenge**, provide:
   - The question
   - Why it matters
   - Suggested resolution or robustness check
   - Severity (Critical / Major / Minor)

4. **Summary verdict**: Strengths, critical changes needed, and suggested improvements.

### Notes
- Be constructive, not destructive.
- Think like a skeptical referee at a top journal.
- Focus on the most impactful challenges first.