Manuscript Review
Produce a thorough, constructive review of an academic manuscript — the kind of report a top-journal referee would write.
Input: $ARGUMENTS — path to a paper (.tex, .pdf, or .qmd), or a filename in master_supporting_docs/.
Steps
Locate and read the manuscript. Check:
- Direct path from
$ARGUMENTS
master_supporting_docs/supporting_papers/$ARGUMENTS
- Glob for partial matches
Read the full paper end-to-end. For long PDFs, read in chunks (5 pages at a time).
Evaluate across 6 dimensions (see below).
Generate 3-5 "referee objections" — the tough questions a top referee would ask.
Produce the review report.
Save to quality_reports/paper_review_[sanitized_name].md
Review Dimensions
1. Argument Structure
- Is the research question clearly stated?
- Does the introduction motivate the question effectively?
- Is the logical flow sound (question → method → results → conclusion)?
- Are the conclusions supported by the evidence?
- Are limitations acknowledged?
2. Identification Strategy
- Is the causal claim credible?
- What are the key identifying assumptions? Are they stated explicitly?
- Are there threats to identification (omitted variables, reverse causality, measurement error)?
- Are robustness checks adequate?
- Is the estimator appropriate for the research design?
3. Econometric Specification
- Correct standard errors (clustered? robust? bootstrap?)?
- Appropriate functional form?
- Sample selection issues?
- Multiple testing concerns?
- Are point estimates economically meaningful (not just statistically significant)?
4. Literature Positioning
- Are the key papers cited?
- Is prior work characterized accurately?
- Is the contribution clearly differentiated from existing work?
- Any missing citations that a referee would flag?
5. Writing Quality
- Clarity and concision
- Academic tone
- Consistent notation throughout
- Abstract effectively summarizes the paper
- Tables and figures are self-contained (clear labels, notes, sources)
6. Presentation
- Are tables and figures well-designed?
- Is notation consistent throughout?
- Are there any typos, grammatical errors, or formatting issues?
- Is the paper the right length for the contribution?
Output Format
# Manuscript Review: [Paper Title]
**Date:** [YYYY-MM-DD]
**Reviewer:** review-paper skill
**File:** [path to manuscript]
## Summary Assessment
**Overall recommendation:** [Strong Accept / Accept / Revise & Resubmit / Reject]
[2-3 paragraph summary: main contribution, strengths, and key concerns]
## Strengths
1. [Strength 1]
2. [Strength 2]
3. [Strength 3]
## Major Concerns
### MC1: [Title]
- **Dimension:** [Identification / Econometrics / Argument / Literature / Writing / Presentation]
- **Issue:** [Specific description]
- **Suggestion:** [How to address it]
- **Location:** [Section/page/table if applicable]
[Repeat for each major concern]
## Minor Concerns
### mc1: [Title]
- **Issue:** [Description]
- **Suggestion:** [Fix]
[Repeat]
## Referee Objections
These are the tough questions a top referee would likely raise:
### RO1: [Question]
**Why it matters:** [Why this could be fatal]
**How to address it:** [Suggested response or additional analysis]
[Repeat for 3-5 objections]
## Specific Comments
[Line-by-line or section-by-section comments, if any]
## Summary Statistics
| Dimension | Rating (1-5) |
|-----------|-------------|
| Argument Structure | [N] |
| Identification | [N] |
| Econometrics | [N] |
| Literature | [N] |
| Writing | [N] |
| Presentation | [N] |
| **Overall** | **[N]** |
Principles
- Be constructive. Every criticism should come with a suggestion.
- Be specific. Reference exact sections, equations, tables.
- Think like a referee at a top-5 journal. What would make them reject?
- Distinguish fatal flaws from minor issues. Not everything is equally important.
- Acknowledge what's done well. Good research deserves recognition.
- Do NOT fabricate details. If you can't read a section clearly, say so.
1---
2name: review-paper-4
3description: Comprehensive manuscript review covering argument structure, econometric specification, citation completeness, and potential referee objections
4argument-hint: "[paper filename in master_supporting_docs/ or path to .tex/.pdf]"
5allowed-tools: ["Read", "Grep", "Glob", "Write", "Task"]
6---
7
8# Manuscript Review
9
10Produce a thorough, constructive review of an academic manuscript — the kind of report a top-journal referee would write.
11
12**Input:** `$ARGUMENTS` — path to a paper (.tex, .pdf, or .qmd), or a filename in `master_supporting_docs/`.
13
14---
15
16## Steps
17
181. **Locate and read the manuscript.** Check:
19 - Direct path from `$ARGUMENTS`
20 - `master_supporting_docs/supporting_papers/$ARGUMENTS`
21 - Glob for partial matches
22
232. **Read the full paper** end-to-end. For long PDFs, read in chunks (5 pages at a time).
24
253. **Evaluate across 6 dimensions** (see below).
26
274. **Generate 3-5 "referee objections"** — the tough questions a top referee would ask.
28
295. **Produce the review report.**
30
316. **Save to** `quality_reports/paper_review_[sanitized_name].md`
32
33---
34
35## Review Dimensions
36
37### 1. Argument Structure
38- Is the research question clearly stated?
39- Does the introduction motivate the question effectively?
40- Is the logical flow sound (question → method → results → conclusion)?
41- Are the conclusions supported by the evidence?
42- Are limitations acknowledged?
43
44### 2. Identification Strategy
45- Is the causal claim credible?
46- What are the key identifying assumptions? Are they stated explicitly?
47- Are there threats to identification (omitted variables, reverse causality, measurement error)?
48- Are robustness checks adequate?
49- Is the estimator appropriate for the research design?
50
51### 3. Econometric Specification
52- Correct standard errors (clustered? robust? bootstrap?)?
53- Appropriate functional form?
54- Sample selection issues?
55- Multiple testing concerns?
56- Are point estimates economically meaningful (not just statistically significant)?
57
58### 4. Literature Positioning
59- Are the key papers cited?
60- Is prior work characterized accurately?
61- Is the contribution clearly differentiated from existing work?
62- Any missing citations that a referee would flag?
63
64### 5. Writing Quality
65- Clarity and concision
66- Academic tone
67- Consistent notation throughout
68- Abstract effectively summarizes the paper
69- Tables and figures are self-contained (clear labels, notes, sources)
70
71### 6. Presentation
72- Are tables and figures well-designed?
73- Is notation consistent throughout?
74- Are there any typos, grammatical errors, or formatting issues?
75- Is the paper the right length for the contribution?
76
77---
78
79## Output Format
80
81```markdown
82# Manuscript Review: [Paper Title]
83
84**Date:** [YYYY-MM-DD]
85**Reviewer:** review-paper skill
86**File:** [path to manuscript]
87
88## Summary Assessment
89
90**Overall recommendation:** [Strong Accept / Accept / Revise & Resubmit / Reject]
91
92[2-3 paragraph summary: main contribution, strengths, and key concerns]
93
94## Strengths
95
961. [Strength 1]
972. [Strength 2]
983. [Strength 3]
99
100## Major Concerns
101
102### MC1: [Title]
103- **Dimension:** [Identification / Econometrics / Argument / Literature / Writing / Presentation]
104- **Issue:** [Specific description]
105- **Suggestion:** [How to address it]
106- **Location:** [Section/page/table if applicable]
107
108[Repeat for each major concern]
109
110## Minor Concerns
111
112### mc1: [Title]
113- **Issue:** [Description]
114- **Suggestion:** [Fix]
115
116[Repeat]
117
118## Referee Objections
119
120These are the tough questions a top referee would likely raise:
121
122### RO1: [Question]
123**Why it matters:** [Why this could be fatal]
124**How to address it:** [Suggested response or additional analysis]
125
126[Repeat for 3-5 objections]
127
128## Specific Comments
129
130[Line-by-line or section-by-section comments, if any]
131
132## Summary Statistics
133
134| Dimension | Rating (1-5) |
135|-----------|-------------|
136| Argument Structure | [N] |
137| Identification | [N] |
138| Econometrics | [N] |
139| Literature | [N] |
140| Writing | [N] |
141| Presentation | [N] |
142| **Overall** | **[N]** |
143```
144
145---
146
147## Principles
148
149- **Be constructive.** Every criticism should come with a suggestion.
150- **Be specific.** Reference exact sections, equations, tables.
151- **Think like a referee at a top-5 journal.** What would make them reject?
152- **Distinguish fatal flaws from minor issues.** Not everything is equally important.
153- **Acknowledge what's done well.** Good research deserves recognition.
154- **Do NOT fabricate details.** If you can't read a section clearly, say so.