R&R Rebuttal (joap-rebuttal)
A JAP R&R is demanding and usually multi-round. Reviewers and the action editor typically ask
for a sharper theoretical contribution, added methodological rigor (alternative models, CMV
diagnostics, robustness, measurement evidence), and fuller transparency. The response letter must
convert every reviewer, reassure the editor on the dual gate (theory + rigor), and keep the
masked manuscript anonymized.
When to trigger
- An R&R arrived and you are planning the revision + response letter
- Reviewers requested added analyses, alternative models, robustness, or open-science changes
- A requested analysis would change the claim or the contribution
- Writing the cover note to the action editor
Strategy
- Read the editor's letter as the rubric. The action editor adjudicates among reviewers and tells
you which points are decisive — solve those first and visibly.
- Point-by-point, every comment. Quote each comment, then respond; never skip or silently merge one.
- Strengthen the contribution, don't just defend. Many requests (sharper mechanism, alternative
models tested, CMV diagnostics, measurement invariance, robustness) make the paper stronger — do them
and say where. If the theory advance is the weak point, rebuild it (route to
joap-theory-and-hypotheses).
- Test rival explanations head-on. JAP reviewers raise alternative models and method artifacts;
run and report them rather than hand-waving — concede where a rival fits better, defend with evidence
where it does not.
- Place new material wisely. Core new evidence belongs in the manuscript; extended robustness,
invariance, and alternative-model tables usually go to online supplemental materials, summarized
in one sentence in the main text.
- Keep masking and transparency in sync. Maintain anonymization in the revised manuscript and
repository links, and reflect new analyses in the shared data/code and the data-availability
statement (see
joap-open-science-and-transparency).
Response-letter format
For each reviewer comment:
> [Quoted reviewer comment]
Response: [What we did / why we respectfully disagree, with evidence].
Change: [Main text section, supplement section, or table/figure number].
Open with a short summary of the main changes to the action editor; group by reviewer; end each
entry with the location.
Worked micro-example (illustrative response entries)
For the servant-leadership package, an R&R asked for an alternative model, a CMV check, and a sharper boundary.
> R2: Could reverse causality or a third variable explain the safety→
> performance path? An alternative model should be tested.
Response: We agree. We now test (a) the reversed mediation and (b) a model with
prior team performance (Wave 0) as a control; the hypothesized 2-2-2 model fits
better (ΔCFI > .01) and the indirect effect remains (.11, 95% CI [.04, .20]).
The lab experiment provides the causal warrant for the safety path.
Change: Results (alternative models); robustness grid → Supplement S4.
> R1: Same-source bias may inflate the field correlations.
Response: Predictor and outcome were separated by wave and source (member-rated
leadership/safety; supervisor-rated performance). We add a CFA marker-variable
test; estimates are essentially unchanged.
Change: Method (design separation), Results (marker test), Transparency statement.
R&R triage — where each request lands
| Reviewer ask |
Default home |
Note |
| Alternative / reverse-causal model |
Results (core) + supplement detail |
this often decides the paper |
| CMV diagnostic (marker, ULMC) |
Method + Results |
pair with the procedural remedies already used |
| Measurement invariance / extra validity |
supplement |
summarize one sentence in main text |
| Robustness / sensitivity grid |
supplement |
cite from one main-text sentence |
| "Sharpen the contribution" |
Introduction + Theory |
rebuild the mechanism/boundary, don't just reword |
| "Soften causal language" |
throughout |
scale verbs to the design; reserve causation for the experiment |
Recurring R&R pushback and the venue fix
- "Theory is still thin" → do not just expand the literature; articulate the new mechanism/boundary and
rederive the hypotheses (route to
joap-theory-and-hypotheses).
- "You didn't rule out the alternative" → run the rival model and report the comparison; this is the
most common reason a JAP R&R fails.
- "Added analysis quietly weakens the effect" → disclose it, interpret it, adjust the claim;
concealment is the cardinal sin.
- "Data/code don't reflect the revision" → update the deposit and the data-availability statement.
Anti-patterns
- Ignoring or merging away a comment without a visible response
- Defending against an alternative model instead of testing it
- Adding analyses that contradict the original claim without acknowledgment
- Rewording the introduction and calling it a strengthened contribution
- Letting shared data/code/transparency statement drift out of sync with the revision
- Reintroducing identifying information into the masked revision
Output format
【Editor's decisive points】addressed first? [list]
【Coverage】every reviewer comment answered? [Y/N]
【Contribution strengthened】mechanism/boundary sharpened? [Y/N]
【Rigor strengthened】alternative models + CMV + robustness added? [Y/N]
【Placement】core in main text, extended in supplement? [Y/N]
【Open-science + masking】data/code/statement updated; anonymization intact? [Y/N]
【Next】resubmit via Editorial Manager
Supplementary resources
1---2name: joap-rebuttal3description: Use when writing the response to a Journal of Applied Psychology (JAP) revise-and-resubmit. JAP R&Rs typically demand stronger theory, added rigor (alternative models, CMV checks, robustness), and fuller transparency across multiple reviewers and an action editor. The response must address every point, strengthen the contribution, and keep masking intact. Structures the response letter; it does not fabricate results.4---56# R&R Rebuttal (joap-rebuttal)78A JAP **R&R** is demanding and usually multi-round. Reviewers and the **action editor** typically ask9for a **sharper theoretical contribution**, **added methodological rigor** (alternative models, CMV10diagnostics, robustness, measurement evidence), and **fuller transparency**. The response letter must11**convert every reviewer**, **reassure the editor on the dual gate** (theory + rigor), and keep the12masked manuscript anonymized.1314## When to trigger1516- An R&R arrived and you are planning the revision + response letter17- Reviewers requested added analyses, alternative models, robustness, or open-science changes18- A requested analysis would change the claim or the contribution19- Writing the cover note to the action editor2021## Strategy22231. **Read the editor's letter as the rubric.** The action editor adjudicates among reviewers and tells24 you which points are decisive — solve those first and visibly.252. **Point-by-point, every comment.** Quote each comment, then respond; never skip or silently merge one.263. **Strengthen the contribution, don't just defend.** Many requests (sharper mechanism, alternative27 models tested, CMV diagnostics, measurement invariance, robustness) make the paper stronger — do them28 and say where. If the theory advance is the weak point, rebuild it (route to29 `joap-theory-and-hypotheses`).304. **Test rival explanations head-on.** JAP reviewers raise alternative models and method artifacts;31 run and report them rather than hand-waving — concede where a rival fits better, defend with evidence32 where it does not.335. **Place new material wisely.** Core new evidence belongs in the manuscript; extended robustness,34 invariance, and alternative-model tables usually go to **online supplemental materials**, summarized35 in one sentence in the main text.366. **Keep masking and transparency in sync.** Maintain anonymization in the revised manuscript and37 repository links, and reflect new analyses in the shared data/code and the data-availability38 statement (see `joap-open-science-and-transparency`).3940## Response-letter format4142For each reviewer comment:4344```45> [Quoted reviewer comment]4647Response: [What we did / why we respectfully disagree, with evidence].48Change: [Main text section, supplement section, or table/figure number].49```5051Open with a short **summary of the main changes** to the action editor; group by reviewer; end each52entry with the location.5354## Worked micro-example (illustrative response entries)5556For the servant-leadership package, an R&R asked for an alternative model, a CMV check, and a sharper boundary.5758```59> R2: Could reverse causality or a third variable explain the safety→60> performance path? An alternative model should be tested.6162Response: We agree. We now test (a) the reversed mediation and (b) a model with63prior team performance (Wave 0) as a control; the hypothesized 2-2-2 model fits64better (ΔCFI > .01) and the indirect effect remains (.11, 95% CI [.04, .20]).65The lab experiment provides the causal warrant for the safety path.66Change: Results (alternative models); robustness grid → Supplement S4.6768> R1: Same-source bias may inflate the field correlations.6970Response: Predictor and outcome were separated by wave and source (member-rated71leadership/safety; supervisor-rated performance). We add a CFA marker-variable72test; estimates are essentially unchanged.73Change: Method (design separation), Results (marker test), Transparency statement.74```7576## R&R triage — where each request lands7778| Reviewer ask | Default home | Note |79|--------------|--------------|------|80| Alternative / reverse-causal model | Results (core) + supplement detail | this often decides the paper |81| CMV diagnostic (marker, ULMC) | Method + Results | pair with the procedural remedies already used |82| Measurement invariance / extra validity | supplement | summarize one sentence in main text |83| Robustness / sensitivity grid | supplement | cite from one main-text sentence |84| "Sharpen the contribution" | Introduction + Theory | rebuild the mechanism/boundary, don't just reword |85| "Soften causal language" | throughout | scale verbs to the design; reserve causation for the experiment |8687## Recurring R&R pushback and the venue fix8889- "Theory is still thin" → do not just expand the literature; articulate the new mechanism/boundary and90 rederive the hypotheses (route to `joap-theory-and-hypotheses`).91- "You didn't rule out the alternative" → run the rival model and report the comparison; this is the92 most common reason a JAP R&R fails.93- "Added analysis quietly weakens the effect" → disclose it, interpret it, adjust the claim;94 concealment is the cardinal sin.95- "Data/code don't reflect the revision" → update the deposit and the data-availability statement.9697## Anti-patterns9899- Ignoring or merging away a comment without a visible response100- Defending against an alternative model instead of testing it101- Adding analyses that contradict the original claim without acknowledgment102- Rewording the introduction and calling it a strengthened contribution103- Letting shared data/code/transparency statement drift out of sync with the revision104- Reintroducing identifying information into the masked revision105106## Output format107108```109【Editor's decisive points】addressed first? [list]110【Coverage】every reviewer comment answered? [Y/N]111【Contribution strengthened】mechanism/boundary sharpened? [Y/N]112【Rigor strengthened】alternative models + CMV + robustness added? [Y/N]113【Placement】core in main text, extended in supplement? [Y/N]114【Open-science + masking】data/code/statement updated; anonymization intact? [Y/N]115【Next】resubmit via Editorial Manager116```117118## Supplementary resources119120- [`../../resources/official-source-map.md`](../../resources/official-source-map.md) — masked review model, action-editor process, TOP weighting
brycewang-stanford