Review Process (joap-review-process)
JAP is selective and exacting. Reviewers and the action editor weigh theoretical contribution and
methodological rigor together — an interesting finding with weak measurement, and a flawless design
with no theory advance, are both common rejections. Review is masked (anonymized). Knowing how the
gate works lets you pre-empt the standard rejection reasons.
When to trigger
- Before submitting, to stress-test the manuscript
- Deciding how to frame the contribution and rigor for masked reviewers
- Interpreting a decision letter and setting expectations
How review works
- Masked review. Author identities are withheld throughout consideration; keep names out of the
manuscript and out of repository/preregistration links (see
joap-submission).
- Editorial triage. The editor / action editor screens for fit, theoretical contribution, and
rigor; weak-fit or atheoretical papers are frequently desk rejected without full review.
- Action-editor model. An associate/action editor manages the manuscript and several reviewers and
writes the decision; the editor's letter is the rubric you must satisfy on revision.
- External review assesses the theoretical contribution, construct validity and measurement,
design and causal warrant, analysis (SEM/HLM/mediation/meta-analysis), and transparency.
- Transparency is weighed. TOP-aligned data/materials/code sharing and preregistration factor into
evaluation; opacity is a mark against the paper.
- Decisions. Reject, major/minor revise-and-resubmit, or accept; expect a demanding R&R, often
across multiple rounds, before acceptance.
The dual gate (what gets papers in)
| Gate |
What reviewers ask |
Where to fix it |
| Theoretical contribution |
Is there a new mechanism/boundary/integration? |
joap-theory-and-hypotheses, joap-literature-positioning |
| Construct validity / measurement |
Are the constructs validly measured? |
joap-study-design |
| Causal / inferential warrant |
Does the design support the claim (CMV, nesting)? |
joap-study-design, joap-data-analysis |
| Analytic rigor |
SEM fit, indirect-effect CIs, multilevel done right? |
joap-data-analysis |
| Transparency |
Data/materials/code shared under TOP? |
joap-open-science-and-transparency |
Desk-reject and decline-without-review patterns
The dual gate means many manuscripts never reach external review. Confirm current categories on the
official page, but recognize these shapes:
| Pattern an editor sees |
Likely outcome |
Pre-empt it by |
| Rigorous study, no theoretical advance |
desk reject |
state the new mechanism/boundary/integration up front |
| Cross-sectional single-source self-report |
desk reject (rigor) |
add temporal/source separation or an experimental leg |
| Better fit for a sibling venue |
desk reject (fit) |
make the I-O micro/measurement contribution explicit |
| Mediation by Sobel/steps; OLS on nested data |
thin-method flag |
modern indirect-effect CIs; multilevel models |
| "Data available on request," no DOIs |
returned for compliance |
deposit with persistent IDs before submitting |
Worked micro-example (illustrative triage)
Manuscript: two-wave multilevel field study (612 in 74 teams) + lab experiment,
servant leadership → safety → performance, open data/materials/code,
experiment preregistered, indirect-effect CI reported.
Editor read: contribution (cross-level mechanism + boundary), rigor (temporal +
multilevel + experimental leg), transparency (TOP-aligned — strong).
Likely route: external review, probable major R&R (added robustness/alternative
models, sharper boundary theory).
Counter-case: same finding, one cross-sectional single-source survey, no prereg,
request-only data → likely desk reject.
How reviewers weigh the evidence (calibration anchors)
- The single strongest signal is theory + rigor together: a clear mechanism and a design that can
bear the causal/cumulative claim. Either alone usually loses.
- A causal leg (experiment or field experiment) attached to a field study converts "interesting
correlation" into "credible mechanism."
- Transparency is weighed, not pass/fail — a candid exemption with an access path reads better than
silent opacity; preregistration quality matters more than mere presence.
- Expect multiple R&R rounds; reviewers test alternative explanations and measurement rivals hard.
Anti-patterns
- A rigorous but atheoretical paper (the venue's most common rejection)
- Cross-sectional single-source self-report as the whole evidentiary base
- Exploratory results dressed as confirmatory
- Weak or absent transparency (counts against the paper)
- Expecting acceptance without a demanding, multi-round R&R
Output format
【Theoretical contribution】clear + new? [Y/N]
【Construct validity / measurement】adequate? [Y/N]
【Causal / inferential warrant】CMV + nesting handled? [Y/N]
【Analytic rigor】SEM fit / indirect CIs / multilevel correct? [Y/N]
【Transparency】data/materials/code + preregistration strong? [Y/N]
【Realistic outcome】desk reject / R&R / accept
【Next】joap-submission (or joap-rebuttal if decided)
Supplementary resources
1---2name: joap-review-process3description: Use when you need to understand how the Journal of Applied Psychology (JAP) evaluates a manuscript — masked (anonymized) peer review, the action-editor model, the dual gate of theoretical contribution and measurement/design rigor, and common desk-reject patterns. Use when stress-testing a paper before submission or interpreting a decision letter. Sets expectations and shapes the paper to survive review; it does not contact editors.4---56# Review Process (joap-review-process)78JAP is selective and exacting. Reviewers and the action editor weigh **theoretical contribution** and9**methodological rigor together** — an interesting finding with weak measurement, and a flawless design10with no theory advance, are both common rejections. Review is **masked (anonymized)**. Knowing how the11gate works lets you pre-empt the standard rejection reasons.1213## When to trigger1415- Before submitting, to stress-test the manuscript16- Deciding how to frame the contribution and rigor for masked reviewers17- Interpreting a decision letter and setting expectations1819## How review works20211. **Masked review.** Author identities are withheld throughout consideration; keep names out of the22 manuscript and out of repository/preregistration links (see `joap-submission`).232. **Editorial triage.** The editor / action editor screens for fit, theoretical contribution, and24 rigor; weak-fit or atheoretical papers are frequently **desk rejected** without full review.253. **Action-editor model.** An associate/action editor manages the manuscript and several reviewers and26 writes the decision; the editor's letter is the rubric you must satisfy on revision.274. **External review** assesses the theoretical contribution, construct validity and measurement,28 design and causal warrant, analysis (SEM/HLM/mediation/meta-analysis), and transparency.295. **Transparency is weighed.** TOP-aligned data/materials/code sharing and preregistration factor into30 evaluation; opacity is a mark against the paper.316. **Decisions.** Reject, major/minor revise-and-resubmit, or accept; expect a demanding R&R, often32 across multiple rounds, before acceptance.3334## The dual gate (what gets papers in)3536| Gate | What reviewers ask | Where to fix it |37|------|--------------------|-----------------|38| Theoretical contribution | Is there a new mechanism/boundary/integration? | `joap-theory-and-hypotheses`, `joap-literature-positioning` |39| Construct validity / measurement | Are the constructs validly measured? | `joap-study-design` |40| Causal / inferential warrant | Does the design support the claim (CMV, nesting)? | `joap-study-design`, `joap-data-analysis` |41| Analytic rigor | SEM fit, indirect-effect CIs, multilevel done right? | `joap-data-analysis` |42| Transparency | Data/materials/code shared under TOP? | `joap-open-science-and-transparency` |4344## Desk-reject and decline-without-review patterns4546The dual gate means many manuscripts never reach external review. Confirm current categories on the47official page, but recognize these shapes:4849| Pattern an editor sees | Likely outcome | Pre-empt it by |50|------------------------|----------------|----------------|51| Rigorous study, no theoretical advance | desk reject | state the new mechanism/boundary/integration up front |52| Cross-sectional single-source self-report | desk reject (rigor) | add temporal/source separation or an experimental leg |53| Better fit for a sibling venue | desk reject (fit) | make the I-O micro/measurement contribution explicit |54| Mediation by Sobel/steps; OLS on nested data | thin-method flag | modern indirect-effect CIs; multilevel models |55| "Data available on request," no DOIs | returned for compliance | deposit with persistent IDs before submitting |5657## Worked micro-example (illustrative triage)5859```60Manuscript: two-wave multilevel field study (612 in 74 teams) + lab experiment,61 servant leadership → safety → performance, open data/materials/code,62 experiment preregistered, indirect-effect CI reported.63Editor read: contribution (cross-level mechanism + boundary), rigor (temporal +64 multilevel + experimental leg), transparency (TOP-aligned — strong).65Likely route: external review, probable major R&R (added robustness/alternative66 models, sharper boundary theory).67Counter-case: same finding, one cross-sectional single-source survey, no prereg,68 request-only data → likely desk reject.69```7071## How reviewers weigh the evidence (calibration anchors)7273- The single strongest signal is **theory + rigor together**: a clear mechanism *and* a design that can74 bear the causal/cumulative claim. Either alone usually loses.75- A causal leg (experiment or field experiment) attached to a field study converts "interesting76 correlation" into "credible mechanism."77- Transparency is weighed, not pass/fail — a candid exemption with an access path reads better than78 silent opacity; preregistration *quality* matters more than mere presence.79- Expect multiple R&R rounds; reviewers test alternative explanations and measurement rivals hard.8081## Anti-patterns8283- A rigorous but atheoretical paper (the venue's most common rejection)84- Cross-sectional single-source self-report as the whole evidentiary base85- Exploratory results dressed as confirmatory86- Weak or absent transparency (counts against the paper)87- Expecting acceptance without a demanding, multi-round R&R8889## Output format9091```92【Theoretical contribution】clear + new? [Y/N]93【Construct validity / measurement】adequate? [Y/N]94【Causal / inferential warrant】CMV + nesting handled? [Y/N]95【Analytic rigor】SEM fit / indirect CIs / multilevel correct? [Y/N]96【Transparency】data/materials/code + preregistration strong? [Y/N]97【Realistic outcome】desk reject / R&R / accept98【Next】joap-submission (or joap-rebuttal if decided)99```100101## Supplementary resources102103- [`../../resources/official-source-map.md`](../../resources/official-source-map.md) — masked review model, TOP weighting, action-editor process
brycewang-stanford