Review Process (psci-review-process)
Psychological Science combines high-impact selectivity with strong credibility checks. Reviewers and
editors weigh not only whether the finding is interesting, but whether it is robust, adequately
powered, and transparent. Knowing this lets you pre-empt the common rejection reasons.
When to trigger
- Before submitting, to stress-test the manuscript
- Deciding whether to use the Registered Reports route
- Interpreting a decision letter and setting expectations
How review works
- Anonymized review. Initial submissions are anonymized; keep author identity out of the
manuscript and out of repository links (see
psci-submission).
- Editorial triage. Editors assess impact, breadth, robustness, and fit; the very tight format
means weak-fit or thin papers may be declined without full review.
- External review assesses theoretical contribution, design and power, analysis and disclosure,
and the strength of the claim relative to the evidence.
- Transparency is graded. The Research Transparency Statement is shared with reviewers, and
"limits on transparency will be a factor in editorial decisions"; preregistration quality
is also weighed.
- Decisions. Reject, revise and resubmit, or accept; expect substantive revision and frequent
requests for added robustness, disclosure, or analyses.
Registered Reports route (strongest for confirmatory claims)
- Stage 1: theory + design + analysis plan reviewed before data; in-principle acceptance
commits the journal regardless of outcome if you follow the plan. Stage 2 reports the results.
This route protects against publication bias and is well suited to confirmatory and replication work
(and RR with Existing Data for prior-collected data).
Shape the paper to pass
- Make impact and breadth explicit early; show the result is robust and well-powered.
- Disclose fully and share data/materials (or justify exemptions) — credibility signals matter here.
- Separate confirmatory from exploratory analyses honestly.
- Fit the format — reviewers notice when a paper fights the word limit.
Desk-reject and decline-without-review patterns
The tight format and credibility screen mean many manuscripts never reach external review. Confirm
current categories and limits against the journal's submission guidelines, but recognize these shapes:
| Pattern an editor sees |
Likely outcome |
Pre-empt it by |
| Surprising effect, single small study, no preregistration |
declined or RR suggestion |
add internal replication; preregister; report power |
| Narrow-paradigm result, no broad-relevance argument |
desk reject (fit) |
state who outside the subarea inherits the claim |
| "Data available on request," no DOIs |
returned for compliance |
deposit with persistent IDs before submitting |
| Over the word format, exhibits dumped at the end |
returned to author |
design to the format; embed exhibits |
| p-values and stars, no effect sizes/CIs |
thin-evidence flag |
estimation-first reporting |
Worked micro-example (illustrative triage)
Manuscript: two preregistered attention studies (N = 240; N = 300),
open data + materials with DOIs, effect sizes + CIs.
Editor read: impact (load-bearing premise), breadth (clinical inheritance),
robustness (internal replication), transparency (graded — strong).
Likely route: external review, probable R&R for added robustness/disclosure.
Counter-case: same finding, one N = 45 study, no prereg, request-only data
→ likely declined without full review.
How reviewers weigh the evidence (calibration anchors)
- A powered internal replication is the single strongest signal you can send; it converts "interesting
but fragile" into "credible."
- Transparency is graded, not pass/fail — a candid exemption with an access path reads better than
silent opacity. Preregistration quality (specific, dated, followed) matters more than its presence.
- Registered Reports are the venue's structural answer to publication bias; choosing the route after
data exist defeats its purpose and reviewers will say so.
Anti-patterns
- A surprising but underpowered, single-study effect
- Weak or absent transparency (counts against the paper)
- Exploratory results dressed as confirmatory
- Expecting acceptance without a robustness/disclosure-heavy R&R
- Choosing a Registered Report after results exist
Output format
【Impact + breadth】clear early? [Y/N]
【Robustness + power】adequate? [Y/N]
【Transparency】data/materials + statement + preregistration strong? [Y/N]
【Confirmatory vs exploratory】honest? [Y/N]
【Route】Research Article vs Registered Report
【Realistic outcome】reject / R&R / accept
【Next】psci-submission (or psci-rebuttal if decided)
Supplementary resources
1---2name: psci-review-process3description: Use when you need to understand how Psychological Science evaluates a manuscript — anonymized peer review, editorial weighting of robustness, transparency, and preregistration quality, desk-reject and decline-without-review patterns, and the Registered Reports route. Use when stress-testing a paper before submission or interpreting a decision letter. Sets expectations and shapes the paper to survive review; it does not contact editors.4---56# Review Process (psci-review-process)78Psychological Science combines high-impact selectivity with strong credibility checks. Reviewers and9editors weigh not only whether the finding is interesting, but whether it is **robust**, **adequately10powered**, and **transparent**. Knowing this lets you pre-empt the common rejection reasons.1112## When to trigger1314- Before submitting, to stress-test the manuscript15- Deciding whether to use the **Registered Reports** route16- Interpreting a decision letter and setting expectations1718## How review works19201. **Anonymized review.** Initial submissions are anonymized; keep author identity out of the21 manuscript and out of repository links (see `psci-submission`).222. **Editorial triage.** Editors assess impact, breadth, robustness, and fit; the very tight format23 means weak-fit or thin papers may be declined without full review.243. **External review** assesses theoretical contribution, design and power, analysis and disclosure,25 and the strength of the claim relative to the evidence.264. **Transparency is graded.** The **Research Transparency Statement** is shared with reviewers, and27 "**limits on transparency will be a factor in editorial decisions**"; **preregistration quality**28 is also weighed.295. **Decisions.** Reject, revise and resubmit, or accept; expect substantive revision and frequent30 requests for added robustness, disclosure, or analyses.3132## Registered Reports route (strongest for confirmatory claims)3334- **Stage 1**: theory + design + analysis plan reviewed **before** data; in-principle acceptance35 commits the journal regardless of outcome if you follow the plan. **Stage 2** reports the results.36 This route protects against publication bias and is well suited to confirmatory and replication work37 (and **RR with Existing Data** for prior-collected data).3839## Shape the paper to pass4041- Make impact and breadth explicit early; show the result is **robust and well-powered**.42- Disclose fully and share data/materials (or justify exemptions) — credibility signals matter here.43- Separate confirmatory from exploratory analyses honestly.44- Fit the format — reviewers notice when a paper fights the word limit.4546## Desk-reject and decline-without-review patterns4748The tight format and credibility screen mean many manuscripts never reach external review. Confirm49current categories and limits against the journal's submission guidelines, but recognize these shapes:5051| Pattern an editor sees | Likely outcome | Pre-empt it by |52|------------------------|----------------|----------------|53| Surprising effect, single small study, no preregistration | declined or RR suggestion | add internal replication; preregister; report power |54| Narrow-paradigm result, no broad-relevance argument | desk reject (fit) | state who outside the subarea inherits the claim |55| "Data available on request," no DOIs | returned for compliance | deposit with persistent IDs before submitting |56| Over the word format, exhibits dumped at the end | returned to author | design to the format; embed exhibits |57| p-values and stars, no effect sizes/CIs | thin-evidence flag | estimation-first reporting |5859## Worked micro-example (illustrative triage)6061```62Manuscript: two preregistered attention studies (N = 240; N = 300),63 open data + materials with DOIs, effect sizes + CIs.64Editor read: impact (load-bearing premise), breadth (clinical inheritance),65 robustness (internal replication), transparency (graded — strong).66Likely route: external review, probable R&R for added robustness/disclosure.67Counter-case: same finding, one N = 45 study, no prereg, request-only data68 → likely declined without full review.69```7071## How reviewers weigh the evidence (calibration anchors)7273- A powered internal replication is the single strongest signal you can send; it converts "interesting74 but fragile" into "credible."75- Transparency is graded, not pass/fail — a candid exemption with an access path reads better than76 silent opacity. Preregistration *quality* (specific, dated, followed) matters more than its presence.77- Registered Reports are the venue's structural answer to publication bias; choosing the route after78 data exist defeats its purpose and reviewers will say so.7980## Anti-patterns8182- A surprising but underpowered, single-study effect83- Weak or absent transparency (counts against the paper)84- Exploratory results dressed as confirmatory85- Expecting acceptance without a robustness/disclosure-heavy R&R86- Choosing a Registered Report after results exist8788## Output format8990```91【Impact + breadth】clear early? [Y/N]92【Robustness + power】adequate? [Y/N]93【Transparency】data/materials + statement + preregistration strong? [Y/N]94【Confirmatory vs exploratory】honest? [Y/N]95【Route】Research Article vs Registered Report96【Realistic outcome】reject / R&R / accept97【Next】psci-submission (or psci-rebuttal if decided)98```99100## Supplementary resources101102- [`../../resources/official-source-map.md`](../../resources/official-source-map.md) — review model, transparency weighting, Registered Reports
brycewang-stanford