Review Process (psci-review-process)
Psychological Science combines high-impact selectivity with strong credibility checks. Reviewers and
editors weigh not only whether the finding is interesting, but whether it is robust, adequately
powered, and transparent. Knowing this lets you pre-empt the common rejection reasons.
When to trigger
- Before submitting, to stress-test the manuscript
- Deciding whether to use the Registered Reports route
- Interpreting a decision letter and setting expectations
How review works
- Anonymized review. Initial submissions are anonymized; keep author identity out of the
manuscript and out of repository links (see
psci-submission).
- Editorial triage. Editors assess impact, breadth, robustness, and fit; the very tight format
means weak-fit or thin papers may be declined without full review.
- External review assesses theoretical contribution, design and power, analysis and disclosure,
and the strength of the claim relative to the evidence.
- Transparency is graded. The Research Transparency Statement is shared with reviewers, and
"limits on transparency will be a factor in editorial decisions"; preregistration quality
is also weighed.
- Decisions. Reject, revise and resubmit, or accept; expect substantive revision and frequent
requests for added robustness, disclosure, or analyses.
Registered Reports route (strongest for confirmatory claims)
- Stage 1: theory + design + analysis plan reviewed before data; in-principle acceptance
commits the journal regardless of outcome if you follow the plan. Stage 2 reports the results.
This route protects against publication bias and is well suited to confirmatory and replication work
(and RR with Existing Data for prior-collected data).
Shape the paper to pass
- Make impact and breadth explicit early; show the result is robust and well-powered.
- Disclose fully and share data/materials (or justify exemptions) — credibility signals matter here.
- Separate confirmatory from exploratory analyses honestly.
- Fit the format — reviewers notice when a paper fights the word limit.
Desk-reject and decline-without-review patterns
The tight format and credibility screen mean many manuscripts never reach external review. Confirm
current categories and limits against the journal's submission guidelines, but recognize these shapes:
| Pattern an editor sees |
Likely outcome |
Pre-empt it by |
| Surprising effect, single small study, no preregistration |
declined or RR suggestion |
add internal replication; preregister; report power |
| Narrow-paradigm result, no broad-relevance argument |
desk reject (fit) |
state who outside the subarea inherits the claim |
| "Data available on request," no DOIs |
returned for compliance |
deposit with persistent IDs before submitting |
| Over the word format, exhibits dumped at the end |
returned to author |
design to the format; embed exhibits |
| p-values and stars, no effect sizes/CIs |
thin-evidence flag |
estimation-first reporting |
Worked micro-example (illustrative triage)
Manuscript: two preregistered attention studies (N = 240; N = 300),
open data + materials with DOIs, effect sizes + CIs.
Editor read: impact (load-bearing premise), breadth (clinical inheritance),
robustness (internal replication), transparency (graded — strong).
Likely route: external review, probable R&R for added robustness/disclosure.
Counter-case: same finding, one N = 45 study, no prereg, request-only data
→ likely declined without full review.
How reviewers weigh the evidence (calibration anchors)
- A powered internal replication is the single strongest signal you can send; it converts "interesting
but fragile" into "credible."
- Transparency is graded, not pass/fail — a candid exemption with an access path reads better than
silent opacity. Preregistration quality (specific, dated, followed) matters more than its presence.
- Registered Reports are the venue's structural answer to publication bias; choosing the route after
data exist defeats its purpose and reviewers will say so.
Anti-patterns
- A surprising but underpowered, single-study effect
- Weak or absent transparency (counts against the paper)
- Exploratory results dressed as confirmatory
- Expecting acceptance without a robustness/disclosure-heavy R&R
- Choosing a Registered Report after results exist
Output format
【Impact + breadth】clear early? [Y/N]
【Robustness + power】adequate? [Y/N]
【Transparency】data/materials + statement + preregistration strong? [Y/N]
【Confirmatory vs exploratory】honest? [Y/N]
【Route】Research Article vs Registered Report
【Realistic outcome】reject / R&R / accept
【Next】psci-submission (or psci-rebuttal if decided)
Supplementary resources
Source: brycewang-stanford/Awesome-Journal-Skills → Psychological-Science-Skills/skills/psci-review-process/SKILL.md
1---2name: psci-review-process3description: Use when you need to understand how Psychological Science evaluates a manuscript — anonymized peer review, editorial weighting of robustness, transparency, and preregistration quality, desk-reject and decline-without-review patterns, and the Registered Reports route. Use when stress-testing a paper before submission or interpreting a decision letter. Sets expectations and shapes the paper to survive review; it does not contact editors.4---567# Review Process (psci-review-process)89Psychological Science combines high-impact selectivity with strong credibility checks. Reviewers and10editors weigh not only whether the finding is interesting, but whether it is **robust**, **adequately11powered**, and **transparent**. Knowing this lets you pre-empt the common rejection reasons.1213## When to trigger1415- Before submitting, to stress-test the manuscript16- Deciding whether to use the **Registered Reports** route17- Interpreting a decision letter and setting expectations1819## How review works20211. **Anonymized review.** Initial submissions are anonymized; keep author identity out of the22 manuscript and out of repository links (see `psci-submission`).232. **Editorial triage.** Editors assess impact, breadth, robustness, and fit; the very tight format24 means weak-fit or thin papers may be declined without full review.253. **External review** assesses theoretical contribution, design and power, analysis and disclosure,26 and the strength of the claim relative to the evidence.274. **Transparency is graded.** The **Research Transparency Statement** is shared with reviewers, and28 "**limits on transparency will be a factor in editorial decisions**"; **preregistration quality**29 is also weighed.305. **Decisions.** Reject, revise and resubmit, or accept; expect substantive revision and frequent31 requests for added robustness, disclosure, or analyses.3233## Registered Reports route (strongest for confirmatory claims)3435- **Stage 1**: theory + design + analysis plan reviewed **before** data; in-principle acceptance36 commits the journal regardless of outcome if you follow the plan. **Stage 2** reports the results.37 This route protects against publication bias and is well suited to confirmatory and replication work38 (and **RR with Existing Data** for prior-collected data).3940## Shape the paper to pass4142- Make impact and breadth explicit early; show the result is **robust and well-powered**.43- Disclose fully and share data/materials (or justify exemptions) — credibility signals matter here.44- Separate confirmatory from exploratory analyses honestly.45- Fit the format — reviewers notice when a paper fights the word limit.4647## Desk-reject and decline-without-review patterns4849The tight format and credibility screen mean many manuscripts never reach external review. Confirm50current categories and limits against the journal's submission guidelines, but recognize these shapes:5152| Pattern an editor sees | Likely outcome | Pre-empt it by |53|------------------------|----------------|----------------|54| Surprising effect, single small study, no preregistration | declined or RR suggestion | add internal replication; preregister; report power |55| Narrow-paradigm result, no broad-relevance argument | desk reject (fit) | state who outside the subarea inherits the claim |56| "Data available on request," no DOIs | returned for compliance | deposit with persistent IDs before submitting |57| Over the word format, exhibits dumped at the end | returned to author | design to the format; embed exhibits |58| p-values and stars, no effect sizes/CIs | thin-evidence flag | estimation-first reporting |5960## Worked micro-example (illustrative triage)6162```63Manuscript: two preregistered attention studies (N = 240; N = 300),64 open data + materials with DOIs, effect sizes + CIs.65Editor read: impact (load-bearing premise), breadth (clinical inheritance),66 robustness (internal replication), transparency (graded — strong).67Likely route: external review, probable R&R for added robustness/disclosure.68Counter-case: same finding, one N = 45 study, no prereg, request-only data69 → likely declined without full review.70```7172## How reviewers weigh the evidence (calibration anchors)7374- A powered internal replication is the single strongest signal you can send; it converts "interesting75 but fragile" into "credible."76- Transparency is graded, not pass/fail — a candid exemption with an access path reads better than77 silent opacity. Preregistration *quality* (specific, dated, followed) matters more than its presence.78- Registered Reports are the venue's structural answer to publication bias; choosing the route after79 data exist defeats its purpose and reviewers will say so.8081## Anti-patterns8283- A surprising but underpowered, single-study effect84- Weak or absent transparency (counts against the paper)85- Exploratory results dressed as confirmatory86- Expecting acceptance without a robustness/disclosure-heavy R&R87- Choosing a Registered Report after results exist8889## Output format9091```92【Impact + breadth】clear early? [Y/N]93【Robustness + power】adequate? [Y/N]94【Transparency】data/materials + statement + preregistration strong? [Y/N]95【Confirmatory vs exploratory】honest? [Y/N]96【Route】Research Article vs Registered Report97【Realistic outcome】reject / R&R / accept98【Next】psci-submission (or psci-rebuttal if decided)99```100101## Supplementary resources102103- [`../../resources/official-source-map.md`](../../resources/official-source-map.md) — review model, transparency weighting, Registered Reports104105---106107**Source:** [`brycewang-stanford/Awesome-Journal-Skills`](https://github.com/brycewang-stanford/Awesome-Journal-Skills) → `Psychological-Science-Skills/skills/psci-review-process/SKILL.md`
thedixitjain