Review Process (jedpsych-review-process)
The Journal of Educational Psychology combines selectivity for educational importance with rigorous
methodological scrutiny. Under masked review, both author and reviewer identities are hidden, and
editors and expert reviewers weigh not only whether the finding is interesting but whether it is
theoretically grounded, rigorously designed for its nested setting, and transparent. Knowing
this lets you pre-empt the common rejection reasons.
When to trigger
- Before submitting, to stress-test the manuscript
- Deciding whether to preregister and how to present transparency
- Interpreting a decision letter and setting expectations
How review works
- Masked review. Identities of authors and reviewers are masked; keep author identity out of the
manuscript, exhibits, and repository links (see
jedpsych-submission).
- Editorial triage. The editor (and associate/handling editors) assesses scope fit (educational
relevance + primary psychological research), theory, design rigor, and contribution; weak-fit or
out-of-scope papers (e.g., single-instrument validation, pure evaluation) may be desk-rejected.
- Expert external review assesses the theoretical contribution, the design and analysis (especially
whether nesting/power are handled), the strength of the claim relative to the evidence, measurement
quality, and transparency/JARS reporting.
- Transparency and standards are weighed. The Transparency and Openness subsection, JARS compliance,
and preregistration (encouraged) factor into the evaluation.
- Decisions. Reject, revise and resubmit (often major), or accept; expect substantive revision and
frequent requests for added rigor (multilevel modeling, mechanism tests), disclosure, or analyses.
What gets a paper through
- Make educational relevance and the theoretical mechanism explicit early.
- Show the design is rigorous for its setting — nesting modeled, powered at the cluster level,
validated measures, fidelity reported.
- Report effect sizes with CIs and educational interpretation; test the mechanism, not just the total
effect.
- Disclose fully (JARS) and prepare the Transparency and Openness subsection; preregister where feasible.
Desk-reject and decline patterns
The scope and rigor screens mean many manuscripts never reach full external review. Confirm current
categories on the journal's submission guidelines, but recognize these shapes:
| Pattern an editor sees |
Likely outcome |
Pre-empt it by |
| Reliability/validity of one instrument |
desk reject (scope) |
reframe around a learning question or choose a measurement venue |
| Program evaluation with no psychological theory |
desk reject / decline |
foreground the learning/motivation mechanism and a mechanism test |
| Classroom study analyzed as if students independent |
major revision or reject |
refit a multilevel model; power at the cluster level |
| Lab effect with no educational bridge |
scope concern |
argue the instructional/policy implication or go elsewhere |
| Stars-only stats, no effect sizes/CIs |
rigor flag |
estimation-first reporting with educational interpretation |
| Identity leaks under masked review |
returned to author |
scrub names, sites, grant numbers, first-person self-cites |
Worked micro-example (illustrative triage)
Manuscript: preregistered cluster-randomized reading trial (48 classrooms),
multilevel model, effect size + CI + mediation, TOP subsection.
Editor read: educational relevance (classroom reading), theory (strategy
instruction → monitoring), rigor (cluster-powered, nesting modeled),
transparency (data/code with DOIs).
Likely route: external review, probable major R&R for added robustness/
measurement detail.
Counter-case: same effect, single-level OLS on clustered data, no mechanism,
"data on request" → likely declined or heavy revision.
How reviewers weigh the evidence (calibration anchors)
- A design that matches its nesting (randomized, powered, and analyzed at the cluster level) is the
single strongest methodological signal at JEP; ignoring clustering is a routine reason for rejection.
- A tested mechanism is what marks the paper as educational psychology rather than evaluation;
reviewers reward a mediation/moderation result tied to theory.
- Transparency is part of credibility: a candid restricted-data statement with an access path reads better
than silent opacity; preregistration quality (specific, dated, followed) strengthens the paper.
Anti-patterns
- A finding with no clear educational implication or theoretical mechanism
- Clustered data analyzed as independent (the classic JEP methodological reject)
- Stars-only reporting without effect sizes, CIs, or educational meaning
- Weak or absent transparency / JARS reporting
- Expecting acceptance without a rigor- and disclosure-heavy R&R
Output format
【Educational relevance】clear early? [Y/N]
【Theory + mechanism】grounded and tested? [Y/N]
【Design rigor】nesting modeled, cluster-powered, measures valid? [Y/N]
【Transparency + JARS】subsection + reporting standards strong? [Y/N]
【Masked】no identity leaks? [Y/N]
【Realistic outcome】reject / major R&R / minor R&R / accept
【Next】jedpsych-submission (or jedpsych-rebuttal if decided)
Supplementary resources
Source: brycewang-stanford/Awesome-Journal-Skills → Journal-of-Educational-Psychology-Skills/skills/jedpsych-review-process/SKILL.md
1---2name: jedpsych-review-process3description: Use when you need to understand how the Journal of Educational Psychology evaluates a manuscript — masked peer review, editorial weighting of educational relevance, theory, design rigor (nesting/power), and transparency, desk-reject patterns, and the role of preregistration and JARS. Use when stress-testing a paper before submission or interpreting a decision letter. Sets expectations and shapes the paper to survive review; it does not contact editors.4---567# Review Process (jedpsych-review-process)89The Journal of Educational Psychology combines selectivity for **educational importance** with rigorous10methodological scrutiny. Under **masked review**, both author and reviewer identities are hidden, and11editors and expert reviewers weigh not only whether the finding is interesting but whether it is12**theoretically grounded**, **rigorously designed for its nested setting**, and **transparent**. Knowing13this lets you pre-empt the common rejection reasons.1415## When to trigger1617- Before submitting, to stress-test the manuscript18- Deciding whether to preregister and how to present transparency19- Interpreting a decision letter and setting expectations2021## How review works22231. **Masked review.** Identities of authors and reviewers are masked; keep author identity out of the24 manuscript, exhibits, and repository links (see `jedpsych-submission`).252. **Editorial triage.** The editor (and associate/handling editors) assesses scope fit (educational26 relevance + primary psychological research), theory, design rigor, and contribution; weak-fit or27 out-of-scope papers (e.g., single-instrument validation, pure evaluation) may be desk-rejected.283. **Expert external review** assesses the theoretical contribution, the design and analysis (especially29 whether nesting/power are handled), the strength of the claim relative to the evidence, measurement30 quality, and transparency/JARS reporting.314. **Transparency and standards are weighed.** The Transparency and Openness subsection, JARS compliance,32 and preregistration (encouraged) factor into the evaluation.335. **Decisions.** Reject, revise and resubmit (often major), or accept; expect substantive revision and34 frequent requests for added rigor (multilevel modeling, mechanism tests), disclosure, or analyses.3536## What gets a paper through3738- Make **educational relevance** and the **theoretical mechanism** explicit early.39- Show the design is **rigorous for its setting** — nesting modeled, powered at the cluster level,40 validated measures, fidelity reported.41- Report **effect sizes with CIs and educational interpretation**; test the mechanism, not just the total42 effect.43- Disclose fully (JARS) and prepare the Transparency and Openness subsection; preregister where feasible.4445## Desk-reject and decline patterns4647The scope and rigor screens mean many manuscripts never reach full external review. Confirm current48categories on the journal's submission guidelines, but recognize these shapes:4950| Pattern an editor sees | Likely outcome | Pre-empt it by |51|------------------------|----------------|----------------|52| Reliability/validity of one instrument | desk reject (scope) | reframe around a learning question or choose a measurement venue |53| Program evaluation with no psychological theory | desk reject / decline | foreground the learning/motivation mechanism and a mechanism test |54| Classroom study analyzed as if students independent | major revision or reject | refit a multilevel model; power at the cluster level |55| Lab effect with no educational bridge | scope concern | argue the instructional/policy implication or go elsewhere |56| Stars-only stats, no effect sizes/CIs | rigor flag | estimation-first reporting with educational interpretation |57| Identity leaks under masked review | returned to author | scrub names, sites, grant numbers, first-person self-cites |5859## Worked micro-example (illustrative triage)6061```62Manuscript: preregistered cluster-randomized reading trial (48 classrooms),63 multilevel model, effect size + CI + mediation, TOP subsection.64Editor read: educational relevance (classroom reading), theory (strategy65 instruction → monitoring), rigor (cluster-powered, nesting modeled),66 transparency (data/code with DOIs).67Likely route: external review, probable major R&R for added robustness/68 measurement detail.69Counter-case: same effect, single-level OLS on clustered data, no mechanism,70 "data on request" → likely declined or heavy revision.71```7273## How reviewers weigh the evidence (calibration anchors)7475- A design that **matches its nesting** (randomized, powered, and analyzed at the cluster level) is the76 single strongest methodological signal at JEP; ignoring clustering is a routine reason for rejection.77- A tested **mechanism** is what marks the paper as educational *psychology* rather than evaluation;78 reviewers reward a mediation/moderation result tied to theory.79- Transparency is part of credibility: a candid restricted-data statement with an access path reads better80 than silent opacity; preregistration quality (specific, dated, followed) strengthens the paper.8182## Anti-patterns8384- A finding with no clear educational implication or theoretical mechanism85- Clustered data analyzed as independent (the classic JEP methodological reject)86- Stars-only reporting without effect sizes, CIs, or educational meaning87- Weak or absent transparency / JARS reporting88- Expecting acceptance without a rigor- and disclosure-heavy R&R8990## Output format9192```93【Educational relevance】clear early? [Y/N]94【Theory + mechanism】grounded and tested? [Y/N]95【Design rigor】nesting modeled, cluster-powered, measures valid? [Y/N]96【Transparency + JARS】subsection + reporting standards strong? [Y/N]97【Masked】no identity leaks? [Y/N]98【Realistic outcome】reject / major R&R / minor R&R / accept99【Next】jedpsych-submission (or jedpsych-rebuttal if decided)100```101102## Supplementary resources103104- [`../../resources/official-source-map.md`](../../resources/official-source-map.md) — masked review, scope, JARS, and preregistration policy105106---107108**Source:** [`brycewang-stanford/Awesome-Journal-Skills`](https://github.com/brycewang-stanford/Awesome-Journal-Skills) → `Journal-of-Educational-Psychology-Skills/skills/jedpsych-review-process/SKILL.md`
thedixitjain