Review Process (jedpsych-review-process)
The Journal of Educational Psychology combines selectivity for educational importance with rigorous
methodological scrutiny. Under masked review, both author and reviewer identities are hidden, and
editors and expert reviewers weigh not only whether the finding is interesting but whether it is
theoretically grounded, rigorously designed for its nested setting, and transparent. Knowing
this lets you pre-empt the common rejection reasons.
When to trigger
- Before submitting, to stress-test the manuscript
- Deciding whether to preregister and how to present transparency
- Interpreting a decision letter and setting expectations
How review works
- Masked review. Identities of authors and reviewers are masked; keep author identity out of the
manuscript, exhibits, and repository links (see
jedpsych-submission).
- Editorial triage. The editor (and associate/handling editors) assesses scope fit (educational
relevance + primary psychological research), theory, design rigor, and contribution; weak-fit or
out-of-scope papers (e.g., single-instrument validation, pure evaluation) may be desk-rejected.
- Expert external review assesses the theoretical contribution, the design and analysis (especially
whether nesting/power are handled), the strength of the claim relative to the evidence, measurement
quality, and transparency/JARS reporting.
- Transparency and standards are weighed. The Transparency and Openness subsection, JARS compliance,
and preregistration (encouraged) factor into the evaluation.
- Decisions. Reject, revise and resubmit (often major), or accept; expect substantive revision and
frequent requests for added rigor (multilevel modeling, mechanism tests), disclosure, or analyses.
What gets a paper through
- Make educational relevance and the theoretical mechanism explicit early.
- Show the design is rigorous for its setting — nesting modeled, powered at the cluster level,
validated measures, fidelity reported.
- Report effect sizes with CIs and educational interpretation; test the mechanism, not just the total
effect.
- Disclose fully (JARS) and prepare the Transparency and Openness subsection; preregister where feasible.
Desk-reject and decline patterns
The scope and rigor screens mean many manuscripts never reach full external review. Confirm current
categories on the journal's submission guidelines, but recognize these shapes:
| Pattern an editor sees |
Likely outcome |
Pre-empt it by |
| Reliability/validity of one instrument |
desk reject (scope) |
reframe around a learning question or choose a measurement venue |
| Program evaluation with no psychological theory |
desk reject / decline |
foreground the learning/motivation mechanism and a mechanism test |
| Classroom study analyzed as if students independent |
major revision or reject |
refit a multilevel model; power at the cluster level |
| Lab effect with no educational bridge |
scope concern |
argue the instructional/policy implication or go elsewhere |
| Stars-only stats, no effect sizes/CIs |
rigor flag |
estimation-first reporting with educational interpretation |
| Identity leaks under masked review |
returned to author |
scrub names, sites, grant numbers, first-person self-cites |
Worked micro-example (illustrative triage)
Manuscript: preregistered cluster-randomized reading trial (48 classrooms),
multilevel model, effect size + CI + mediation, TOP subsection.
Editor read: educational relevance (classroom reading), theory (strategy
instruction → monitoring), rigor (cluster-powered, nesting modeled),
transparency (data/code with DOIs).
Likely route: external review, probable major R&R for added robustness/
measurement detail.
Counter-case: same effect, single-level OLS on clustered data, no mechanism,
"data on request" → likely declined or heavy revision.
How reviewers weigh the evidence (calibration anchors)
- A design that matches its nesting (randomized, powered, and analyzed at the cluster level) is the
single strongest methodological signal at JEP; ignoring clustering is a routine reason for rejection.
- A tested mechanism is what marks the paper as educational psychology rather than evaluation;
reviewers reward a mediation/moderation result tied to theory.
- Transparency is part of credibility: a candid restricted-data statement with an access path reads better
than silent opacity; preregistration quality (specific, dated, followed) strengthens the paper.
Anti-patterns
- A finding with no clear educational implication or theoretical mechanism
- Clustered data analyzed as independent (the classic JEP methodological reject)
- Stars-only reporting without effect sizes, CIs, or educational meaning
- Weak or absent transparency / JARS reporting
- Expecting acceptance without a rigor- and disclosure-heavy R&R
Output format
【Educational relevance】clear early? [Y/N]
【Theory + mechanism】grounded and tested? [Y/N]
【Design rigor】nesting modeled, cluster-powered, measures valid? [Y/N]
【Transparency + JARS】subsection + reporting standards strong? [Y/N]
【Masked】no identity leaks? [Y/N]
【Realistic outcome】reject / major R&R / minor R&R / accept
【Next】jedpsych-submission (or jedpsych-rebuttal if decided)
Supplementary resources
1---2name: jedpsych-review-process3description: Use when you need to understand how the Journal of Educational Psychology evaluates a manuscript — masked peer review, editorial weighting of educational relevance, theory, design rigor (nesting/power), and transparency, desk-reject patterns, and the role of preregistration and JARS. Use when stress-testing a paper before submission or interpreting a decision letter. Sets expectations and shapes the paper to survive review; it does not contact editors.4---56# Review Process (jedpsych-review-process)78The Journal of Educational Psychology combines selectivity for **educational importance** with rigorous9methodological scrutiny. Under **masked review**, both author and reviewer identities are hidden, and10editors and expert reviewers weigh not only whether the finding is interesting but whether it is11**theoretically grounded**, **rigorously designed for its nested setting**, and **transparent**. Knowing12this lets you pre-empt the common rejection reasons.1314## When to trigger1516- Before submitting, to stress-test the manuscript17- Deciding whether to preregister and how to present transparency18- Interpreting a decision letter and setting expectations1920## How review works21221. **Masked review.** Identities of authors and reviewers are masked; keep author identity out of the23 manuscript, exhibits, and repository links (see `jedpsych-submission`).242. **Editorial triage.** The editor (and associate/handling editors) assesses scope fit (educational25 relevance + primary psychological research), theory, design rigor, and contribution; weak-fit or26 out-of-scope papers (e.g., single-instrument validation, pure evaluation) may be desk-rejected.273. **Expert external review** assesses the theoretical contribution, the design and analysis (especially28 whether nesting/power are handled), the strength of the claim relative to the evidence, measurement29 quality, and transparency/JARS reporting.304. **Transparency and standards are weighed.** The Transparency and Openness subsection, JARS compliance,31 and preregistration (encouraged) factor into the evaluation.325. **Decisions.** Reject, revise and resubmit (often major), or accept; expect substantive revision and33 frequent requests for added rigor (multilevel modeling, mechanism tests), disclosure, or analyses.3435## What gets a paper through3637- Make **educational relevance** and the **theoretical mechanism** explicit early.38- Show the design is **rigorous for its setting** — nesting modeled, powered at the cluster level,39 validated measures, fidelity reported.40- Report **effect sizes with CIs and educational interpretation**; test the mechanism, not just the total41 effect.42- Disclose fully (JARS) and prepare the Transparency and Openness subsection; preregister where feasible.4344## Desk-reject and decline patterns4546The scope and rigor screens mean many manuscripts never reach full external review. Confirm current47categories on the journal's submission guidelines, but recognize these shapes:4849| Pattern an editor sees | Likely outcome | Pre-empt it by |50|------------------------|----------------|----------------|51| Reliability/validity of one instrument | desk reject (scope) | reframe around a learning question or choose a measurement venue |52| Program evaluation with no psychological theory | desk reject / decline | foreground the learning/motivation mechanism and a mechanism test |53| Classroom study analyzed as if students independent | major revision or reject | refit a multilevel model; power at the cluster level |54| Lab effect with no educational bridge | scope concern | argue the instructional/policy implication or go elsewhere |55| Stars-only stats, no effect sizes/CIs | rigor flag | estimation-first reporting with educational interpretation |56| Identity leaks under masked review | returned to author | scrub names, sites, grant numbers, first-person self-cites |5758## Worked micro-example (illustrative triage)5960```61Manuscript: preregistered cluster-randomized reading trial (48 classrooms),62 multilevel model, effect size + CI + mediation, TOP subsection.63Editor read: educational relevance (classroom reading), theory (strategy64 instruction → monitoring), rigor (cluster-powered, nesting modeled),65 transparency (data/code with DOIs).66Likely route: external review, probable major R&R for added robustness/67 measurement detail.68Counter-case: same effect, single-level OLS on clustered data, no mechanism,69 "data on request" → likely declined or heavy revision.70```7172## How reviewers weigh the evidence (calibration anchors)7374- A design that **matches its nesting** (randomized, powered, and analyzed at the cluster level) is the75 single strongest methodological signal at JEP; ignoring clustering is a routine reason for rejection.76- A tested **mechanism** is what marks the paper as educational *psychology* rather than evaluation;77 reviewers reward a mediation/moderation result tied to theory.78- Transparency is part of credibility: a candid restricted-data statement with an access path reads better79 than silent opacity; preregistration quality (specific, dated, followed) strengthens the paper.8081## Anti-patterns8283- A finding with no clear educational implication or theoretical mechanism84- Clustered data analyzed as independent (the classic JEP methodological reject)85- Stars-only reporting without effect sizes, CIs, or educational meaning86- Weak or absent transparency / JARS reporting87- Expecting acceptance without a rigor- and disclosure-heavy R&R8889## Output format9091```92【Educational relevance】clear early? [Y/N]93【Theory + mechanism】grounded and tested? [Y/N]94【Design rigor】nesting modeled, cluster-powered, measures valid? [Y/N]95【Transparency + JARS】subsection + reporting standards strong? [Y/N]96【Masked】no identity leaks? [Y/N]97【Realistic outcome】reject / major R&R / minor R&R / accept98【Next】jedpsych-submission (or jedpsych-rebuttal if decided)99```100101## Supplementary resources102103- [`../../resources/official-source-map.md`](../../resources/official-source-map.md) — masked review, scope, JARS, and preregistration policy
brycewang-stanford