Theory Integration (psychbull-theory-integration)
A Psychological Bulletin paper is judged not by the size of its table but by what the synthesis
means for psychology. The journal publishes evaluative and integrative reviews — the value is in
interpreting an existing literature, reconciling its contradictions, and advancing or refining a
theoretical account. (Note: a purely new theory with no synthesis belongs to Psychological Review;
here the theory is grounded in the synthesized evidence.) This skill builds the contribution; the
numbers come from the analysis skills.
When to trigger
- The pooled effect, moderators, and bias analyses exist and you must say what they mean
- A literature has conflicting findings you can now reconcile
- Building or refining a theoretical model from the synthesized evidence
- A reviewer says the review is "a competent meta-analysis but not a contribution"
From results to contribution
- Answer the field's open question. State what the synthesis resolves: the size of an effect, why
studies disagreed, which moderator explains the pattern, whether an effect survives bias correction.
- Reconcile conflict with the moderators. Use the moderator/meta-regression results to explain
why prior studies clashed — different populations, measures, designs, or conditions.
- Build or refine a model. Translate the empirical pattern into a theoretical statement: an
integrative framework, boundary conditions, a mediating/moderating mechanism, or a corrected estimate.
- State scope conditions honestly. Where does the effect hold, and where not? Heterogeneity and
the prediction interval discipline the claim.
- Set the agenda. What should primary researchers do next — the gaps, the under-powered cells, the
untested moderators the synthesis exposes.
Calibrate claims to evidence
- Match the strength of the theoretical claim to heterogeneity, k, and bias robustness.
- Distinguish confirmatory (pre-specified) from exploratory patterns when theorizing.
- Avoid over-reading a fragile or bias-sensitive effect into a strong theory.
Anti-patterns
- A "results dump" with no interpretive or theoretical payoff
- Theorizing past the evidence (strong claims on small k or bias-sensitive effects)
- Ignoring heterogeneity when stating a general law
- Presenting an exploratory moderator as if it were the confirmatory story
- Submitting a pure new theory that should have gone to Psychological Review
The integration bar that defines a Bulletin paper
This is the calibration anchor that separates the APA's flagship review journal from a methods-only
meta-analysis: a competent pooled estimate is necessary but not sufficient. The genuine theoretical
advance is the threshold reviewers police.
| Synthesis delivers… |
Methods-only meta-analysis (reject risk) |
Psychological Bulletin contribution |
| A pooled number |
"The effect is g = 0.34" and stops |
Explains what that resolves for the field |
| Heterogeneity |
Reports I² = 68% as a nuisance |
Uses moderators to say why studies disagreed |
| A model |
None — tallies effects |
Advances or refines a theoretical account |
| Scope |
Implies the effect is universal |
States boundary conditions from the PI |
Worked vignette — turning numbers into theory
Illustrative numbers only. The self-affirmation synthesis yields g = 0.34 [0.24, 0.44], I² = 68%,
with delivery format explaining an R²-analog of 0.22 and bias diagnostics pulling the effect toward
≈ 0.25. The integrative payoff under this skill's rules:
- Open question resolved: self-affirmation has a small-to-moderate but real effect, smaller than the
early enthusiastic literature implied once selective reporting is modeled.
- Conflict reconciled: the disagreement tracks delivery format — facilitated, in-person formats
outperform brief written prompts — not a true-versus-null split.
- Model refined: this sharpens the timing/fit account rather than proposing a brand-new theory
(which would belong to Psychological Review).
- Scope conditions: the wide prediction interval [−0.10, 0.78] disciplines the claim — the effect can
vanish in some settings, so no universal law is asserted.
- Agenda: pre-registered trials varying delivery format, and direct tests of the underutilized cells.
Referee pushback → venue-specific fix
- "Competent meta-analysis, but not a contribution." → Add the interpretive layer: state the field
question and how the moderators resolve the conflict, not just the pooled number.
- "You theorize past your evidence." → Down-calibrate to k, heterogeneity, and bias robustness.
- "This is really a new theory." → If the model is not grounded in the synthesized evidence, it belongs
to Psychological Review.
Output format
【Open question resolved】one sentence
【Conflict reconciled】via which moderator(s)
【Model / framework】what is advanced or refined
【Scope conditions】where it holds / breaks
【Research agenda】top gaps for primary work
【Claim calibration】matched to k / heterogeneity / bias? [Y/N]
【Next】psychbull-tables-figures
Supplementary resources
1---2name: psychbull-theory-integration3description: Use when turning the synthesis results of a Psychological Bulletin manuscript into a genuine theoretical contribution — reconciling conflicting findings, building or refining a model, and stating scope conditions and a research agenda. Makes the synthesis matter; it does not run the analysis.4---56# Theory Integration (psychbull-theory-integration)78A Psychological Bulletin paper is judged not by the size of its table but by **what the synthesis9means for psychology**. The journal publishes **evaluative and integrative** reviews — the value is in10**interpreting** an existing literature, reconciling its contradictions, and advancing or refining a11theoretical account. (Note: a *purely* new theory with no synthesis belongs to *Psychological Review*;12here the theory is grounded in the synthesized evidence.) This skill builds the contribution; the13numbers come from the analysis skills.1415## When to trigger1617- The pooled effect, moderators, and bias analyses exist and you must say what they *mean*18- A literature has conflicting findings you can now reconcile19- Building or refining a theoretical model from the synthesized evidence20- A reviewer says the review is "a competent meta-analysis but not a contribution"2122## From results to contribution23241. **Answer the field's open question.** State what the synthesis resolves: the size of an effect, why25 studies disagreed, which moderator explains the pattern, whether an effect survives bias correction.262. **Reconcile conflict with the moderators.** Use the moderator/meta-regression results to explain27 *why* prior studies clashed — different populations, measures, designs, or conditions.283. **Build or refine a model.** Translate the empirical pattern into a theoretical statement: an29 integrative framework, boundary conditions, a mediating/moderating mechanism, or a corrected estimate.304. **State scope conditions honestly.** Where does the effect hold, and where not? Heterogeneity and31 the prediction interval discipline the claim.325. **Set the agenda.** What should primary researchers do next — the gaps, the under-powered cells, the33 untested moderators the synthesis exposes.3435## Calibrate claims to evidence3637- Match the strength of the theoretical claim to **heterogeneity, k, and bias robustness**.38- Distinguish **confirmatory** (pre-specified) from **exploratory** patterns when theorizing.39- Avoid over-reading a fragile or bias-sensitive effect into a strong theory.4041## Anti-patterns4243- A "results dump" with no interpretive or theoretical payoff44- Theorizing past the evidence (strong claims on small k or bias-sensitive effects)45- Ignoring heterogeneity when stating a general law46- Presenting an exploratory moderator as if it were the confirmatory story47- Submitting a pure new theory that should have gone to *Psychological Review*4849## The integration bar that defines a Bulletin paper5051This is the calibration anchor that separates the APA's flagship review journal from a methods-only52meta-analysis: a competent pooled estimate is necessary but not sufficient. The genuine theoretical53advance is the threshold reviewers police.5455| Synthesis delivers… | Methods-only meta-analysis (reject risk) | Psychological Bulletin contribution |56|---------------------|-------------------------------------------|--------------------------------------|57| A pooled number | "The effect is g = 0.34" and stops | Explains what that resolves for the field |58| Heterogeneity | Reports I² = 68% as a nuisance | Uses moderators to say *why* studies disagreed |59| A model | None — tallies effects | Advances or refines a theoretical account |60| Scope | Implies the effect is universal | States boundary conditions from the PI |6162## Worked vignette — turning numbers into theory6364*Illustrative numbers only.* The self-affirmation synthesis yields g = 0.34 [0.24, 0.44], I² = 68%,65with delivery format explaining an R²-analog of 0.22 and bias diagnostics pulling the effect toward66≈ 0.25. The integrative payoff under this skill's rules:6768- **Open question resolved**: self-affirmation has a small-to-moderate but real effect, smaller than the69 early enthusiastic literature implied once selective reporting is modeled.70- **Conflict reconciled**: the disagreement tracks *delivery format* — facilitated, in-person formats71 outperform brief written prompts — not a true-versus-null split.72- **Model refined**: this sharpens the timing/fit account rather than proposing a brand-new theory73 (which would belong to *Psychological Review*).74- **Scope conditions**: the wide prediction interval [−0.10, 0.78] disciplines the claim — the effect can75 vanish in some settings, so no universal law is asserted.76- **Agenda**: pre-registered trials varying delivery format, and direct tests of the underutilized cells.7778## Referee pushback → venue-specific fix7980- *"Competent meta-analysis, but not a contribution."* → Add the interpretive layer: state the field81 question and how the moderators resolve the conflict, not just the pooled number.82- *"You theorize past your evidence."* → Down-calibrate to k, heterogeneity, and bias robustness.83- *"This is really a new theory."* → If the model is not grounded in the synthesized evidence, it belongs84 to *Psychological Review*.8586## Output format8788```89【Open question resolved】one sentence90【Conflict reconciled】via which moderator(s)91【Model / framework】what is advanced or refined92【Scope conditions】where it holds / breaks93【Research agenda】top gaps for primary work94【Claim calibration】matched to k / heterogeneity / bias? [Y/N]95【Next】psychbull-tables-figures96```9798## Supplementary resources99100- [`../../resources/external_tools.md`](../../resources/external_tools.md) — synthesis/reporting standards that frame the contribution101- [`../../resources/official-source-map.md`](../../resources/official-source-map.md) — Psychological Bulletin's evaluative/integrative scope (vs. Psychological Review for theory)