Theory Integration (psychbull-theory-integration)
A Psychological Bulletin paper is judged not by the size of its table but by what the synthesis
means for psychology. The journal publishes evaluative and integrative reviews — the value is in
interpreting an existing literature, reconciling its contradictions, and advancing or refining a
theoretical account. (Note: a purely new theory with no synthesis belongs to Psychological Review;
here the theory is grounded in the synthesized evidence.) This skill builds the contribution; the
numbers come from the analysis skills.
When to trigger
- The pooled effect, moderators, and bias analyses exist and you must say what they mean
- A literature has conflicting findings you can now reconcile
- Building or refining a theoretical model from the synthesized evidence
- A reviewer says the review is "a competent meta-analysis but not a contribution"
From results to contribution
- Answer the field's open question. State what the synthesis resolves: the size of an effect, why
studies disagreed, which moderator explains the pattern, whether an effect survives bias correction.
- Reconcile conflict with the moderators. Use the moderator/meta-regression results to explain
why prior studies clashed — different populations, measures, designs, or conditions.
- Build or refine a model. Translate the empirical pattern into a theoretical statement: an
integrative framework, boundary conditions, a mediating/moderating mechanism, or a corrected estimate.
- State scope conditions honestly. Where does the effect hold, and where not? Heterogeneity and
the prediction interval discipline the claim.
- Set the agenda. What should primary researchers do next — the gaps, the under-powered cells, the
untested moderators the synthesis exposes.
Calibrate claims to evidence
- Match the strength of the theoretical claim to heterogeneity, k, and bias robustness.
- Distinguish confirmatory (pre-specified) from exploratory patterns when theorizing.
- Avoid over-reading a fragile or bias-sensitive effect into a strong theory.
Anti-patterns
- A "results dump" with no interpretive or theoretical payoff
- Theorizing past the evidence (strong claims on small k or bias-sensitive effects)
- Ignoring heterogeneity when stating a general law
- Presenting an exploratory moderator as if it were the confirmatory story
- Submitting a pure new theory that should have gone to Psychological Review
The integration bar that defines a Bulletin paper
This is the calibration anchor that separates the APA's flagship review journal from a methods-only
meta-analysis: a competent pooled estimate is necessary but not sufficient. The genuine theoretical
advance is the threshold reviewers police.
| Synthesis delivers… |
Methods-only meta-analysis (reject risk) |
Psychological Bulletin contribution |
| A pooled number |
"The effect is g = 0.34" and stops |
Explains what that resolves for the field |
| Heterogeneity |
Reports I² = 68% as a nuisance |
Uses moderators to say why studies disagreed |
| A model |
None — tallies effects |
Advances or refines a theoretical account |
| Scope |
Implies the effect is universal |
States boundary conditions from the PI |
Worked vignette — turning numbers into theory
Illustrative numbers only. The self-affirmation synthesis yields g = 0.34 [0.24, 0.44], I² = 68%,
with delivery format explaining an R²-analog of 0.22 and bias diagnostics pulling the effect toward
≈ 0.25. The integrative payoff under this skill's rules:
- Open question resolved: self-affirmation has a small-to-moderate but real effect, smaller than the
early enthusiastic literature implied once selective reporting is modeled.
- Conflict reconciled: the disagreement tracks delivery format — facilitated, in-person formats
outperform brief written prompts — not a true-versus-null split.
- Model refined: this sharpens the timing/fit account rather than proposing a brand-new theory
(which would belong to Psychological Review).
- Scope conditions: the wide prediction interval [−0.10, 0.78] disciplines the claim — the effect can
vanish in some settings, so no universal law is asserted.
- Agenda: pre-registered trials varying delivery format, and direct tests of the underutilized cells.
Referee pushback → venue-specific fix
- "Competent meta-analysis, but not a contribution." → Add the interpretive layer: state the field
question and how the moderators resolve the conflict, not just the pooled number.
- "You theorize past your evidence." → Down-calibrate to k, heterogeneity, and bias robustness.
- "This is really a new theory." → If the model is not grounded in the synthesized evidence, it belongs
to Psychological Review.
Output format
【Open question resolved】one sentence
【Conflict reconciled】via which moderator(s)
【Model / framework】what is advanced or refined
【Scope conditions】where it holds / breaks
【Research agenda】top gaps for primary work
【Claim calibration】matched to k / heterogeneity / bias? [Y/N]
【Next】psychbull-tables-figures
Supplementary resources
Source: brycewang-stanford/Awesome-Journal-Skills → Psychological-Bulletin-Skills/skills/psychbull-theory-integration/SKILL.md
1---2name: psychbull-theory-integration3description: Use when turning the synthesis results of a Psychological Bulletin manuscript into a genuine theoretical contribution — reconciling conflicting findings, building or refining a model, and stating scope conditions and a research agenda. Makes the synthesis matter; it does not run the analysis.4---5
6
7# Theory Integration (psychbull-theory-integration)
8
9A Psychological Bulletin paper is judged not by the size of its table but by **what the synthesis
10means for psychology**. The journal publishes **evaluative and integrative** reviews — the value is in
11**interpreting** an existing literature, reconciling its contradictions, and advancing or refining a
12theoretical account. (Note: a *purely* new theory with no synthesis belongs to *Psychological Review*;
13here the theory is grounded in the synthesized evidence.) This skill builds the contribution; the
14numbers come from the analysis skills.
15
16## When to trigger
17
18- The pooled effect, moderators, and bias analyses exist and you must say what they *mean*
19- A literature has conflicting findings you can now reconcile
20- Building or refining a theoretical model from the synthesized evidence
21- A reviewer says the review is "a competent meta-analysis but not a contribution"
22
23## From results to contribution
24
251. **Answer the field's open question.** State what the synthesis resolves: the size of an effect, why
26 studies disagreed, which moderator explains the pattern, whether an effect survives bias correction.
272. **Reconcile conflict with the moderators.** Use the moderator/meta-regression results to explain
28 *why* prior studies clashed — different populations, measures, designs, or conditions.
293. **Build or refine a model.** Translate the empirical pattern into a theoretical statement: an
30 integrative framework, boundary conditions, a mediating/moderating mechanism, or a corrected estimate.
314. **State scope conditions honestly.** Where does the effect hold, and where not? Heterogeneity and
32 the prediction interval discipline the claim.
335. **Set the agenda.** What should primary researchers do next — the gaps, the under-powered cells, the
34 untested moderators the synthesis exposes.
35
36## Calibrate claims to evidence
37
38- Match the strength of the theoretical claim to **heterogeneity, k, and bias robustness**.
39- Distinguish **confirmatory** (pre-specified) from **exploratory** patterns when theorizing.
40- Avoid over-reading a fragile or bias-sensitive effect into a strong theory.
41
42## Anti-patterns
43
44- A "results dump" with no interpretive or theoretical payoff
45- Theorizing past the evidence (strong claims on small k or bias-sensitive effects)
46- Ignoring heterogeneity when stating a general law
47- Presenting an exploratory moderator as if it were the confirmatory story
48- Submitting a pure new theory that should have gone to *Psychological Review*
49
50## The integration bar that defines a Bulletin paper
51
52This is the calibration anchor that separates the APA's flagship review journal from a methods-only
53meta-analysis: a competent pooled estimate is necessary but not sufficient. The genuine theoretical
54advance is the threshold reviewers police.
55
56| Synthesis delivers… | Methods-only meta-analysis (reject risk) | Psychological Bulletin contribution |
57|---------------------|-------------------------------------------|--------------------------------------|
58| A pooled number | "The effect is g = 0.34" and stops | Explains what that resolves for the field |
59| Heterogeneity | Reports I² = 68% as a nuisance | Uses moderators to say *why* studies disagreed |
60| A model | None — tallies effects | Advances or refines a theoretical account |
61| Scope | Implies the effect is universal | States boundary conditions from the PI |
62
63## Worked vignette — turning numbers into theory
64
65*Illustrative numbers only.* The self-affirmation synthesis yields g = 0.34 [0.24, 0.44], I² = 68%,
66with delivery format explaining an R²-analog of 0.22 and bias diagnostics pulling the effect toward
67≈ 0.25. The integrative payoff under this skill's rules:
68
69- **Open question resolved**: self-affirmation has a small-to-moderate but real effect, smaller than the
70 early enthusiastic literature implied once selective reporting is modeled.
71- **Conflict reconciled**: the disagreement tracks *delivery format* — facilitated, in-person formats
72 outperform brief written prompts — not a true-versus-null split.
73- **Model refined**: this sharpens the timing/fit account rather than proposing a brand-new theory
74 (which would belong to *Psychological Review*).
75- **Scope conditions**: the wide prediction interval [−0.10, 0.78] disciplines the claim — the effect can
76 vanish in some settings, so no universal law is asserted.
77- **Agenda**: pre-registered trials varying delivery format, and direct tests of the underutilized cells.
78
79## Referee pushback → venue-specific fix
80
81- *"Competent meta-analysis, but not a contribution."* → Add the interpretive layer: state the field
82 question and how the moderators resolve the conflict, not just the pooled number.
83- *"You theorize past your evidence."* → Down-calibrate to k, heterogeneity, and bias robustness.
84- *"This is really a new theory."* → If the model is not grounded in the synthesized evidence, it belongs
85 to *Psychological Review*.
86
87## Output format
88
89```
90【Open question resolved】one sentence
91【Conflict reconciled】via which moderator(s)
92【Model / framework】what is advanced or refined
93【Scope conditions】where it holds / breaks
94【Research agenda】top gaps for primary work
95【Claim calibration】matched to k / heterogeneity / bias? [Y/N]
96【Next】psychbull-tables-figures
97```
98
99## Supplementary resources
100
101- [`../../resources/external_tools.md`](../../resources/external_tools.md) — synthesis/reporting standards that frame the contribution
102- [`../../resources/official-source-map.md`](../../resources/official-source-map.md) — Psychological Bulletin's evaluative/integrative scope (vs. Psychological Review for theory)
103
104---
105
106**Source:** [`brycewang-stanford/Awesome-Journal-Skills`](https://github.com/brycewang-stanford/Awesome-Journal-Skills) → `Psychological-Bulletin-Skills/skills/psychbull-theory-integration/SKILL.md`
thedixitjain