Theory of Change & Mechanism (jpam-theory-building)
JPAM is empirical, but the best policy papers are not atheoretical. The "theory" here is a theory of
change: a transparent logic that says why the policy lever should move the outcome, through what
mechanism, for whom, and under what conditions it would (or would not) transfer to another
jurisdiction or scale. This frame is what turns a single estimate into evidence a policymaker elsewhere
can use, and it disciplines the cost-benefit and heterogeneity analysis downstream.
When to trigger
- Specifying the logic model / theory of change before or alongside the design
- A reviewer asked "what's the mechanism?" or "why would this generalize?"
- Deciding which heterogeneity and mediation analyses are theory-driven (not fishing)
- Framing scope conditions for external validity and scale-up
Building the theory of change
- Lever → mechanism → outcome. Write the causal chain explicitly: the policy changes X (incentive,
constraint, information, price, access), which operates through mechanism M, producing outcome Y.
- Behavioral or institutional micro-foundation. Say who responds and why — incentives,
liquidity, salience, capacity, compliance, take-up. Ground it in the relevant econ / PS / PA theory.
- Predicted heterogeneity. Whom should the effect be larger or smaller for? Specify before
estimation so subgroup results read as tests, not data-mining.
- Scope conditions for transfer. What features of this setting (administrative capacity, market
structure, population, complementary policies) does the effect depend on? This governs external
validity and scale-up claims.
- Unintended effects and general equilibrium. Name plausible offsetting or spillover responses a
policymaker would worry about (displacement, crowd-out, behavioral adaptation).
What the theory buys (JPAM-specific)
- It tells policymakers in other jurisdictions whether the result should travel.
- It pre-commits the heterogeneity and mediation analyses, protecting them from fishing critiques.
- It specifies which costs and benefits enter the cost-benefit analysis and for whom (distribution).
- It distinguishes "the program worked here" from "this kind of program works through this mechanism."
Checklist
Anti-patterns
- A bare estimate with no mechanism — "the program raised Y" with no account of why
- Post hoc storytelling that fits whatever heterogeneity the data happened to show
- Claiming broad generalizability with no stated scope conditions
- Ignoring unintended consequences a policymaker would immediately ask about
- Borrowing a formal model that adds notation but no testable, policy-relevant implication
Worked micro-example (illustrative)
A team evaluates a tax-credit expansion. The bare version says "the credit raised employment." The
JPAM theory-of-change version writes the chain — credit raises the after-tax return to work
(mechanism: labor-supply incentive) → larger response for the population facing the steepest
participation tax (predicted heterogeneity: single parents near the phase-in) → effect depends on local
labor demand and on take-up via tax-filing (scope conditions) — and flags a plausible unintended
effect (employers capturing part of the credit through wage adjustment). Each link is then a testable
implication the design and heterogeneity analysis must address, and the scope conditions tell a
policymaker in another state whether the result should travel. (Fields/numbers illustrative.)
Calibration anchors (hedged)
- The "theory" JPAM wants is a transparent logic model, not necessarily a formal model; added
notation must buy a testable, policy-relevant implication.
- Scope conditions are a strength, not a hedge: they are how a single evaluation informs decisions
elsewhere, which is JPAM's whole purpose.
- Pre-specify heterogeneity and mechanism tests so they read as confirmatory, not as fishing.
Output format
【Lever → mechanism → outcome】the causal chain in one line
【Micro-foundation】who responds and why
【Predicted heterogeneity】subgroups specified ex ante
【Scope conditions】what the effect depends on for transfer
【Unintended effects】spillovers / GE / displacement flagged
【Next】jpam-research-design
Supplementary resources
1---2name: jpam-theory-building3description: Use when building the conceptual frame of a Journal of Policy Analysis and Management (JPAM) manuscript — the theory of change / logic model linking the policy lever to outcomes, the mechanism, and the scope conditions that govern transfer to other settings. Sharpens the argument; it does not run estimation or design identification.4---56# Theory of Change & Mechanism (jpam-theory-building)78JPAM is empirical, but the best policy papers are not atheoretical. The "theory" here is a **theory of9change**: a transparent logic that says *why* the policy lever should move the outcome, *through what10mechanism*, *for whom*, and *under what conditions it would (or would not) transfer* to another11jurisdiction or scale. This frame is what turns a single estimate into evidence a policymaker elsewhere12can use, and it disciplines the cost-benefit and heterogeneity analysis downstream.1314## When to trigger1516- Specifying the logic model / theory of change before or alongside the design17- A reviewer asked "what's the mechanism?" or "why would this generalize?"18- Deciding which heterogeneity and mediation analyses are theory-driven (not fishing)19- Framing scope conditions for external validity and scale-up2021## Building the theory of change22231. **Lever → mechanism → outcome.** Write the causal chain explicitly: the policy changes X (incentive,24 constraint, information, price, access), which operates through mechanism M, producing outcome Y.252. **Behavioral or institutional micro-foundation.** Say *who* responds and *why* — incentives,26 liquidity, salience, capacity, compliance, take-up. Ground it in the relevant econ / PS / PA theory.273. **Predicted heterogeneity.** Whom should the effect be larger or smaller for? Specify *before*28 estimation so subgroup results read as tests, not data-mining.294. **Scope conditions for transfer.** What features of this setting (administrative capacity, market30 structure, population, complementary policies) does the effect depend on? This governs external31 validity and scale-up claims.325. **Unintended effects and general equilibrium.** Name plausible offsetting or spillover responses a33 policymaker would worry about (displacement, crowd-out, behavioral adaptation).3435## What the theory buys (JPAM-specific)3637- It tells policymakers in *other* jurisdictions whether the result should travel.38- It pre-commits the heterogeneity and mediation analyses, protecting them from fishing critiques.39- It specifies which costs and benefits enter the cost-benefit analysis and for whom (distribution).40- It distinguishes "the program worked here" from "this *kind* of program works through this mechanism."4142## Checklist4344- [ ] An explicit lever → mechanism → outcome chain written down45- [ ] A behavioral/institutional micro-foundation for who responds and why46- [ ] Predicted heterogeneity stated before estimation47- [ ] Scope conditions for transfer / scale-up named48- [ ] Plausible unintended effects, spillovers, or GE responses flagged49- [ ] Mechanism tied to specific, testable observable implications5051## Anti-patterns5253- A bare estimate with no mechanism — "the program raised Y" with no account of why54- Post hoc storytelling that fits whatever heterogeneity the data happened to show55- Claiming broad generalizability with no stated scope conditions56- Ignoring unintended consequences a policymaker would immediately ask about57- Borrowing a formal model that adds notation but no testable, policy-relevant implication5859## Worked micro-example (illustrative)6061A team evaluates a tax-credit expansion. The bare version says "the credit raised employment." The62JPAM theory-of-change version writes the chain — *credit raises the after-tax return to work63(mechanism: labor-supply incentive) → larger response for the population facing the steepest64participation tax (predicted heterogeneity: single parents near the phase-in) → effect depends on local65labor demand and on take-up via tax-filing (scope conditions)* — and flags a plausible **unintended66effect** (employers capturing part of the credit through wage adjustment). Each link is then a testable67implication the design and heterogeneity analysis must address, and the scope conditions tell a68policymaker in another state whether the result should travel. (Fields/numbers illustrative.)6970## Calibration anchors (hedged)7172- The "theory" JPAM wants is a **transparent logic model**, not necessarily a formal model; added73 notation must buy a testable, policy-relevant implication.74- Scope conditions are a *strength*, not a hedge: they are how a single evaluation informs decisions75 elsewhere, which is JPAM's whole purpose.76- Pre-specify heterogeneity and mechanism tests so they read as confirmatory, not as fishing.7778## Output format7980```81【Lever → mechanism → outcome】the causal chain in one line82【Micro-foundation】who responds and why83【Predicted heterogeneity】subgroups specified ex ante84【Scope conditions】what the effect depends on for transfer85【Unintended effects】spillovers / GE / displacement flagged86【Next】jpam-research-design87```8889## Supplementary resources9091- [`../../resources/exemplars/library.md`](../../resources/exemplars/library.md) — JPAM papers whose mechanism makes the result portable92- [`../../resources/external_tools.md`](../../resources/external_tools.md) — mediation / mechanism estimation packages