Research Design (popdevr-research-design)
PDR accepts a wide range of approaches — empirical demography, formal demography, and conceptual
synthesis — but is demanding about each, and it asks one extra question: does the design illuminate the
population-and-development linkage, not just a demographic quantity? The design must credibly connect
the argument (popdevr-theory-building) to evidence a broad readership will trust. This skill is
method-aware: pick the section that matches your question and defend it against the strongest rival.
When to trigger
- Choosing the method that actually answers a population-and-development question
- A reviewer questioned the rate construction, the identification, or the development linkage
- Specifying a decomposition, event-history, age-period-cohort, or projection design
- Justifying why your design adjudicates the rival account from
popdevr-literature-positioning
Match the method to the question
- Life tables — for survival, life expectancy, and exposure: period vs. cohort, abridged vs.
complete; multiple-decrement (cause-specific) where the development story is cause-specific.
- Decomposition — to attribute a difference or change in a rate to components: Kitagawa
(rate vs. composition), Arriaga (age contributions to e0), Das Gupta (multi-factor). Say exactly what
each component means and which maps to a development channel.
- Event-history / survival — for timing and transitions (first birth, migration, mortality), with
competing risks where several destinations matter; check the proportional-hazards assumption.
- Age-period-cohort — confront the identification problem head-on: state the constraint or
modeling assumption (and its justification); do not present a single "identified" APC partition as
assumption-free.
- Projections / cohort-component — make transition rates, the base population, and assumptions
(closed/open, period/cohort, policy scenarios) explicit; report sensitivity to key assumptions; PDR
values scenario projections tied to development or policy futures.
When the question is causal (population ↔ development)
- Identification first. State the estimand and the assumptions licensing a causal reading
(ignorability, parallel trends, exclusion, continuity); defend them, do not assert them.
- Selection and exposure are demographic hazards: mortality selection, migration selection, and
differential exposure can masquerade as effects — address them explicitly.
- Two-way causation. Population and development often co-move; name the direction you claim and the
observable that separates it from the reverse (reverse causation, institutional confounding).
- Inference. Cluster at the right level (household, region, country); use survey/design weights;
report uncertainty for derived quantities.
- Sensitivity. How strong must an unobserved confounder (or a violated assumption) be to overturn it?
The adjudication test (PDR-specific)
For the single strongest rival explanation (e.g., reverse causation, compositional change, selection,
institutional confounding), write one sentence: "If the rival were true rather than my account, the
pattern would look like ___; instead it looks like ___." If you cannot, the design does not yet identify
the population-and-development contribution.
Cross-country comparability (a recurring PDR design problem)
PDR papers often compare countries or development contexts, and a cross-national contrast is only as good
as its comparability. Before reading a between-country gap as a development effect, settle three things:
- Definitions and coverage. Are the demographic concepts (a "birth," a "migrant," an age cutoff) and
the denominators measured the same way across settings? Vital-registration coverage and census quality
vary with development level — and that variation can create the gradient you are studying.
- Data class and vintage. Mixing a high-quality register with a single DHS round, or different WPP
vintages, can manufacture artefactual differences. Hold the data class and vintage as constant as the
question allows, and report what you could not harmonize.
- Like-with-like comparison. Where full comparability is impossible, restrict to the subset that is
comparable, or model the measurement difference explicitly rather than absorbing it into the estimate.
State which of these you have controlled and which remain a caveat in popdevr-tables-figures notes.
When the contribution is a synthetic essay (no new estimate)
If the paper's contribution is a framework rather than an analysis, the "design" is the argument
architecture: the propositions, the evidence marshaled for each, and the boundary where the framework
stops applying. Route the rigor through popdevr-theory-building and popdevr-writing-style instead of
this skill's estimation machinery, but still pass the adjudication test against the prior framework it
revises.
Execution bridge (StatsPAI / Stata MCP)
Estimate and audit the design, don't only describe it. Full map:
execution-with-mcp. PDR is population studies blending quantitative and policy work; apply the chain to its empirical-causal papers.
detect_design → recommend → fit with as_handle=true → audit_result.
- Observational causal claims: staggered DiD (
callaway_santanna / sun_abraham +
bacon_decomposition + honest_did_from_result); IV (effective_f_test +
anderson_rubin_ci); RDD (rdrobust + mccrary_test).
- Experiments: randomization-based inference,
romano_wolf for many-outcome
family-wise control, and mediate for mediation (not naive controlling-away).
- Sensitivity:
oster_delta / sensemakr for observational claims.
Report the effect size in interpretable units; route the full battery to the
appendix/supplement. A run end-to-end (synthetic data, real returns) is in the
JF execution walkthrough.
Anti-patterns
- Running a regression when the question calls for a life table, a decomposition, or an event-history model
- Presenting an APC decomposition without naming the identifying constraint
- Period rates read as cohort experience (or vice versa) without justification
- Ignoring mortality/migration selection or the population↔development direction of causation
- Projections whose assumptions are buried instead of varied and reported
Output format
【Method】life table / decomposition / event history / APC / projection / causal
【Quantity / estimand】what is measured or identified + its development linkage
【Key assumption(s)】and how each is defended (name the APC constraint if used)
【Rival ruled out】the adjudication sentence (incl. reverse causation if relevant)
【Robustness/sensitivity】planned checks
【Next】popdevr-data-analysis
Supplementary resources
1---2name: popdevr-research-design3description: Use when defending the research design of a Population and Development Review (PDR, Wiley / Population Council) manuscript — choosing among demographic methods (life tables, decomposition, event-history, age-period-cohort, projections) and, where the question is causal, defending identification, with the population-and-development linkage made explicit. PDR judges each method on its own terms and asks what it shows about development. Strengthens the design; it does not write code.4---56# Research Design (popdevr-research-design)78PDR accepts a wide range of approaches — empirical demography, formal demography, and conceptual9synthesis — but is demanding about each, and it asks one extra question: **does the design illuminate the10population-and-development linkage**, not just a demographic quantity? The design must credibly connect11the argument (`popdevr-theory-building`) to evidence a broad readership will trust. This skill is12method-aware: pick the section that matches your question and defend it against the strongest rival.1314## When to trigger1516- Choosing the method that actually answers a population-and-development question17- A reviewer questioned the rate construction, the identification, or the development linkage18- Specifying a decomposition, event-history, age-period-cohort, or projection design19- Justifying why your design adjudicates the rival account from `popdevr-literature-positioning`2021## Match the method to the question2223- **Life tables** — for survival, life expectancy, and exposure: period vs. cohort, abridged vs.24 complete; multiple-decrement (cause-specific) where the development story is cause-specific.25- **Decomposition** — to attribute a difference or change in a rate to components: Kitagawa26 (rate vs. composition), Arriaga (age contributions to e0), Das Gupta (multi-factor). Say exactly **what27 each component means** and which maps to a development channel.28- **Event-history / survival** — for timing and transitions (first birth, migration, mortality), with29 **competing risks** where several destinations matter; check the proportional-hazards assumption.30- **Age-period-cohort** — confront the **identification problem head-on**: state the constraint or31 modeling assumption (and its justification); do not present a single "identified" APC partition as32 assumption-free.33- **Projections / cohort-component** — make transition rates, the base population, and assumptions34 (closed/open, period/cohort, policy scenarios) explicit; report sensitivity to key assumptions; PDR35 values scenario projections tied to development or policy futures.3637## When the question is causal (population ↔ development)3839- **Identification first.** State the estimand and the assumptions licensing a causal reading40 (ignorability, parallel trends, exclusion, continuity); defend them, do not assert them.41- **Selection and exposure** are demographic hazards: mortality selection, migration selection, and42 differential exposure can masquerade as effects — address them explicitly.43- **Two-way causation.** Population and development often co-move; name the direction you claim and the44 observable that separates it from the reverse (reverse causation, institutional confounding).45- **Inference.** Cluster at the right level (household, region, country); use survey/design weights;46 report uncertainty for derived quantities.47- **Sensitivity.** How strong must an unobserved confounder (or a violated assumption) be to overturn it?4849## The adjudication test (PDR-specific)5051For the **single strongest rival explanation** (e.g., reverse causation, compositional change, selection,52institutional confounding), write one sentence: *"If the rival were true rather than my account, the53pattern would look like ___; instead it looks like ___."* If you cannot, the design does not yet identify54the population-and-development contribution.5556## Cross-country comparability (a recurring PDR design problem)5758PDR papers often compare countries or development contexts, and a cross-national contrast is only as good59as its comparability. Before reading a between-country gap as a development effect, settle three things:60611. **Definitions and coverage.** Are the demographic concepts (a "birth," a "migrant," an age cutoff) and62 the denominators measured the same way across settings? Vital-registration coverage and census quality63 vary with development level — and that variation can *create* the gradient you are studying.642. **Data class and vintage.** Mixing a high-quality register with a single DHS round, or different WPP65 vintages, can manufacture artefactual differences. Hold the data class and vintage as constant as the66 question allows, and report what you could not harmonize.673. **Like-with-like comparison.** Where full comparability is impossible, restrict to the subset that is68 comparable, or model the measurement difference explicitly rather than absorbing it into the estimate.6970State which of these you have controlled and which remain a caveat in `popdevr-tables-figures` notes.7172## When the contribution is a synthetic essay (no new estimate)7374If the paper's contribution is a framework rather than an analysis, the "design" is the **argument75architecture**: the propositions, the evidence marshaled for each, and the boundary where the framework76stops applying. Route the rigor through `popdevr-theory-building` and `popdevr-writing-style` instead of77this skill's estimation machinery, but still pass the adjudication test against the prior framework it78revises.7980## Execution bridge (StatsPAI / Stata MCP)8182Estimate and audit the design, don't only describe it. Full map:83[`execution-with-mcp`](../../../shared-resources/empirical-methods/execution-with-mcp.md). PDR is population studies blending quantitative and policy work; apply the chain to its empirical-causal papers.8485- `detect_design` → `recommend` → fit with `as_handle=true` → `audit_result`.86- **Observational causal claims:** staggered DiD (`callaway_santanna` / `sun_abraham` +87 `bacon_decomposition` + `honest_did_from_result`); IV (`effective_f_test` +88 `anderson_rubin_ci`); RDD (`rdrobust` + `mccrary_test`).89- **Experiments:** randomization-based inference, `romano_wolf` for many-outcome90 family-wise control, and `mediate` for mediation (not naive controlling-away).91- **Sensitivity:** `oster_delta` / `sensemakr` for observational claims.9293Report the effect size in interpretable units; route the full battery to the94appendix/supplement. A run end-to-end (synthetic data, real returns) is in the95[JF execution walkthrough](../../../Journal-of-Finance-Skills/resources/worked-examples/02-execution-walkthrough.md).96## Anti-patterns9798- Running a regression when the question calls for a life table, a decomposition, or an event-history model99- Presenting an APC decomposition without naming the identifying constraint100- Period rates read as cohort experience (or vice versa) without justification101- Ignoring mortality/migration selection or the population↔development direction of causation102- Projections whose assumptions are buried instead of varied and reported103104## Output format105106```107【Method】life table / decomposition / event history / APC / projection / causal108【Quantity / estimand】what is measured or identified + its development linkage109【Key assumption(s)】and how each is defended (name the APC constraint if used)110【Rival ruled out】the adjudication sentence (incl. reverse causation if relevant)111【Robustness/sensitivity】planned checks112【Next】popdevr-data-analysis113```114115## Supplementary resources116117- [`../../resources/external_tools.md`](../../resources/external_tools.md) — life-table, decomposition, survival, APC, and projection packages118- [`../../resources/official-source-map.md`](../../resources/official-source-map.md) — PDR scope and methodological breadth