Identification Strategy (jebo-identification)
When to trigger
- A lab/field experiment's treatment, incentives, or comprehension are not pinned down
- An effect could be an experimenter-demand effect rather than the claimed behavioral mechanism
- An observational behavioral claim rests on OLS + controls, or TWFE on staggered timing
- A study uses deception, or runs many treatments, and the inference/ethics implications are unaddressed
- You are unsure the design isolates the behavioral mechanism, not a confound
The JEBO identification bar
JEBO judges identification through a behavioral-mechanism lens: the design must isolate the psychological or institutional channel the paper claims, not merely produce a significant difference. Because JEBO treats experimental design as a first-class identification branch alongside observational causal designs, "identification" means different things by branch — pick the branch and make the channel transparent. Inference must match the design (clustering at the level of randomization or assignment; few-cluster corrections).
Branch A: Lab / online experiment (the JEBO core)
- Incentive compatibility: payoffs must make truthful/effortful behavior the dominant strategy for the elicited object (e.g., BDM, strategy method, incentivized beliefs). State the mechanism and the stakes.
- No-deception norm: the experimental-economics convention is no deception; if you deviate, justify it and expect scrutiny — many referees treat deception as disqualifying for an incentivized study.
- Comprehension & attention checks: report comprehension quizzes, control questions, and how failures were handled (drop / re-instruct), so the effect is not confusion.
- Experimenter demand: rule out demand effects — neutral framing, between-subject where within-subject would cue the hypothesis, obfuscated objectives, or an explicit demand-treatment (e.g., Mummolo–Peterson / de Quidt-style bounds).
- Randomization & balance: show balance on observables; report the randomization procedure and unit.
- Multiple treatments: if several treatment arms, plan the comparisons and correct for multiplicity (see jebo-robustness).
- Pre-registration: pre-register the design and primary analysis (AEA RCT Registry / AsPredicted / OSF) and report deviations. (JEBO does not currently mandate it — 待核实 — but referees increasingly expect it.)
Branch B: Field experiment
- ITT vs. LATE/TOT stated; randomization unit and stratification described; spillovers and SUTVA addressed.
- Attrition examined and bounded (Lee bounds if differential); compliance documented.
- Ethical clearance / consent noted; external-validity scope stated (the field setting's generality).
Branch C: Observational behavioral empirics
- DID / event study with staggered adoption: move beyond TWFE (Callaway–Sant'Anna, Sun–Abraham, de Chaisemartin–D'Haultfœuille); show clean event-study leads; Goodman-Bacon decomposition.
- IV: strong first stage (effective F); weak-IV-robust sets (Anderson–Rubin) when needed; defend exclusion in institutions/theory + falsification.
- RDD: density/manipulation test (McCrary / Cattaneo–Jansson–Ma); local-linear, data-driven bandwidth, bias-corrected robust CIs.
- The behavioral interpretation must be argued, not assumed — the design identifies an estimate; the mechanism connecting it to a behavioral channel needs its own evidence (see jebo-theory-model).
Branch D: Agent-based / simulation
- Document the data-generating process and behavioral rules; set and report seeds; show the result is not an artifact of grid/tuning choices (see jebo-robustness).
Execution bridge (StatsPAI / Stata MCP)
Estimate and audit the design, don't only describe it. Full map:
execution-with-mcp. JEBO spans behavioral/experimental and applied micro; randomization inference for experiments, DiD/IV for observational claims.
detect_design → recommend → fit with as_handle=true → audit_result.
- Observational causal claims: staggered DiD (
callaway_santanna / sun_abraham +
bacon_decomposition + honest_did_from_result); IV (effective_f_test +
anderson_rubin_ci); RDD (rdrobust + mccrary_test).
- Experiments: randomization-based inference +
romano_wolf for many-outcome control.
- Sensitivity:
oster_delta / sensemakr for observational claims.
Report the magnitude in interpretable units; route the full battery to the appendix. A
run end-to-end (synthetic data, real returns) is in the JF execution walkthrough.
Checklist
Anti-patterns
- Reporting a treatment difference as a behavioral mechanism without ruling out demand effects
- Using deception in an incentivized study without justification (referees may reject outright)
- Within-subject designs that cue the hypothesis, presented as if between-subject-clean
- TWFE on staggered treatment with no heterogeneity-bias discussion
- Calling a significant coefficient "evidence of [bias]" when a non-behavioral confound survives
- Significance asterisks standing in for clustered SEs or a pre-registered primary outcome
Worked vignette (illustrative)
A lab study claims that public visibility raises cooperation via image concerns. A referee asks whether subjects merely inferred the experimenter wanted more cooperation in the visible arm. The JEBO fix: add a demand-effect treatment (explicitly tell one cell "we expect more cooperation"), show the visibility effect (illustrative: +0.6 contributions, s.e. 0.2) is an order of magnitude larger than the pure demand response, and pre-register cooperation as the primary outcome — turning "could be demand" into a bounded, mechanism-level claim.
Output format
【Branch】lab / field / observational / simulation
【Design-to-mechanism mapping】one sentence
【Behavioral channel isolated】<image concern / loss aversion / learning / norm / ...>
【Identification evidence】[incentives+comprehension+demand-bound / balance+attrition / pre-trends+density+first-stage / DGP+seeds]
【Estimator + inference】estimator; clustering level; weak-IV/honest-DID if any
【What it does NOT identify】[...]
【Next step】jebo-theory-model
Source: brycewang-stanford/Awesome-Journal-Skills → Journal-of-Economic-Behavior-and-Organization-Skills/skills/jebo-identification/SKILL.md
1---2name: jebo-identification3description: Use when the design that isolates a behavioral mechanism is the bottleneck for a Journal of Economic Behavior & Organization (JEBO) manuscript — lab/field experiment, observational causal design, or simulation. Stress-tests experimental and observational identification to JEBO's behavioral-credibility bar; it does not write prose or build the deposit.4---567# Identification Strategy (jebo-identification)89## When to trigger1011- A lab/field experiment's treatment, incentives, or comprehension are not pinned down12- An effect could be an **experimenter-demand effect** rather than the claimed behavioral mechanism13- An observational behavioral claim rests on OLS + controls, or TWFE on staggered timing14- A study uses deception, or runs many treatments, and the inference/ethics implications are unaddressed15- You are unsure the design isolates the *behavioral* mechanism, not a confound1617## The JEBO identification bar1819JEBO judges identification through a **behavioral-mechanism** lens: the design must isolate the *psychological or institutional channel* the paper claims, not merely produce a significant difference. Because JEBO treats **experimental design as a first-class identification branch** alongside observational causal designs, "identification" means different things by branch — pick the branch and make the channel transparent. Inference must match the design (clustering at the level of randomization or assignment; few-cluster corrections).2021### Branch A: Lab / online experiment (the JEBO core)2223- **Incentive compatibility:** payoffs must make truthful/effortful behavior the dominant strategy for the elicited object (e.g., BDM, strategy method, incentivized beliefs). State the mechanism and the stakes.24- **No-deception norm:** the experimental-economics convention is **no deception**; if you deviate, justify it and expect scrutiny — many referees treat deception as disqualifying for an incentivized study.25- **Comprehension & attention checks:** report comprehension quizzes, control questions, and how failures were handled (drop / re-instruct), so the effect is not confusion.26- **Experimenter demand:** rule out demand effects — neutral framing, between-subject where within-subject would cue the hypothesis, obfuscated objectives, or an explicit demand-treatment (e.g., Mummolo–Peterson / de Quidt-style bounds).27- **Randomization & balance:** show balance on observables; report the randomization procedure and unit.28- **Multiple treatments:** if several treatment arms, plan the comparisons and correct for multiplicity (see jebo-robustness).29- **Pre-registration:** pre-register the design and primary analysis (AEA RCT Registry / AsPredicted / OSF) and report deviations. (JEBO does not currently mandate it — 待核实 — but referees increasingly expect it.)3031### Branch B: Field experiment3233- ITT vs. LATE/TOT stated; randomization unit and stratification described; spillovers and SUTVA addressed.34- Attrition examined and bounded (Lee bounds if differential); compliance documented.35- Ethical clearance / consent noted; external-validity scope stated (the field setting's generality).3637### Branch C: Observational behavioral empirics3839- **DID / event study** with staggered adoption: move beyond TWFE (Callaway–Sant'Anna, Sun–Abraham, de Chaisemartin–D'Haultfœuille); show clean event-study leads; Goodman-Bacon decomposition.40- **IV:** strong first stage (effective F); weak-IV-robust sets (Anderson–Rubin) when needed; defend exclusion in institutions/theory + falsification.41- **RDD:** density/manipulation test (McCrary / Cattaneo–Jansson–Ma); local-linear, data-driven bandwidth, bias-corrected robust CIs.42- The behavioral interpretation must be argued, not assumed — the design identifies an estimate; the *mechanism* connecting it to a behavioral channel needs its own evidence (see jebo-theory-model).4344### Branch D: Agent-based / simulation4546- Document the data-generating process and behavioral rules; set and report seeds; show the result is not an artifact of grid/tuning choices (see jebo-robustness).4748## Execution bridge (StatsPAI / Stata MCP)4950Estimate and audit the design, don't only describe it. Full map:51[`execution-with-mcp`](../../../shared-resources/empirical-methods/execution-with-mcp.md). JEBO spans behavioral/experimental and applied micro; randomization inference for experiments, DiD/IV for observational claims.5253- `detect_design` → `recommend` → fit with `as_handle=true` → `audit_result`.54- **Observational causal claims:** staggered DiD (`callaway_santanna` / `sun_abraham` +55 `bacon_decomposition` + `honest_did_from_result`); IV (`effective_f_test` +56 `anderson_rubin_ci`); RDD (`rdrobust` + `mccrary_test`).57- **Experiments:** randomization-based inference + `romano_wolf` for many-outcome control.58- **Sensitivity:** `oster_delta` / `sensemakr` for observational claims.5960Report the magnitude in interpretable units; route the full battery to the appendix. A61run end-to-end (synthetic data, real returns) is in the [JF execution walkthrough](../../../Journal-of-Finance-Skills/resources/worked-examples/02-execution-walkthrough.md).62## Checklist6364- [ ] Branch chosen; the design-to-mechanism mapping stated in one sentence65- [ ] Experiment: incentive-compatible elicitation; no deception (or justified); comprehension checks reported66- [ ] Experimenter-demand effects ruled out or bounded67- [ ] Randomization unit, balance, and (for field) attrition/spillovers handled68- [ ] Observational: design-appropriate diagnostics; modern estimator where TWFE/2SLS would bias69- [ ] Inference clustered at the randomization/assignment level; few-cluster issue addressed70- [ ] The behavioral claim never exceeds what the design isolates7172## Anti-patterns7374- Reporting a treatment difference as a behavioral mechanism without ruling out demand effects75- Using deception in an incentivized study without justification (referees may reject outright)76- Within-subject designs that cue the hypothesis, presented as if between-subject-clean77- TWFE on staggered treatment with no heterogeneity-bias discussion78- Calling a significant coefficient "evidence of [bias]" when a non-behavioral confound survives79- Significance asterisks standing in for clustered SEs or a pre-registered primary outcome8081## Worked vignette (illustrative)8283A lab study claims that public visibility raises cooperation via image concerns. A referee asks whether subjects merely inferred the experimenter wanted more cooperation in the visible arm. The JEBO fix: add a demand-effect treatment (explicitly tell one cell "we expect more cooperation"), show the visibility effect (illustrative: +0.6 contributions, s.e. 0.2) is an order of magnitude larger than the pure demand response, and pre-register cooperation as the primary outcome — turning "could be demand" into a bounded, mechanism-level claim.8485## Output format8687```text88【Branch】lab / field / observational / simulation89【Design-to-mechanism mapping】one sentence90【Behavioral channel isolated】<image concern / loss aversion / learning / norm / ...>91【Identification evidence】[incentives+comprehension+demand-bound / balance+attrition / pre-trends+density+first-stage / DGP+seeds]92【Estimator + inference】estimator; clustering level; weak-IV/honest-DID if any93【What it does NOT identify】[...]94【Next step】jebo-theory-model95```9697---9899**Source:** [`brycewang-stanford/Awesome-Journal-Skills`](https://github.com/brycewang-stanford/Awesome-Journal-Skills) → `Journal-of-Economic-Behavior-and-Organization-Skills/skills/jebo-identification/SKILL.md`