Data Analysis & Robustness (jar-data-analysis)
When to trigger
- Data are built and it is time to estimate and report
- You are unsure how to cluster standard errors for your panel
- Referees will probe endogeneity, measurement, or the channel
- You must assemble the reproducible data-and-code package JAR posts
Get the standard errors right (a JAR signature check)
Empirical-accounting referees scrutinize inference. Default to clustering by firm, and consider two-way clustering by firm and year (Petersen) when both cross-sectional and time-series dependence are present. With few clusters, use the wild-cluster bootstrap rather than asymptotic cluster-robust SEs. Match the clustering to the source of correlated shocks implied by your design, and report the choice explicitly.
Execute the identification, don't just assert it
- DiD: report pre-trends and use heterogeneity-robust estimators for staggered timing (Callaway-Sant'Anna / Sun-Abraham), not naive two-way FE.
- RD: report the optimal bandwidth, robust bias-corrected estimates, a manipulation (density) test, and covariate balance at the cutoff.
- IV/2SLS: report the first stage and instrument strength (e.g., F-statistic), and defend the exclusion restriction in words.
- Event studies: report abnormal returns with a defensible benchmark model and window, and confront confounding events.
Measure accounting constructs credibly
Use measures with precedent in prior JAR/JAE work (discretionary accruals, earnings persistence/smoothness, disclosure indices, comparability, audit-quality proxies, bid-ask spread / PIN for information asymmetry). Show the proxy behaves sensibly (validation, correlations with established measures) and test sensitivity to alternative proxies — proxy fragility is a common rejection reason.
The robustness battery referees expect
- Alternative specifications: controls in/out, alternative fixed effects, alternative measures of the key construct.
- Subsamples and falsification/placebo tests (e.g., effect absent where theory says it should be).
- Sensitivity of identification assumptions (alternative instruments, donut RD, bounds).
- Cross-sectional partitions that confirm the predicted channel (the conditional predictions from jar-theory-development).
- Sample-construction and winsorization choices documented and varied.
Reproducibility is a deliverable, not a courtesy
JAR's data-and-code sharing policy requires and hosts the materials. Keep top-to-bottom runnable scripts that regenerate every table and figure from raw extracts; document screens, vintages, and access dates; respect the terms of use (academic-research-only, acknowledgement of the JAR publication and code authors, authors retain copyright). On a Registered Report, the executed analysis must match the pre-approved Stage 1 protocol.
Execution bridge (StatsPAI / Stata MCP)
Run the battery, don't just enumerate it. Full map:
execution-with-mcp. JAR is archival/empirical accounting; foreground identification around disclosure and regulation shocks, with modern DiD where adoption is staggered.
- Many outcomes / specifications:
romano_wolf (step-down FWER) or
benjamini_hochberg — report the adjusted threshold.
- OVB sensitivity:
oster_delta / sensemakr.
- Inference:
wild_cluster_bootstrap (few clusters), twoway_cluster / conley;
multilevel data → cluster at the right level.
- Re-fit off one handle:
audit_result(result_id) lists the missing checks and the
exact suggest_function for each.
- Exhibits:
etable / did_summary_to_latex from the handle — no retyped numbers.
Keep the decisive checks in the body and the exhaustive battery in the appendix. See the
executed chain in the JF execution walkthrough.
Checklist
Anti-patterns
- White/robust SEs on panel data ignoring within-firm correlation.
- Naive two-way-FE DiD with staggered adoption.
- One proxy, no validation for a contested accounting construct.
- Significance fishing across windows, bandwidths, or specifications.
- "Code available on request" — JAR requires the package to be posted.
Output format
【Estimator & SEs】model; clustering (firm / firm×year / wild bootstrap)
【Identification executed】diagnostics reported (pre-trends/bandwidth/first-stage)
【Construct measurement】proxy + validation + alt-proxy robustness
【Robustness/falsification】[...]
【Channel partitions】conditional predictions confirmed? [...]
【Reproducibility】data/code package status per JAR policy
【Open issues for referees】[...]
【Next step】jar-contribution-framing
Resources
Source: brycewang-stanford/Awesome-Journal-Skills → Journal-of-Accounting-Research-Skills/skills/jar-data-analysis/SKILL.md
1---2name: jar-data-analysis3description: Use when running and reporting the empirical-archival analysis for a Journal of Accounting Research (JAR) manuscript — standard-error clustering, endogeneity execution, construct measurement, and the robustness battery referees expect, plus the reproducible data-and-code package JAR requires. Executes and reports; it does not choose the identification strategy (jar-methods) or frame the contribution (jar-contribution-framing).4---567# Data Analysis & Robustness (jar-data-analysis)89## When to trigger1011- Data are built and it is time to estimate and report12- You are unsure how to cluster standard errors for your panel13- Referees will probe endogeneity, measurement, or the channel14- You must assemble the reproducible **data-and-code package** JAR posts1516## Get the standard errors right (a JAR signature check)1718Empirical-accounting referees scrutinize inference. Default to **clustering by firm**, and consider **two-way clustering by firm and year** (Petersen) when both cross-sectional and time-series dependence are present. With **few clusters**, use the **wild-cluster bootstrap** rather than asymptotic cluster-robust SEs. Match the clustering to the source of correlated shocks implied by your design, and report the choice explicitly.1920## Execute the identification, don't just assert it2122- **DiD**: report pre-trends and use heterogeneity-robust estimators for staggered timing (Callaway-Sant'Anna / Sun-Abraham), not naive two-way FE.23- **RD**: report the optimal bandwidth, robust bias-corrected estimates, a manipulation (density) test, and covariate balance at the cutoff.24- **IV/2SLS**: report the first stage and instrument strength (e.g., F-statistic), and defend the exclusion restriction in words.25- **Event studies**: report abnormal returns with a defensible benchmark model and window, and confront confounding events.2627## Measure accounting constructs credibly2829Use measures with precedent in prior JAR/JAE work (discretionary accruals, earnings persistence/smoothness, disclosure indices, comparability, audit-quality proxies, bid-ask spread / PIN for information asymmetry). Show the proxy behaves sensibly (validation, correlations with established measures) and test sensitivity to alternative proxies — proxy fragility is a common rejection reason.3031## The robustness battery referees expect3233- Alternative specifications: controls in/out, alternative fixed effects, alternative measures of the key construct.34- Subsamples and falsification/placebo tests (e.g., effect absent where theory says it should be).35- Sensitivity of identification assumptions (alternative instruments, donut RD, bounds).36- Cross-sectional partitions that confirm the **predicted channel** (the conditional predictions from jar-theory-development).37- Sample-construction and winsorization choices documented and varied.3839## Reproducibility is a deliverable, not a courtesy4041JAR's **data-and-code sharing policy requires and hosts** the materials. Keep top-to-bottom runnable scripts that regenerate every table and figure from raw extracts; document screens, vintages, and access dates; respect the terms of use (academic-research-only, acknowledgement of the JAR publication and code authors, authors retain copyright). On a **Registered Report**, the executed analysis must match the pre-approved Stage 1 protocol.4243## Execution bridge (StatsPAI / Stata MCP)4445Run the battery, don't just enumerate it. Full map:46[`execution-with-mcp`](../../../shared-resources/empirical-methods/execution-with-mcp.md). JAR is archival/empirical accounting; foreground identification around disclosure and regulation shocks, with modern DiD where adoption is staggered.4748- **Many outcomes / specifications:** `romano_wolf` (step-down FWER) or49 `benjamini_hochberg` — report the adjusted threshold.50- **OVB sensitivity:** `oster_delta` / `sensemakr`.51- **Inference:** `wild_cluster_bootstrap` (few clusters), `twoway_cluster` / `conley`;52 multilevel data → cluster at the right level.53- **Re-fit off one handle:** `audit_result(result_id)` lists the missing checks and the54 exact `suggest_function` for each.55- **Exhibits:** `etable` / `did_summary_to_latex` from the handle — no retyped numbers.5657Keep the decisive checks in the body and the exhaustive battery in the appendix. See the58executed chain in the [JF execution walkthrough](../../../Journal-of-Finance-Skills/resources/worked-examples/02-execution-walkthrough.md).59## Checklist6061- [ ] SE clustering matches the design (firm / firm-and-year; wild bootstrap if few clusters)62- [ ] Identification executed with diagnostics (pre-trends / bandwidth / first-stage / balance)63- [ ] Modern DiD estimators used for staggered treatment timing64- [ ] Key construct validated; results robust to alternative proxies65- [ ] Robustness, falsification/placebo, and channel partitions reported66- [ ] Winsorization/sample screens documented and varied67- [ ] Reproducible data-and-code package assembled per JAR policy6869## Anti-patterns7071- **White/robust SEs on panel data** ignoring within-firm correlation.72- **Naive two-way-FE DiD** with staggered adoption.73- **One proxy, no validation** for a contested accounting construct.74- **Significance fishing** across windows, bandwidths, or specifications.75- **"Code available on request"** — JAR requires the package to be posted.7677## Output format7879```80【Estimator & SEs】model; clustering (firm / firm×year / wild bootstrap)81【Identification executed】diagnostics reported (pre-trends/bandwidth/first-stage)82【Construct measurement】proxy + validation + alt-proxy robustness83【Robustness/falsification】[...]84【Channel partitions】conditional predictions confirmed? [...]85【Reproducibility】data/code package status per JAR policy86【Open issues for referees】[...]87【Next step】jar-contribution-framing88```8990## Resources9192- [`../../resources/official-source-map.md`](../../resources/official-source-map.md) — official JAR/Chicago Booth/Wiley URLs (accessed 2026-06-01)93- [`../../resources/external_tools.md`](../../resources/external_tools.md) — econometric packages (reghdfe / fixest / csdid / rdrobust / boottest) and data sources9495---9697**Source:** [`brycewang-stanford/Awesome-Journal-Skills`](https://github.com/brycewang-stanford/Awesome-Journal-Skills) → `Journal-of-Accounting-Research-Skills/skills/jar-data-analysis/SKILL.md`