Estimation, Robustness & Data Authenticity (tar-data-analysis)
When to trigger
- The sample is built and it is time to estimate and report
- You are unsure whether your standard errors, fixed effects, or estimator match the design
- Reviewers will probe robustness, alternative measures, or sample-selection screens
- You must assemble the data-authenticity / code-access package TAR requires
- A reviewer says "the result is not robust" or "I cannot tell how the sample was built"
Estimator and inference (large-sample archival core)
- Match the estimator to the design set in
tar-methods: OLS with high-dimensional fixed
effects (firm, year, industry-year) for panel associations; DiD / staggered-DiD with a modern
estimator for adoption shocks; 2SLS for endogenous regressors; RDD for threshold settings; logit/
probit/Poisson/Tobit for limited or count outcomes (e.g., restatement, going-concern, fraud).
- Cluster standard errors at the level of treatment assignment / correlation (firm, or two-way
firm-and-year); for few clusters use the wild-cluster bootstrap.
- Report fixed effects explicitly and show how the coefficient moves as you add them — a result
that survives tighter fixed effects is more credible than one that does not.
- For accounting-specific measures (discretionary accruals, real earnings management, abnormal
audit fees, effective/cash tax rates, disclosure tone), state the construction model and screen,
and show the result is not an artifact of the proxy.
Robustness reviewers expect
- Alternative measures of the focal accounting construct (e.g., a second accruals model; cash vs.
GAAP ETR; alternative disclosure proxy).
- Alternative samples and screens (drop financials/utilities; winsorize vs. truncate; subperiods).
- Sensitivity of the identifying assumption (pre-trends, placebo dates, alternative instruments,
bandwidth choices for RDD).
- Falsification / placebo tests where the effect should be absent.
- Economic magnitude, not just significance — interpret the coefficient in accounting terms.
Data-authenticity & code access (a TAR-specific requirement)
TAR requires authors to enable confirmation of data authenticity, with differentiated rules:
- Publicly available databases (Compustat, CRSP, I/B/E/S, Audit Analytics): provide a precise
description of the data and access to the computer code used to process it.
- Data abstracted from public sources (hand-collected from filings, PCAOB reports): provide the
abstraction methodology plus code access.
- Privately collected data (proprietary field data, experiments): provide enough detail for
reader confidence; corroborating third parties are acceptable.
Code/data sufficiency is part of the submission and acceptance requirements (待核实 whether a named
public repository deposit is mandated at acceptance). Build clean, commented scripts from raw
extract to every table now — not after the R&R.
Execution bridge (StatsPAI / Stata MCP)
Run the battery, don't just enumerate it. Full map:
execution-with-mcp. TAR is archival accounting — DiD around regulation / standard changes, IV, and earnings-based designs; the corporate-causal chain fits directly.
- Many outcomes / specifications:
romano_wolf (step-down FWER) or
benjamini_hochberg — report the adjusted threshold.
- OVB sensitivity:
oster_delta / sensemakr.
- Inference:
wild_cluster_bootstrap (few clusters), twoway_cluster / conley;
multilevel data → cluster at the right level.
- Re-fit off one handle:
audit_result(result_id) lists the missing checks and the
exact suggest_function for each.
- Exhibits:
etable / did_summary_to_latex from the handle — no retyped numbers.
Keep the decisive checks in the body and the exhaustive battery in the appendix. See the
executed chain in the JF execution walkthrough.
Checklist
Anti-patterns
- Uncluttered p-values, no magnitude — significance without economic interpretation.
- Single proxy for a contested construct (e.g., one accruals model) presented as definitive.
- TWFE on staggered adoption ignoring heterogeneous-treatment-effect bias.
- Robustness theater: many tables that never vary the thing a skeptic doubts.
- Unreproducible sample: screens and merges that no one can rebuild from the raw data.
- No processing code ready, in violation of the data-authenticity policy.
Output format
【Estimator】OLS-HDFE / staggered-DiD / 2SLS / RDD / logit-Poisson ...
【Fixed effects & clustering】... ; SE level ...
【Focal measure】construction + alternative proxy: pass/issues
【Robustness】alt measures / samples / placebo / pre-trends ...
【Economic magnitude】coefficient means ... in accounting terms
【Data authenticity】public-db / abstracted / private — code & description ready? yes/no
【Open issues for reviewers】...
【Next step】tar-contribution-framing
Source: brycewang-stanford/Awesome-Journal-Skills → The-Accounting-Review-Skills/skills/tar-data-analysis/SKILL.md
1---2name: tar-data-analysis3description: Use when running and reporting the estimation for a The Accounting Review (TAR) manuscript — the estimator, fixed effects, standard-error clustering, robustness, and the data-authenticity / code-access documentation TAR requires. Executes and reports the analysis; it does not design identification (tar-methods) or frame the contribution (tar-contribution-framing).4---5
6
7# Estimation, Robustness & Data Authenticity (tar-data-analysis)
8
9## When to trigger
10
11- The sample is built and it is time to estimate and report
12- You are unsure whether your standard errors, fixed effects, or estimator match the design
13- Reviewers will probe robustness, alternative measures, or sample-selection screens
14- You must assemble the data-authenticity / code-access package TAR requires
15- A reviewer says "the result is not robust" or "I cannot tell how the sample was built"
16
17## Estimator and inference (large-sample archival core)
18
19- **Match the estimator to the design** set in `tar-methods`: OLS with high-dimensional fixed
20 effects (firm, year, industry-year) for panel associations; DiD / staggered-DiD with a modern
21 estimator for adoption shocks; 2SLS for endogenous regressors; RDD for threshold settings; logit/
22 probit/Poisson/Tobit for limited or count outcomes (e.g., restatement, going-concern, fraud).
23- **Cluster standard errors** at the level of treatment assignment / correlation (firm, or two-way
24 firm-and-year); for few clusters use the wild-cluster bootstrap.
25- **Report fixed effects explicitly** and show how the coefficient moves as you add them — a result
26 that survives tighter fixed effects is more credible than one that does not.
27- For **accounting-specific measures** (discretionary accruals, real earnings management, abnormal
28 audit fees, effective/cash tax rates, disclosure tone), state the construction model and screen,
29 and show the result is not an artifact of the proxy.
30
31## Robustness reviewers expect
32
33- Alternative measures of the focal accounting construct (e.g., a second accruals model; cash vs.
34 GAAP ETR; alternative disclosure proxy).
35- Alternative samples and screens (drop financials/utilities; winsorize vs. truncate; subperiods).
36- Sensitivity of the identifying assumption (pre-trends, placebo dates, alternative instruments,
37 bandwidth choices for RDD).
38- Falsification / placebo tests where the effect should be absent.
39- Economic magnitude, not just significance — interpret the coefficient in accounting terms.
40
41## Data-authenticity & code access (a TAR-specific requirement)
42
43TAR requires authors to enable confirmation of data authenticity, with differentiated rules:
44
45- **Publicly available databases** (Compustat, CRSP, I/B/E/S, Audit Analytics): provide a precise
46 description of the data **and** access to the **computer code** used to process it.
47- **Data abstracted from public sources** (hand-collected from filings, PCAOB reports): provide the
48 **abstraction methodology** plus code access.
49- **Privately collected data** (proprietary field data, experiments): provide enough detail for
50 reader confidence; **corroborating third parties** are acceptable.
51
52Code/data sufficiency is part of the submission and acceptance requirements (待核实 whether a named
53public repository deposit is mandated at acceptance). Build clean, commented scripts from raw
54extract to every table now — not after the R&R.
55
56## Execution bridge (StatsPAI / Stata MCP)
57
58Run the battery, don't just enumerate it. Full map:
59[`execution-with-mcp`](../../../shared-resources/empirical-methods/execution-with-mcp.md). TAR is archival accounting — DiD around regulation / standard changes, IV, and earnings-based designs; the corporate-causal chain fits directly.
60
61- **Many outcomes / specifications:** `romano_wolf` (step-down FWER) or
62 `benjamini_hochberg` — report the adjusted threshold.
63- **OVB sensitivity:** `oster_delta` / `sensemakr`.
64- **Inference:** `wild_cluster_bootstrap` (few clusters), `twoway_cluster` / `conley`;
65 multilevel data → cluster at the right level.
66- **Re-fit off one handle:** `audit_result(result_id)` lists the missing checks and the
67 exact `suggest_function` for each.
68- **Exhibits:** `etable` / `did_summary_to_latex` from the handle — no retyped numbers.
69
70Keep the decisive checks in the body and the exhaustive battery in the appendix. See the
71executed chain in the [JF execution walkthrough](../../../Journal-of-Finance-Skills/resources/worked-examples/02-execution-walkthrough.md).
72## Checklist
73
74- [ ] Estimator matches the design; FEs reported; SEs clustered at the right level
75- [ ] Coefficient stability shown across FE/control sets
76- [ ] Focal accounting measure validated with an alternative construction
77- [ ] Pre-trends/placebo/falsification tests reported where the design needs them
78- [ ] Economic magnitude interpreted, not just p-values
79- [ ] Data-authenticity package assembled per data type (description + processing code / methodology)
80- [ ] Sample-construction screens documented and reproducible from raw data
81
82## Anti-patterns
83
84- **Uncluttered p-values, no magnitude** — significance without economic interpretation.
85- **Single proxy** for a contested construct (e.g., one accruals model) presented as definitive.
86- **TWFE on staggered adoption** ignoring heterogeneous-treatment-effect bias.
87- **Robustness theater**: many tables that never vary the thing a skeptic doubts.
88- **Unreproducible sample**: screens and merges that no one can rebuild from the raw data.
89- **No processing code** ready, in violation of the data-authenticity policy.
90
91## Output format
92
93```
94【Estimator】OLS-HDFE / staggered-DiD / 2SLS / RDD / logit-Poisson ...
95【Fixed effects & clustering】... ; SE level ...
96【Focal measure】construction + alternative proxy: pass/issues
97【Robustness】alt measures / samples / placebo / pre-trends ...
98【Economic magnitude】coefficient means ... in accounting terms
99【Data authenticity】public-db / abstracted / private — code & description ready? yes/no
100【Open issues for reviewers】...
101【Next step】tar-contribution-framing
102```
103
104---
105
106**Source:** [`brycewang-stanford/Awesome-Journal-Skills`](https://github.com/brycewang-stanford/Awesome-Journal-Skills) → `The-Accounting-Review-Skills/skills/tar-data-analysis/SKILL.md`