Data Analysis & Evidence (orgstud-data-analysis)
When to trigger
- You have data but the path from raw material to theory is opaque
- Qualitative: your quotes are decorative, not evidentiary; the coding is undocumented
- Process: you have events but no visible analytic structure turning them into a model
- Quantitative: main results exist but robustness and alternative explanations are thin
- A reviewer asks "how did you get from your data to these constructs?"
OS expects readers to see how data became theory
OS's interpretive, European tradition makes analytic transparency a first-class criterion — qualitative rigor is judged on its own terms, not against a quantitative yardstick. The reader must be able to audit the inference from raw data to theoretical claim. Make the analytic ladder visible.
Branch A — Qualitative analysis (the data-to-theory ladder)
- Transparent coding. Show first-order codes (informant terms), second-order themes (researcher constructs), and aggregate dimensions — the Gioia data structure — or an equivalent (Eisenhardt cross-case tables, Langley process bracketing). State who coded, how disagreements were resolved, and how iteration with theory proceeded.
- Data-to-theory table. A table linking representative raw evidence → codes → constructs, so the inference is auditable (build it with
orgstud-tables-figures).
- Power quotes vs. proof quotes. A few vivid "power quotes" in the body carry the argument; corroborating "proof quotes" sit in tables/appendix. Quotes must carry the claim, not illustrate a conclusion reached elsewhere.
- Evidence for each construct. Every construct backed by patterned evidence across informants/cases, with prevalence where appropriate.
- Negative cases. Report disconfirming instances and how they refined the theory — central to trustworthiness at OS.
- Process display. For process theory, show the temporal/event structure (timeline, phase model, visual mapping); make the transitions between phases analytically explicit, not just narrated.
Branch B — Process analysis (when the contribution is a process model)
- Choose a process strategy explicitly: narrative, temporal bracketing, visual mapping, grounded theory, or alternate templates (Langley). Say why it fits.
- Identify events, sequences, and turning points; show what triggers each transition and what each phase accomplishes that the prior could not.
- Distinguish real-time from retrospective data and address the recall/hindsight risks of each.
- The output is a process model figure plus the analytic account that earns it.
Branch C — Quantitative analysis
- Main models match the design (FE/RE, event-history, multilevel, network); standard errors clustered at the right level.
- Robustness that targets the theory's threats — alternative measures, samples, specifications, endogeneity checks, modern staggered-DiD diagnostics if relevant — not a wall of tables that never address the real threat.
- Mechanism evidence. Don't stop at the reduced-form relationship; probe why (mediation/moderation or supplementary tests).
- Effect interpretation in organizational terms — magnitudes, not just significance.
Either branch — the "so what" of the evidence
- Tie every analytic result back to the mechanism and the theoretical puzzle.
- Distinguish what the data can and cannot establish — overclaiming is a fast OS rejection.
- Prepare exhibits jointly with
orgstud-tables-figures.
Execution bridge (StatsPAI / Stata MCP)
Run the battery, don't just enumerate it. Full map:
execution-with-mcp. Organization Studies is largely qualitative/theoretical; use the chain below only for its quantitative-empirical papers, and say so when a study is interpretive.
- Many outcomes / specifications:
romano_wolf (step-down FWER) or
benjamini_hochberg — report the adjusted threshold.
- OVB sensitivity:
oster_delta / sensemakr.
- Inference:
wild_cluster_bootstrap (few clusters), twoway_cluster / conley;
multilevel data → cluster at the right level.
- Re-fit off one handle:
audit_result(result_id) lists the missing checks and the
exact suggest_function for each.
- Exhibits:
etable / did_summary_to_latex from the handle — no retyped numbers.
Keep the decisive checks in the body and the exhaustive battery in the appendix. See the
executed chain in the JF execution walkthrough.
Checklist
Anti-patterns
- "Anecdotal" qualitative work: cherry-picked quotes with no coding transparency
- Quotes that illustrate a pre-set conclusion rather than generating/supporting it
- A process "model" that is really a narrative with no analytic structure or transition logic
- Robustness theater: many tables that never address the real identification threat
- Reporting significance with no interpretation of organizational magnitude
- Overclaiming causality or generalizability beyond what the design supports
Output format
【Branch】qualitative / process / quantitative
【Data-to-theory link】data structure / process strategy / mechanism tests done
【Key evidence】power quotes, the process model, or main estimates
【Trustworthiness/robustness】checks completed + gaps (negative cases, clustering, alt explanations)
【What evidence cannot show】explicit limits
【Next skill】orgstud-contribution-framing
1---2name: orgstud-data-analysis3description: Use when executing and reporting the analysis for an Organization Studies (OS) manuscript — qualitative coding and the data-to-theory ladder, process analysis, or quantitative estimation and robustness. Makes the evidence-to-theory link transparent; it does not design the study (see orgstud-methods).4---56# Data Analysis & Evidence (orgstud-data-analysis)78## When to trigger910- You have data but the path from raw material to theory is opaque11- Qualitative: your quotes are decorative, not evidentiary; the coding is undocumented12- Process: you have events but no visible analytic structure turning them into a model13- Quantitative: main results exist but robustness and alternative explanations are thin14- A reviewer asks "how did you get from your data to these constructs?"1516## OS expects readers to *see* how data became theory1718OS's interpretive, European tradition makes **analytic transparency** a first-class criterion — qualitative rigor is judged on its own terms, not against a quantitative yardstick. The reader must be able to *audit the inference* from raw data to theoretical claim. Make the analytic ladder visible.1920## Branch A — Qualitative analysis (the data-to-theory ladder)2122- **Transparent coding.** Show first-order codes (informant terms), second-order themes (researcher constructs), and aggregate dimensions — the **Gioia data structure** — or an equivalent (Eisenhardt cross-case tables, Langley process bracketing). State who coded, how disagreements were resolved, and how iteration with theory proceeded.23- **Data-to-theory table.** A table linking representative raw evidence → codes → constructs, so the inference is auditable (build it with `orgstud-tables-figures`).24- **Power quotes vs. proof quotes.** A few vivid "power quotes" in the body carry the argument; corroborating "proof quotes" sit in tables/appendix. Quotes must *carry* the claim, not illustrate a conclusion reached elsewhere.25- **Evidence for each construct.** Every construct backed by patterned evidence across informants/cases, with prevalence where appropriate.26- **Negative cases.** Report disconfirming instances and how they refined the theory — central to trustworthiness at OS.27- **Process display.** For process theory, show the temporal/event structure (timeline, phase model, visual mapping); make the transitions between phases analytically explicit, not just narrated.2829## Branch B — Process analysis (when the contribution is a process model)3031- Choose a **process strategy** explicitly: narrative, temporal bracketing, visual mapping, grounded theory, or alternate templates (Langley). Say why it fits.32- Identify **events, sequences, and turning points**; show what triggers each transition and what each phase accomplishes that the prior could not.33- Distinguish **real-time** from **retrospective** data and address the recall/hindsight risks of each.34- The output is a **process model figure** plus the analytic account that earns it.3536## Branch C — Quantitative analysis3738- **Main models** match the design (FE/RE, event-history, multilevel, network); standard errors clustered at the right level.39- **Robustness that targets the theory's threats** — alternative measures, samples, specifications, endogeneity checks, modern staggered-DiD diagnostics if relevant — not a wall of tables that never address the real threat.40- **Mechanism evidence.** Don't stop at the reduced-form relationship; probe *why* (mediation/moderation or supplementary tests).41- **Effect interpretation in organizational terms** — magnitudes, not just significance.4243## Either branch — the "so what" of the evidence4445- Tie every analytic result back to the mechanism and the theoretical puzzle.46- Distinguish what the data *can* and *cannot* establish — overclaiming is a fast OS rejection.47- Prepare exhibits jointly with `orgstud-tables-figures`.4849## Execution bridge (StatsPAI / Stata MCP)5051Run the battery, don't just enumerate it. Full map:52[`execution-with-mcp`](../../../shared-resources/empirical-methods/execution-with-mcp.md). Organization Studies is largely qualitative/theoretical; use the chain below only for its quantitative-empirical papers, and say so when a study is interpretive.5354- **Many outcomes / specifications:** `romano_wolf` (step-down FWER) or55 `benjamini_hochberg` — report the adjusted threshold.56- **OVB sensitivity:** `oster_delta` / `sensemakr`.57- **Inference:** `wild_cluster_bootstrap` (few clusters), `twoway_cluster` / `conley`;58 multilevel data → cluster at the right level.59- **Re-fit off one handle:** `audit_result(result_id)` lists the missing checks and the60 exact `suggest_function` for each.61- **Exhibits:** `etable` / `did_summary_to_latex` from the handle — no retyped numbers.6263Keep the decisive checks in the body and the exhaustive battery in the appendix. See the64executed chain in the [JF execution walkthrough](../../../Journal-of-Finance-Skills/resources/worked-examples/02-execution-walkthrough.md).65## Checklist6667- [ ] Qual: data structure (first-order → second-order → dimensions) documented68- [ ] Qual: a data-to-theory / evidence table built; quotes carry (not decorate) claims69- [ ] Qual: negative cases reported and used to refine the theory70- [ ] Process: process strategy named; turning points and transitions made explicit71- [ ] Quant: SEs clustered appropriately; robustness targets the theory's threats; magnitudes interpreted72- [ ] Mechanism is probed, not just the headline relationship73- [ ] Claims are matched to what the evidence can actually support7475## Anti-patterns7677- "Anecdotal" qualitative work: cherry-picked quotes with no coding transparency78- Quotes that illustrate a pre-set conclusion rather than generating/supporting it79- A process "model" that is really a narrative with no analytic structure or transition logic80- Robustness theater: many tables that never address the real identification threat81- Reporting significance with no interpretation of organizational magnitude82- Overclaiming causality or generalizability beyond what the design supports8384## Output format8586```text87【Branch】qualitative / process / quantitative88【Data-to-theory link】data structure / process strategy / mechanism tests done89【Key evidence】power quotes, the process model, or main estimates90【Trustworthiness/robustness】checks completed + gaps (negative cases, clustering, alt explanations)91【What evidence cannot show】explicit limits92【Next skill】orgstud-contribution-framing93```