Data Analysis & Evidence (orgstud-data-analysis)
When to trigger
- You have data but the path from raw material to theory is opaque
- Qualitative: your quotes are decorative, not evidentiary; the coding is undocumented
- Process: you have events but no visible analytic structure turning them into a model
- Quantitative: main results exist but robustness and alternative explanations are thin
- A reviewer asks "how did you get from your data to these constructs?"
OS expects readers to see how data became theory
OS's interpretive, European tradition makes analytic transparency a first-class criterion — qualitative rigor is judged on its own terms, not against a quantitative yardstick. The reader must be able to audit the inference from raw data to theoretical claim. Make the analytic ladder visible.
Branch A — Qualitative analysis (the data-to-theory ladder)
- Transparent coding. Show first-order codes (informant terms), second-order themes (researcher constructs), and aggregate dimensions — the Gioia data structure — or an equivalent (Eisenhardt cross-case tables, Langley process bracketing). State who coded, how disagreements were resolved, and how iteration with theory proceeded.
- Data-to-theory table. A table linking representative raw evidence → codes → constructs, so the inference is auditable (build it with
orgstud-tables-figures).
- Power quotes vs. proof quotes. A few vivid "power quotes" in the body carry the argument; corroborating "proof quotes" sit in tables/appendix. Quotes must carry the claim, not illustrate a conclusion reached elsewhere.
- Evidence for each construct. Every construct backed by patterned evidence across informants/cases, with prevalence where appropriate.
- Negative cases. Report disconfirming instances and how they refined the theory — central to trustworthiness at OS.
- Process display. For process theory, show the temporal/event structure (timeline, phase model, visual mapping); make the transitions between phases analytically explicit, not just narrated.
Branch B — Process analysis (when the contribution is a process model)
- Choose a process strategy explicitly: narrative, temporal bracketing, visual mapping, grounded theory, or alternate templates (Langley). Say why it fits.
- Identify events, sequences, and turning points; show what triggers each transition and what each phase accomplishes that the prior could not.
- Distinguish real-time from retrospective data and address the recall/hindsight risks of each.
- The output is a process model figure plus the analytic account that earns it.
Branch C — Quantitative analysis
- Main models match the design (FE/RE, event-history, multilevel, network); standard errors clustered at the right level.
- Robustness that targets the theory's threats — alternative measures, samples, specifications, endogeneity checks, modern staggered-DiD diagnostics if relevant — not a wall of tables that never address the real threat.
- Mechanism evidence. Don't stop at the reduced-form relationship; probe why (mediation/moderation or supplementary tests).
- Effect interpretation in organizational terms — magnitudes, not just significance.
Either branch — the "so what" of the evidence
- Tie every analytic result back to the mechanism and the theoretical puzzle.
- Distinguish what the data can and cannot establish — overclaiming is a fast OS rejection.
- Prepare exhibits jointly with
orgstud-tables-figures.
Execution bridge (StatsPAI / Stata MCP)
Run the battery, don't just enumerate it. Full map:
execution-with-mcp. Organization Studies is largely qualitative/theoretical; use the chain below only for its quantitative-empirical papers, and say so when a study is interpretive.
- Many outcomes / specifications:
romano_wolf (step-down FWER) or
benjamini_hochberg — report the adjusted threshold.
- OVB sensitivity:
oster_delta / sensemakr.
- Inference:
wild_cluster_bootstrap (few clusters), twoway_cluster / conley;
multilevel data → cluster at the right level.
- Re-fit off one handle:
audit_result(result_id) lists the missing checks and the
exact suggest_function for each.
- Exhibits:
etable / did_summary_to_latex from the handle — no retyped numbers.
Keep the decisive checks in the body and the exhaustive battery in the appendix. See the
executed chain in the JF execution walkthrough.
Checklist
Anti-patterns
- "Anecdotal" qualitative work: cherry-picked quotes with no coding transparency
- Quotes that illustrate a pre-set conclusion rather than generating/supporting it
- A process "model" that is really a narrative with no analytic structure or transition logic
- Robustness theater: many tables that never address the real identification threat
- Reporting significance with no interpretation of organizational magnitude
- Overclaiming causality or generalizability beyond what the design supports
Output format
【Branch】qualitative / process / quantitative
【Data-to-theory link】data structure / process strategy / mechanism tests done
【Key evidence】power quotes, the process model, or main estimates
【Trustworthiness/robustness】checks completed + gaps (negative cases, clustering, alt explanations)
【What evidence cannot show】explicit limits
【Next skill】orgstud-contribution-framing
Source: brycewang-stanford/Awesome-Journal-Skills → Organization-Studies-Skills/skills/orgstud-data-analysis/SKILL.md
1---2name: orgstud-data-analysis3description: Use when executing and reporting the analysis for an Organization Studies (OS) manuscript — qualitative coding and the data-to-theory ladder, process analysis, or quantitative estimation and robustness. Makes the evidence-to-theory link transparent; it does not design the study (see orgstud-methods).4---567# Data Analysis & Evidence (orgstud-data-analysis)89## When to trigger1011- You have data but the path from raw material to theory is opaque12- Qualitative: your quotes are decorative, not evidentiary; the coding is undocumented13- Process: you have events but no visible analytic structure turning them into a model14- Quantitative: main results exist but robustness and alternative explanations are thin15- A reviewer asks "how did you get from your data to these constructs?"1617## OS expects readers to *see* how data became theory1819OS's interpretive, European tradition makes **analytic transparency** a first-class criterion — qualitative rigor is judged on its own terms, not against a quantitative yardstick. The reader must be able to *audit the inference* from raw data to theoretical claim. Make the analytic ladder visible.2021## Branch A — Qualitative analysis (the data-to-theory ladder)2223- **Transparent coding.** Show first-order codes (informant terms), second-order themes (researcher constructs), and aggregate dimensions — the **Gioia data structure** — or an equivalent (Eisenhardt cross-case tables, Langley process bracketing). State who coded, how disagreements were resolved, and how iteration with theory proceeded.24- **Data-to-theory table.** A table linking representative raw evidence → codes → constructs, so the inference is auditable (build it with `orgstud-tables-figures`).25- **Power quotes vs. proof quotes.** A few vivid "power quotes" in the body carry the argument; corroborating "proof quotes" sit in tables/appendix. Quotes must *carry* the claim, not illustrate a conclusion reached elsewhere.26- **Evidence for each construct.** Every construct backed by patterned evidence across informants/cases, with prevalence where appropriate.27- **Negative cases.** Report disconfirming instances and how they refined the theory — central to trustworthiness at OS.28- **Process display.** For process theory, show the temporal/event structure (timeline, phase model, visual mapping); make the transitions between phases analytically explicit, not just narrated.2930## Branch B — Process analysis (when the contribution is a process model)3132- Choose a **process strategy** explicitly: narrative, temporal bracketing, visual mapping, grounded theory, or alternate templates (Langley). Say why it fits.33- Identify **events, sequences, and turning points**; show what triggers each transition and what each phase accomplishes that the prior could not.34- Distinguish **real-time** from **retrospective** data and address the recall/hindsight risks of each.35- The output is a **process model figure** plus the analytic account that earns it.3637## Branch C — Quantitative analysis3839- **Main models** match the design (FE/RE, event-history, multilevel, network); standard errors clustered at the right level.40- **Robustness that targets the theory's threats** — alternative measures, samples, specifications, endogeneity checks, modern staggered-DiD diagnostics if relevant — not a wall of tables that never address the real threat.41- **Mechanism evidence.** Don't stop at the reduced-form relationship; probe *why* (mediation/moderation or supplementary tests).42- **Effect interpretation in organizational terms** — magnitudes, not just significance.4344## Either branch — the "so what" of the evidence4546- Tie every analytic result back to the mechanism and the theoretical puzzle.47- Distinguish what the data *can* and *cannot* establish — overclaiming is a fast OS rejection.48- Prepare exhibits jointly with `orgstud-tables-figures`.4950## Execution bridge (StatsPAI / Stata MCP)5152Run the battery, don't just enumerate it. Full map:53[`execution-with-mcp`](../../../shared-resources/empirical-methods/execution-with-mcp.md). Organization Studies is largely qualitative/theoretical; use the chain below only for its quantitative-empirical papers, and say so when a study is interpretive.5455- **Many outcomes / specifications:** `romano_wolf` (step-down FWER) or56 `benjamini_hochberg` — report the adjusted threshold.57- **OVB sensitivity:** `oster_delta` / `sensemakr`.58- **Inference:** `wild_cluster_bootstrap` (few clusters), `twoway_cluster` / `conley`;59 multilevel data → cluster at the right level.60- **Re-fit off one handle:** `audit_result(result_id)` lists the missing checks and the61 exact `suggest_function` for each.62- **Exhibits:** `etable` / `did_summary_to_latex` from the handle — no retyped numbers.6364Keep the decisive checks in the body and the exhaustive battery in the appendix. See the65executed chain in the [JF execution walkthrough](../../../Journal-of-Finance-Skills/resources/worked-examples/02-execution-walkthrough.md).66## Checklist6768- [ ] Qual: data structure (first-order → second-order → dimensions) documented69- [ ] Qual: a data-to-theory / evidence table built; quotes carry (not decorate) claims70- [ ] Qual: negative cases reported and used to refine the theory71- [ ] Process: process strategy named; turning points and transitions made explicit72- [ ] Quant: SEs clustered appropriately; robustness targets the theory's threats; magnitudes interpreted73- [ ] Mechanism is probed, not just the headline relationship74- [ ] Claims are matched to what the evidence can actually support7576## Anti-patterns7778- "Anecdotal" qualitative work: cherry-picked quotes with no coding transparency79- Quotes that illustrate a pre-set conclusion rather than generating/supporting it80- A process "model" that is really a narrative with no analytic structure or transition logic81- Robustness theater: many tables that never address the real identification threat82- Reporting significance with no interpretation of organizational magnitude83- Overclaiming causality or generalizability beyond what the design supports8485## Output format8687```text88【Branch】qualitative / process / quantitative89【Data-to-theory link】data structure / process strategy / mechanism tests done90【Key evidence】power quotes, the process model, or main estimates91【Trustworthiness/robustness】checks completed + gaps (negative cases, clustering, alt explanations)92【What evidence cannot show】explicit limits93【Next skill】orgstud-contribution-framing94```9596---9798**Source:** [`brycewang-stanford/Awesome-Journal-Skills`](https://github.com/brycewang-stanford/Awesome-Journal-Skills) → `Organization-Studies-Skills/skills/orgstud-data-analysis/SKILL.md`