Comprehensiveness & Balance (arsoc-comprehensiveness-and-balance)
When to trigger
- The framework is set and you are filling cells with the literature
- You are unsure whether to cite everything or curate
- The subfield has rival theoretical schools, a live debate, or conflicting empirical findings
- You are a contributor to this literature and worry the review tilts toward your own work or method
Completeness vs. selectivity: the ARSoc contract
An ARSoc review must be comprehensive in coverage yet selective in emphasis. The reader should trust that nothing important is missing, while the prose foregrounds what matters. Resolve the tension by tiering the corpus:
| Tier |
Treatment |
| Foundational / field-defining |
discussed in the text, with what they established and their limits |
| Important contributions |
grouped and weighed within the framework's cells; cited with their finding |
| Confirmatory / incremental |
cited in clusters ("see also …") to demonstrate coverage without bloating prose |
| Tangential |
cited only where they bear on a specific claim; not every adjacent study belongs |
Comprehensiveness is proven by the citation set (the saturation log from arsoc-literature-synthesis); selectivity is exercised in the prose. A review that discusses every study at equal length has abdicated the editorial judgment that is its value.
Fairness across schools, methods, authors, and findings
ARSoc is the survey of record for a subfield: its account of a debate becomes the discipline's shared reference. That obliges genuine even-handedness:
- Steelman every camp. State each theoretical school's strongest case in terms its proponents would accept before noting its weaknesses. Refute positions at their best, never at their worst.
- Respect methodological pluralism. Sociology runs on quantitative, qualitative, computational, and theoretical traditions; weigh ethnographic and interpretive evidence on its own terms rather than measuring it against a regression yardstick (or vice versa). Dismissing a whole mode is a classic ARSoc balance failure.
- Weigh, don't tally. Conflicting results are reconciled by credibility (design, data, transparency) and by what each studies, not by vote-counting "7 studies find positive, 4 negative."
- Attribute ideas correctly. Credit originators, not just popularizers; this is a recurring referee complaint, sharpened in a discipline attentive to whose contributions get erased.
- Handle live debates without resolving by fiat. Lay out the disagreement, what evidence would settle it, and where the author's own read sits — labelled as the author's read, not as consensus.
The self-citation trap
If you have published in the subfield, the review must not read as a retrospective of your program. Guardrails:
- Your own work is cited at the tier its importance to the field warrants — no more.
- Rival schools and rival methods to your own are given their strongest statement.
- A reader who does not know who wrote the review cannot tell from the emphasis or the method mix.
- When the field disagrees with you, say so plainly and represent the other side fairly.
Checklist
Anti-patterns
- Comprehensiveness theatre: equal-length summaries of every study (no editorial judgment)
- Vote-counting conflicting results instead of weighing credibility and what-is-studied
- Privileging quantitative findings and treating qualitative/interpretive work as decorative (or the reverse)
- Strawmanning the school the author disagrees with
- A review that doubles as the author's CV (the most-punished ARSoc balance failure)
- Declaring a live debate "resolved" by assertion rather than by laying out the evidentiary state
- Crediting the popularizer of an idea over its originator
Output format
【Tiering】corpus split foundational/important/confirmatory/tangential? Y/N
【Comprehensiveness evidence】saturation log + citation set support "nothing important missing"? Y/N
【Steelman】each rival school stated at its strongest? Y/N
【Method balance】quant/qual/computational/theoretical each weighed fairly? Y/N
【Conflict handling】reconciled by credibility + what-is-studied (not vote-count)? Y/N
【Debate】evidence-to-settle stated; author's read labelled? Y/N
【Self-citation audit】own work at warranted tier; emphasis identity-blind? Y/N
【Next step】→ arsoc-tables-figures (who-found-what tables + conceptual figure)
Source: brycewang-stanford/Awesome-Journal-Skills → Annual-Review-of-Sociology-Skills/skills/arsoc-comprehensiveness-and-balance/SKILL.md
1---2name: arsoc-comprehensiveness-and-balance3description: Use when calibrating completeness vs. selectivity and ensuring fairness across theoretical schools, methods, authors, and debates in an Annual Review of Sociology (ARSoc) review — including not over-promoting the author's own work. Audits coverage and even-handedness; it does not design the framework (arsoc-organizing-framework) or write prose (arsoc-writing-style).4---5
6
7# Comprehensiveness & Balance (arsoc-comprehensiveness-and-balance)
8
9## When to trigger
10
11- The framework is set and you are filling cells with the literature
12- You are unsure whether to cite *everything* or curate
13- The subfield has rival theoretical schools, a live debate, or conflicting empirical findings
14- You are a contributor to this literature and worry the review tilts toward your own work or method
15
16## Completeness vs. selectivity: the ARSoc contract
17
18An ARSoc review must be **comprehensive in coverage** yet **selective in emphasis**. The reader should trust that nothing important is missing, while the prose foregrounds what matters. Resolve the tension by **tiering** the corpus:
19
20| Tier | Treatment |
21|------|-----------|
22| **Foundational / field-defining** | discussed in the text, with what they established and their limits |
23| **Important contributions** | grouped and weighed within the framework's cells; cited with their finding |
24| **Confirmatory / incremental** | cited in clusters ("see also …") to demonstrate coverage without bloating prose |
25| **Tangential** | cited only where they bear on a specific claim; not every adjacent study belongs |
26
27Comprehensiveness is proven by the *citation set* (the saturation log from `arsoc-literature-synthesis`); selectivity is exercised in the *prose*. A review that discusses every study at equal length has abdicated the editorial judgment that is its value.
28
29## Fairness across schools, methods, authors, and findings
30
31ARSoc is the **survey of record** for a subfield: its account of a debate becomes the discipline's shared reference. That obliges genuine even-handedness:
32
33- **Steelman every camp.** State each theoretical school's strongest case in terms its proponents would accept *before* noting its weaknesses. Refute positions at their best, never at their worst.
34- **Respect methodological pluralism.** Sociology runs on quantitative, qualitative, computational, and theoretical traditions; weigh ethnographic and interpretive evidence on its own terms rather than measuring it against a regression yardstick (or vice versa). Dismissing a whole mode is a classic ARSoc balance failure.
35- **Weigh, don't tally.** Conflicting results are reconciled by *credibility* (design, data, transparency) and by *what each studies*, not by vote-counting "7 studies find positive, 4 negative."
36- **Attribute ideas correctly.** Credit originators, not just popularizers; this is a recurring referee complaint, sharpened in a discipline attentive to whose contributions get erased.
37- **Handle live debates without resolving by fiat.** Lay out the disagreement, what evidence would settle it, and where the author's own read sits — labelled as the author's read, not as consensus.
38
39## The self-citation trap
40
41If you have published in the subfield, the review must **not** read as a retrospective of your program. Guardrails:
42
43- Your own work is cited at the tier its *importance to the field* warrants — no more.
44- Rival schools and rival methods to your own are given their strongest statement.
45- A reader who does not know who wrote the review cannot tell from the emphasis or the method mix.
46- When the field disagrees with you, say so plainly and represent the other side fairly.
47
48## Checklist
49
50- [ ] Corpus tiered (foundational / important / confirmatory / tangential); prose emphasis matches tier
51- [ ] Comprehensiveness provable from the citation set + saturation log
52- [ ] Every rival school stated at its strongest before critique (steelman)
53- [ ] Quantitative, qualitative, computational, and theoretical traditions each weighed on their own terms
54- [ ] Conflicting findings reconciled by credibility and what-is-studied, not vote-counting
55- [ ] Idea attribution traces to originators
56- [ ] Live debates presented with what evidence would settle them; author's read labelled as such
57- [ ] Self-citation audited: own work at field-warranted tier; rivals/other methods steelmanned; emphasis identity-blind
58- [ ] No important author/school/method an informed referee could say was slighted or omitted
59
60## Anti-patterns
61
62- Comprehensiveness theatre: equal-length summaries of every study (no editorial judgment)
63- Vote-counting conflicting results instead of weighing credibility and what-is-studied
64- Privileging quantitative findings and treating qualitative/interpretive work as decorative (or the reverse)
65- Strawmanning the school the author disagrees with
66- A review that doubles as the author's CV (the most-punished ARSoc balance failure)
67- Declaring a live debate "resolved" by assertion rather than by laying out the evidentiary state
68- Crediting the popularizer of an idea over its originator
69
70## Output format
71
72```text
73【Tiering】corpus split foundational/important/confirmatory/tangential? Y/N
74【Comprehensiveness evidence】saturation log + citation set support "nothing important missing"? Y/N
75【Steelman】each rival school stated at its strongest? Y/N
76【Method balance】quant/qual/computational/theoretical each weighed fairly? Y/N
77【Conflict handling】reconciled by credibility + what-is-studied (not vote-count)? Y/N
78【Debate】evidence-to-settle stated; author's read labelled? Y/N
79【Self-citation audit】own work at warranted tier; emphasis identity-blind? Y/N
80【Next step】→ arsoc-tables-figures (who-found-what tables + conceptual figure)
81```
82
83---
84
85**Source:** [`brycewang-stanford/Awesome-Journal-Skills`](https://github.com/brycewang-stanford/Awesome-Journal-Skills) → `Annual-Review-of-Sociology-Skills/skills/arsoc-comprehensiveness-and-balance/SKILL.md`
thedixitjain