SIGMETRICS Writing Style
Use this when revising the main paper. SIGMETRICS papers are POMACS journal articles read by
performance-evaluation specialists, so they need a precise performance contribution stated on the
first page and claims a reviewer can check. The failure this skill prevents is a paper that
reads like a systems demo (numbers, no model) or a theory paper with no systems relevance
(theorems, no validation).
Revision rules
- Lead with the performance contribution, stated rigorously: the systems-performance problem, a
precise metric (mean vs. tail latency, throughput, regret, energy), why current models/policies
fall short, the contribution (a model, policy, methodology — ideally with a proven bound), the
validation, and what changes for real systems.
- State assumptions where the result uses them. A theorem is only as strong as its assumptions;
name the arrival process, service distribution, independence, and stationarity your result needs,
and show they are plausible for the target system. Hidden assumptions are the fastest reject.
- Pair every quantitative claim with proportional evidence — a proof for an analytic claim, a
simulation whose curve matches the analysis, confidence intervals over repeated runs, effect
sizes for a comparison — not adjectives.
- Validate the model against measurement. The SIGMETRICS signature move is showing that the
analytic prediction and the measured/simulated data agree; a theorem with no validation, or a
measurement with no model, is half a paper.
- Respect the 20-page acmsmall budget as a design constraint. References are unlimited, but body
text, figures, and in-body appendices are not. A paper that only fits by shrinking the assumptions
or the validation is over-scoped.
- Maintain double-anonymity in self-citations, system names, trace provenance, and
acknowledgements (except in the Operational Systems Track).
Performance-evaluation paper skeleton
| Section |
Job it must do |
Common failure |
| Intro |
Problem, precise metric, inadequacy, contribution, validation preview, systems payoff — first page |
Leads with a trend and "improves performance," no metric or model |
| Model / System |
The model and its assumptions, stated precisely and justified |
Assumptions hidden or unjustified against the real workload |
| Analysis |
Theorems/bounds with proofs (full proofs in an appendix) |
A claimed bound with a hand-waved or incomplete proof |
| Validation |
Analysis-vs-simulation agreement; measurement of the real system |
A plot with no analytic comparison, or no confidence intervals |
| Evaluation |
Baselines, fairly tuned; the systems payoff on real workloads |
Untuned baseline; toy inputs; benchmark score as the whole result |
| Assumption validity / threats |
Where assumptions hold and where they are stressed |
Deferred or absent; no estimation-error / robustness discussion |
Sentence-level rewrites
| Draft pattern |
SIGMETRICS-safe rewrite |
| "Our policy significantly improves performance." |
"reduces p99 latency by X% (95% CI ...) over on , matching Thm. 1" |
| "We assume the standard queueing model." |
"We assume M/G/1 with service-time distribution fit to the trace (§5.1, QQ-plot Fig. 6)" |
| "The bound holds in general." |
"Thm. 1 holds under assumptions A1-A3; §6 quantifies degradation when A2 is violated" |
| "Simulation confirms our approach." |
"the analytic p99 curve lies within the simulated confidence intervals across three distributions (Fig. 4)" |
| "State-of-the-art results." |
Claim scoped to the metric, workload, and regime actually analyzed and measured |
Assumption-and-validation discipline
[Assumptions] list each (arrival, service, independence, stationarity); justify against the target
[Analysis] prove the bound; put full derivations in an appendix within the reviewed pages
[Validation] overlay analysis on simulation/measurement; report CIs and number of runs
[Robustness] quantify what happens when an assumption is stressed (estimation error, heavy tails)
-> a theorem, its assumptions, and its validation are one unit -- present them together
Vignette: compressing a proof-plus-measurement paper
A draft with three theorems, a long simulator description, and a sprawling measurement section: keep
all three theorem statements and their assumptions in the body, move full proofs to an appendix with
forward references, keep the one figure showing analysis-vs-simulation agreement and the table with
the trace-driven payoff, and cut redundant simulator detail to the artifact. The test of a good cut:
a reviewer should be able to answer "what is claimed, under what assumptions, and does the
measurement back it?" from the body alone.
Output format
[Writing diagnosis] clear / under-specified-assumptions / unvalidated / over-claimed / over-scoped
[First-page fix] <new framing leading with the precise performance contribution>
[Assumption audit] <assumption -> stated? justified against workload? where used?>
[Validation fix] <theorem/claim -> analysis-vs-measurement evidence to add>
[Anonymity edits] <system names / self-citations / trace provenance to rewrite>
Source: brycewang-stanford/Awesome-Journal-Skills → SIGMETRICS-Skills/skills/sigmetrics-writing-style/SKILL.md
1---2name: sigmetrics-writing-style3description: Use when revising an ACM SIGMETRICS paper for a rigorously stated performance contribution on the first page, explicit modeling assumptions and their validity, theorems paired with numerical/empirical validation, evidence proportional to the claim, double-anonymous wording, and disciplined use of the 20-page single-column acmsmall budget.4---567# SIGMETRICS Writing Style89Use this when revising the main paper. SIGMETRICS papers are POMACS journal articles read by10performance-evaluation specialists, so they need a **precise performance contribution stated on the11first page** and claims a reviewer can *check*. The failure this skill prevents is a paper that12reads like a systems demo (numbers, no model) or a theory paper with no systems relevance13(theorems, no validation).1415## Revision rules1617- **Lead with the performance contribution, stated rigorously:** the systems-performance problem, a18 precise metric (mean vs. tail latency, throughput, regret, energy), why current models/policies19 fall short, the contribution (a model, policy, methodology — ideally with a proven bound), the20 validation, and what changes for real systems.21- **State assumptions where the result uses them.** A theorem is only as strong as its assumptions;22 name the arrival process, service distribution, independence, and stationarity your result needs,23 and show they are plausible for the target system. Hidden assumptions are the fastest reject.24- **Pair every quantitative claim with proportional evidence** — a proof for an analytic claim, a25 simulation whose curve matches the analysis, confidence intervals over repeated runs, effect26 sizes for a comparison — not adjectives.27- **Validate the model against measurement.** The SIGMETRICS signature move is showing that the28 analytic prediction and the measured/simulated data agree; a theorem with no validation, or a29 measurement with no model, is half a paper.30- **Respect the 20-page acmsmall budget as a design constraint.** References are unlimited, but body31 text, figures, and in-body appendices are not. A paper that only fits by shrinking the assumptions32 or the validation is over-scoped.33- **Maintain double-anonymity** in self-citations, system names, trace provenance, and34 acknowledgements (except in the Operational Systems Track).3536## Performance-evaluation paper skeleton3738| Section | Job it must do | Common failure |39|---|---|---|40| Intro | Problem, precise metric, inadequacy, contribution, validation preview, systems payoff — first page | Leads with a trend and "improves performance," no metric or model |41| Model / System | The model and its **assumptions**, stated precisely and justified | Assumptions hidden or unjustified against the real workload |42| Analysis | Theorems/bounds with proofs (full proofs in an appendix) | A claimed bound with a hand-waved or incomplete proof |43| Validation | Analysis-vs-simulation agreement; measurement of the real system | A plot with no analytic comparison, or no confidence intervals |44| Evaluation | Baselines, fairly tuned; the systems payoff on real workloads | Untuned baseline; toy inputs; benchmark score as the whole result |45| Assumption validity / threats | Where assumptions hold and where they are stressed | Deferred or absent; no estimation-error / robustness discussion |4647## Sentence-level rewrites4849| Draft pattern | SIGMETRICS-safe rewrite |50|---|---|51| "Our policy significantly improves performance." | "reduces p99 latency by X% (95% CI ...) over <tuned baseline> on <workload>, matching Thm. 1" |52| "We assume the standard queueing model." | "We assume M/G/1 with service-time distribution fit to the trace (§5.1, QQ-plot Fig. 6)" |53| "The bound holds in general." | "Thm. 1 holds under assumptions A1-A3; §6 quantifies degradation when A2 is violated" |54| "Simulation confirms our approach." | "the analytic p99 curve lies within the simulated confidence intervals across three distributions (Fig. 4)" |55| "State-of-the-art results." | Claim scoped to the metric, workload, and regime actually analyzed and measured |5657## Assumption-and-validation discipline5859```text60[Assumptions] list each (arrival, service, independence, stationarity); justify against the target61[Analysis] prove the bound; put full derivations in an appendix within the reviewed pages62[Validation] overlay analysis on simulation/measurement; report CIs and number of runs63[Robustness] quantify what happens when an assumption is stressed (estimation error, heavy tails)64-> a theorem, its assumptions, and its validation are one unit -- present them together65```6667## Vignette: compressing a proof-plus-measurement paper6869A draft with three theorems, a long simulator description, and a sprawling measurement section: keep70all three theorem statements and their assumptions in the body, move full proofs to an appendix with71forward references, keep the one figure showing analysis-vs-simulation agreement and the table with72the trace-driven payoff, and cut redundant simulator detail to the artifact. The test of a good cut:73a reviewer should be able to answer "what is claimed, under what assumptions, and does the74measurement back it?" from the body alone.7576## Output format7778```text79[Writing diagnosis] clear / under-specified-assumptions / unvalidated / over-claimed / over-scoped80[First-page fix] <new framing leading with the precise performance contribution>81[Assumption audit] <assumption -> stated? justified against workload? where used?>82[Validation fix] <theorem/claim -> analysis-vs-measurement evidence to add>83[Anonymity edits] <system names / self-citations / trace provenance to rewrite>84```8586---8788**Source:** [`brycewang-stanford/Awesome-Journal-Skills`](https://github.com/brycewang-stanford/Awesome-Journal-Skills) → `SIGMETRICS-Skills/skills/sigmetrics-writing-style/SKILL.md`
thedixitjain