SIGMETRICS Topic Selection
Decide the venue and track before drafting. SIGMETRICS — the ACM flagship for performance
measurement, modeling, and evaluation of computer systems — rewards a rigorous
performance-evaluation contribution: a stochastic/queueing model with a proven bound, a
principled measurement study, or a learning-for-systems algorithm with guarantees. A
technically strong paper whose real lesson is a built system (route to NSDI/OSDI), a pure network
measurement (route to IMC), or a learning-theory result with no systems payoff (route to
NeurIPS/COLT) is respected and then rejected as out of scope.
The routing question that matters most
The decisive question is rarely "is this about systems performance?" but "is the contribution an
analyzed/measured performance result, or is it something else with performance numbers attached?"
SIGMETRICS wants the why — a model, a proof, a validated methodology — not only a faster system or
a bigger dataset.
Sibling-venue routing table
| Signal in your project |
Better home |
Why |
| A model/policy with a proven performance bound, or a principled measurement/modeling study |
ACM SIGMETRICS |
Its center: rigorous performance evaluation published in POMACS |
| The contribution is a built system; the design/implementation is the point |
NSDI / OSDI / SIGCOMM |
Systems-building venues; SIGMETRICS wants analysis, not a system artifact |
| The whole paper is network measurement (Internet, CDN, topology, traffic) |
IMC |
The dedicated network-measurement venue; single annual deadline |
| Networking with a systems/protocol contribution |
SIGCOMM / NSDI / INFOCOM |
Networking-systems scope |
| A learning-theory result with no systems performance payoff |
NeurIPS / ICML / COLT |
Learning venues; SIGMETRICS Learning track wants a systems angle or systems-relevant guarantees |
| A study too long/deep for 20 pages, or wanting multiple revision rounds |
Performance Evaluation / TON / QUESTA |
Journals with no conference page ceiling and open-ended revision |
Contribution shapes SIGMETRICS rewards
- Stochastic / queueing / scheduling theory — a model of a system's performance with a proven
bound, stability condition, or optimality result, validated numerically (the SOAP lineage).
- Measurement & applied modeling — a principled measurement or simulation methodology and the
characterization it yields about a real system (the Google-Play-study lineage).
- Learning for systems — an online-learning/bandit/RL/control algorithm for a systems problem,
with regret/convergence/sample-complexity guarantees (the learning-to-rank lineage).
- Operational systems — a deployed system in significant real-world use, analyzed with
principled measurement and metrics (the Operational Systems Track; may name the system/org).
The rigor and validation tests
Two quick tests sharpen a borderline verdict:
- Rigor test: does the contribution carry a checkable claim — a theorem, a stated-assumption
bound, a measurement methodology a skeptic would accept — or only "it is faster on our setup"? If
the latter, it is a systems-building paper (NSDI/OSDI), not SIGMETRICS.
- Model-swap / methodology test: if your paper leans on a learner or a specific system, ask
whether the performance-evaluation lesson survives — a guarantee, a validated model, a general
methodology. If the only result is a benchmark score, it is an ML or systems paper wearing a
SIGMETRICS title.
Picking the track (do this at abstract registration)
- Theory: the core is a proof (queueing, scheduling, caching, algorithms, control).
- Measurement & Applied Modeling: the core is data from a real system + a methodology/model.
- Learning: the core is a learning algorithm with analysis, applied to or for systems.
- Operational Systems: the core is a deployed, in-use system; you may reveal its name/org.
Pick one; a second only for genuinely interdisciplinary work (e.g. a learning-theoretic result
validated by measurement). The wrong track routes you to the wrong reviewers.
Cheap reconnaissance before committing
[Scope] scan the last few POMACS issues (dblp, ACM DL) for your subarea and track
-> several recent papers = a reviewer pool exists; none = opening or mismatch
[Rigor] does your headline claim reduce to a theorem, a validated model, or a principled
measurement? -> if not, reconsider SIGMETRICS vs. a systems venue
[Calendar] the next rolling deadline (summer/fall/winter) is ~a quarter away -> route to the
nearest honest fit rather than forcing a rushed proof/measurement
Decision procedure
[Audience] who acts differently if the claim holds? -> systems designers/operators/theorists?
[Claim type] queueing/theory / measurement / learning-with-guarantees / operational
[Rigor gate] is there a checkable performance claim (proof / validated model / methodology)?
[Sibling check] built system -> NSDI/OSDI; pure net-measurement -> IMC; learning-theory-only -> NeurIPS
[Verdict] SIGMETRICS <track> / sibling venue / performance journal, with a one-line reason
Run this before the writing skills; a wrong venue or track decision wastes every later step. When
the verdict is SIGMETRICS, continue with sigmetrics-workflow for the deadline choice and
sigmetrics-writing-style for the paper shape.
1---2name: sigmetrics-topic-selection3description: Use when deciding whether a computer-systems performance project belongs at ACM SIGMETRICS or should be routed to IMC, SIGCOMM/NSDI/OSDI, INFOCOM, a learning venue (NeurIPS/ICML), or a performance journal (Performance Evaluation/TON/QUESTA), and when picking the right SIGMETRICS track (Theory / Measurement & Applied Modeling / Learning / Operational Systems).4metadata:5 source: https://skillmd.com/skills/brycewang-stanford/sigmetrics-topic-selection6---78# SIGMETRICS Topic Selection910Decide the venue and track before drafting. SIGMETRICS — the ACM flagship for **performance11measurement, modeling, and evaluation of computer systems** — rewards a **rigorous12performance-evaluation contribution**: a stochastic/queueing model with a **proven bound**, a13**principled measurement study**, or a **learning-for-systems** algorithm with guarantees. A14technically strong paper whose real lesson is a *built system* (route to NSDI/OSDI), a *pure network15measurement* (route to IMC), or a *learning-theory result with no systems payoff* (route to16NeurIPS/COLT) is respected and then rejected as out of scope.1718## The routing question that matters most1920The decisive question is rarely "is this about systems performance?" but **"is the contribution an21analyzed/measured performance result, or is it something else with performance numbers attached?"**22SIGMETRICS wants the *why* — a model, a proof, a validated methodology — not only a faster system or23a bigger dataset.2425## Sibling-venue routing table2627| Signal in your project | Better home | Why |28|---|---|---|29| A model/policy with a **proven performance bound**, or a principled measurement/modeling study | **ACM SIGMETRICS** | Its center: rigorous performance evaluation published in POMACS |30| The contribution is a **built system**; the design/implementation is the point | **NSDI / OSDI / SIGCOMM** | Systems-building venues; SIGMETRICS wants analysis, not a system artifact |31| The whole paper is **network measurement** (Internet, CDN, topology, traffic) | **IMC** | The dedicated network-measurement venue; single annual deadline |32| Networking with a systems/protocol contribution | **SIGCOMM / NSDI / INFOCOM** | Networking-systems scope |33| A **learning-theory** result with no systems performance payoff | **NeurIPS / ICML / COLT** | Learning venues; SIGMETRICS Learning track wants a systems angle or systems-relevant guarantees |34| A study too long/deep for 20 pages, or wanting multiple revision rounds | **Performance Evaluation / TON / QUESTA** | Journals with no conference page ceiling and open-ended revision |3536## Contribution shapes SIGMETRICS rewards3738- **Stochastic / queueing / scheduling theory** — a model of a system's performance with a proven39 bound, stability condition, or optimality result, validated numerically (the SOAP lineage).40- **Measurement & applied modeling** — a principled measurement or simulation methodology and the41 characterization it yields about a real system (the Google-Play-study lineage).42- **Learning for systems** — an online-learning/bandit/RL/control algorithm for a systems problem,43 with **regret/convergence/sample-complexity guarantees** (the learning-to-rank lineage).44- **Operational systems** — a deployed system in significant real-world use, analyzed with45 principled measurement and metrics (the Operational Systems Track; may name the system/org).4647## The rigor and validation tests4849Two quick tests sharpen a borderline verdict:5051- **Rigor test:** does the contribution carry a *checkable* claim — a theorem, a stated-assumption52 bound, a measurement methodology a skeptic would accept — or only "it is faster on our setup"? If53 the latter, it is a systems-building paper (NSDI/OSDI), not SIGMETRICS.54- **Model-swap / methodology test:** if your paper leans on a learner or a specific system, ask55 whether the *performance-evaluation* lesson survives — a guarantee, a validated model, a general56 methodology. If the only result is a benchmark score, it is an ML or systems paper wearing a57 SIGMETRICS title.5859## Picking the track (do this at abstract registration)6061- **Theory:** the core is a proof (queueing, scheduling, caching, algorithms, control).62- **Measurement & Applied Modeling:** the core is data from a real system + a methodology/model.63- **Learning:** the core is a learning algorithm with analysis, applied to or for systems.64- **Operational Systems:** the core is a deployed, in-use system; you may reveal its name/org.6566Pick **one**; a second only for genuinely interdisciplinary work (e.g. a learning-theoretic result67validated by measurement). The wrong track routes you to the wrong reviewers.6869## Cheap reconnaissance before committing7071```text72[Scope] scan the last few POMACS issues (dblp, ACM DL) for your subarea and track73 -> several recent papers = a reviewer pool exists; none = opening or mismatch74[Rigor] does your headline claim reduce to a theorem, a validated model, or a principled75 measurement? -> if not, reconsider SIGMETRICS vs. a systems venue76[Calendar] the next rolling deadline (summer/fall/winter) is ~a quarter away -> route to the77 nearest honest fit rather than forcing a rushed proof/measurement78```7980## Decision procedure8182```text83[Audience] who acts differently if the claim holds? -> systems designers/operators/theorists?84[Claim type] queueing/theory / measurement / learning-with-guarantees / operational85[Rigor gate] is there a checkable performance claim (proof / validated model / methodology)?86[Sibling check] built system -> NSDI/OSDI; pure net-measurement -> IMC; learning-theory-only -> NeurIPS87[Verdict] SIGMETRICS <track> / sibling venue / performance journal, with a one-line reason88```8990Run this before the writing skills; a wrong venue or track decision wastes every later step. When91the verdict is SIGMETRICS, continue with `sigmetrics-workflow` for the deadline choice and92`sigmetrics-writing-style` for the paper shape.