brycewang-stanford ICSE Review Process
Model the pipeline before you interpret any single review. ICSE's process differs from most CS conferences in one structural way: Major Revision is a real decision category, not a euphemism for rejection, and a large share of accepted papers arrive through it.
The four scored criteria
The ICSE 2027 call (read 2026-07-08) evaluates each paper on:
- Novelty — originality of solutions, problem formulations, methodologies, theories, or evaluations relative to the state of the art.
- Rigor — soundness, clarity, and depth of the technical or theoretical contribution, and thoroughness/completeness of the evaluation.
- Relevance — significance and potential impact on software engineering.
- Verifiability and Transparency — whether the paper contains enough information to understand how the innovation works, how data was obtained and analyzed, and whether independent verification or replication is supported.
Read every review comment as an instance of one of these. "The benchmark seems small" is a Rigor objection; "practitioners would not use this" is Relevance; "the prompt templates are not shown" is Verifiability. Diagnosing the criterion tells you whether the cure is new evidence, new framing, or new packaging.
Decision model and 2027 timeline
| Stage (2027 cycle) | Date | What happens |
|---|---|---|
| Submission closes | Jun 30, 2026 AoE | PC bidding and assignment follow |
| Author response | Sep 2026 | Authors see reviews and reply (format 待核实) |
| First decisions | Oct 20, 2026 | Accept / Major Revision / Reject |
| Revision due | Nov 17, 2026 | Revised paper + response for MR papers |
| Final MR decisions | Dec 18, 2026 | Accept or Reject, no second revision |
| Conference | Apr 25 – May 1, 2027 | Dublin; core days Apr 28–30 |
Two consequences. First, a Major Revision gives you roughly four weeks to execute — reviewers expect the revision plan to be feasible in that window, so promising a new user study is self-defeating. Second, the December decision is terminal for the cycle: there is no minor-revision escape hatch after it.
What the recent numbers say
ICSE 2026 (the last two-cycle year) reported, per its research-track pages:
Cycle 1 — 660 submissions, 60 direct accepts, 101 accepted after Major
Revision; Cycle 2 — 809 submissions, 72 direct accepts, 88 accepted after
Major Revision; 321 of 1,469 total (22%). The strategic reading: **direct
acceptance is rare (9%)** — the modal successful path runs through Major
Revision. Write the initial submission so that its weaknesses are revisable
(missing analysis, unclear framing) rather than structural (wrong population,
no baseline), because the process is built to reward repairable papers.
Who reads you
Reviews come from a large research-track Program Committee working double-anonymously; ICSE also runs a Shadow PC in some years (2027 posts one) where early-career researchers review in parallel for training — their reviews do not decide outcomes but signal how a non-expert reads your paper. Expect three reviews with SE-empiricist instincts: they will look for the threats-to- validity section, check whether claims outrun evidence, and often open the replication package.
Where author leverage exists
[Before submission] topic tags -> reviewer pool (largest lever)
[Author response] factual corrections, criterion-targeted evidence
[Major Revision] the strongest lever in the system: a tracked-change
revision + response letter reviewed by the same PC members
[After final reject] no appeal lane; reroute (FSE/ASE/ISSTA or journals)
Author response moves borderline papers when it corrects a factual misreading or supplies a number a reviewer said was missing. It does not move papers when it argues taste. Major Revision moves papers when every requested change is either made or explicitly declined with a reason — silent omissions are what turn December into a rejection.
Reading a review packet
Weight reviews before answering them. Look for: specificity — a review citing your section numbers and exact tables was read closely and will be read closely again in December; criterion coverage — a review that only discusses novelty has left rigor and verifiability to the others, so answer those reviewers on those axes; the question list — reviewers often end with explicit questions, and the September response is scored heavily on whether each got a direct answer. A short, vague, positive review is worth less protection than a long, critical, specific one: the latter's author is your likely advocate if the response holds up.
Misreadings to avoid
- Treating Major Revision as a soft accept. ICSE 2026's numbers show most MR papers do get in, but the December reject is real; budget the four weeks like a deadline, not a formality.
- Treating the response as a debate stage. The PC discussion after the response is where decisions form; your text is evidence for an advocate, not a closing argument to a jury.
- Assuming reviewer unanimity is required. Discussion consensus, guided by the criteria, decides — one enthusiastic champion with answers to the other reviews can carry a paper.
- Projecting the two-cycle rhythm forward. 2025 and 2026 ran two cycles; 2027 posts one. Never infer next year's calendar from last year's.
Output format
[Process stage] pre-submission / awaiting reviews / response / major revision / final
[Criterion map] each review point -> novelty | rigor | relevance | verifiability
[Decision forecast] direct accept / MR-likely / reject-risk, with reasons
[Leverage plan] what to do at the next stage that can actually change the outcome