COLM Skills

A 12-skill depth pack for COLM (Conference on Language Modeling) submissions: venue routing for LM research, the March abstract/paper deadlines, 9-page format, OpenReview rebuttal, contamination-aware evaluation, API-model reproducibility, compute disclosure, camera-ready, and conference planning. Grounded in COLM 2026 official pages checked on 2026-07-08.

by @brycewang-stanford 11 skills

Skills in this plugin

11
  1. Colm Submission · brycewang-stanford
    Use when preparing or auditing a COLM submission on OpenReview — the late-March abstract and full-paper deadlines, the strict 9-page main text, double-blind rules banning acknowledgments and identity links, the Code of Ethics acknowledgment, LLM-usage disclosure, reciprocal-reviewer nomination, and pre-upload risk triage.
    1k repo stars
  2. Colm Experiments · brycewang-stanford
    Use when designing or auditing the empirical core of a COLM paper — contamination analysis for evaluation data, fair baselines under matched prompting and compute, pinned model versions and decoding parameters, uncertainty over runs and samples, scaling coverage, and honest reporting of API-model comparisons.
    1k repo stars
  3. Colm Camera Ready · brycewang-stanford
    Use when converting a COLM acceptance into the final paper — the August 7 camera-ready deadline in 2026, de-anonymization and the one-page acknowledgments allowance, folding rebuttal commitments into the text, publishing on OpenReview, releasing artifacts publicly, and planning the October conference in San Francisco.
    1k repo stars
  4. Colm Related Work · brycewang-stanford
    Use when positioning a COLM paper inside the fastest-moving literature in ML — triaging arXiv-heavy citations, handling concurrent work fairly, citing model and dataset artifacts correctly, distinguishing COLM's three-edition archive from adjacent venues' archives, and keeping self-citation double-blind safe.
    1k repo stars
  5. Colm Supplementary · brycewang-stanford
    Use when deciding what goes into a COLM paper's appendices and supplementary material versus the strict 9-page main text — verbatim prompts, full evaluation configurations, per-task result tables, contamination analyses, human-evaluation protocols, and anonymized code/data packages that survive double-blind review.
    1k repo stars
  6. Colm Writing Style · brycewang-stanford
    Use when drafting or revising COLM paper prose — leading with a finding about language models rather than a leaderboard delta, scoping claims to tested models and scales, naming versions in text, keeping the 9-page main text self-sufficient, and matching the measured, analysis-forward voice of COLM's award lineage.
    1k repo stars
  7. Colm Review Process · brycewang-stanford
    Use when reasoning about how COLM reviews a paper — the OpenReview pipeline from late-March submission through the May review release, the May-June rebuttal window, July decisions, reciprocal-reviewing obligations, the LLM-use rules for reviewers, and how a three-edition-old venue's norms differ from mature conferences.
    1k repo stars
  8. Colm Author Response · brycewang-stanford
    Use when writing a COLM rebuttal in the OpenReview discussion phase — triaging reviews released in late May, running cache-based follow-up experiments inside the roughly two-and-a-half-week window, answering contamination and baseline-fairness objections with evidence, and writing for the area chair who decides in July.
    1k repo stars
  9. Colm Reproducibility · brycewang-stanford
    Use when hardening a COLM paper's reproducibility story — pinning open-weight checkpoints and tokenizers, handling API-model drift and deprecation honestly, versioning evaluation harnesses and prompts, disclosing compute, and writing availability statements that distinguish what is releasable from what is not.
    1k repo stars
  10. Colm Topic Selection · brycewang-stanford
    Use when deciding whether language-model research belongs at COLM or should route to ACL/EMNLP, ICLR, NeurIPS, ICML, or a workshop — applying the object-of-study test, matching against COLM's CFP lanes (training, data, evaluation, inference, safety), and weighing the trade-offs of a young venue before writing begins.
    1k repo stars
  11. Colm Artifact Evaluation · brycewang-stanford
    Use when packaging the artifacts of a COLM paper — model weights, training data, prompts, evaluation sets, and cached model outputs — for anonymous review and public post-acceptance release, navigating licenses, API terms-of-service limits, and the absence of a formal COLM artifact track.
    1k repo stars