Section Writing Agent (Step 4)
Faithful implementation of the Section Writing Agent from PaperOrchestra
(Song et al., 2026, arXiv:2604.05018, §4 Step 4, App. F.1 pp. 47–49).
Cost: ONE LLM call (App. B: "Section Writing Agent (1 call): A single,
comprehensive multimodal call to draft and compile the complete LaTeX
manuscript"). Do NOT split this into per-section calls — the paper
explicitly designs it as one comprehensive call so the model can maintain
global coherence across sections.
Inputs
workspace/outline.json — the master plan
workspace/inputs/idea.md — technical details
workspace/inputs/experimental_log.md — raw data for tables and qualitative analysis
workspace/drafts/intro_relwork.tex — the template with Intro + Related
Work already filled in by Step 3. This is your starting point. The
preamble, package list, style, and the two pre-filled sections must be
preserved verbatim.
workspace/citation_pool.json — the citation map ({key, title, abstract}
for each verified paper)
workspace/refs.bib — the BibTeX file
workspace/inputs/conference_guidelines.md — formatting rules
workspace/figures/ — the actual PNG files from Step 2 (used as
multimodal vision input!)
workspace/figures/captions.json — caption text per figure_id
workspace/tex_profile.json — TeX package availability flags (written by
check_tex_packages.py at Step 0). Read this before generating any
LaTeX. It tells you which packages are installed so you select the right
cross-reference pattern, font packages, etc. before you write — not after
you try to compile.
Output
workspace/drafts/paper.tex — the complete LaTeX paper, with all sections
filled. The Step 5 Refinement Agent will iterate on this file.
How to do it
0.5. Read tex_profile.json and select LaTeX patterns
Before composing the prompt, read workspace/tex_profile.json and apply
these rules to every LaTeX choice in the generated paper:
| Profile flag |
True → use |
False → use instead |
use_cleveref |
\cref{fig:X}, \cref{tab:Y} |
Figure~\ref{fig:X}, Table~\ref{tab:Y} |
use_nicefrac |
\nicefrac{a}{b} |
$a/b$ |
use_microtype |
\usepackage{microtype} |
omit the line |
use_t1_fontenc |
\usepackage[T1]{fontenc} |
omit the line |
If tex_profile.json does not exist (old workspace), default to the safe
fallback column (no cleveref, no nicefrac, no microtype, no T1 fontenc).
1. Pre-extract metrics from the experimental log
Run the deterministic helper:
python skills/section-writing-agent/scripts/extract_metrics.py \
--log workspace/inputs/experimental_log.md \
--out workspace/metrics.json
This parses the ## 2. Raw Numeric Data section's markdown tables into
structured JSON. The Section Writing Agent uses this to construct LaTeX
booktabs tables without re-deriving values from raw text. Read
references/latex-table-patterns.md for the booktabs conventions.
2. Compose the prompt and make ONE multimodal call
Load references/prompt.md (verbatim Section Writing Agent prompt from App.
F.1). Prepend the Anti-Leakage Prompt from
../paper-orchestra/references/anti-leakage-prompt.md.
The user message contains:
outline.json — full content
idea.md — full content
experimental_log.md — full content (tables AND prose)
intro_relwork.tex — full content (this becomes template.tex for the prompt)
citation_pool.json — full content (becomes citation_map.json)
conference_guidelines.md — full content
figures_list — array of {figure_id, filename, caption} from
captions.json and the file listing
- The actual figure PNGs as multimodal image inputs, so the model can
visually inspect them and write accurate descriptions / refer to them
correctly in the prose.
If your host LLM has no vision input, fall back to text-only mode: pass the
captions in captions.json as descriptions and tell the agent it cannot see
the images directly. Quality drops noticeably (the paper notes that visual
grounding measurably improves figure-text alignment), but the pipeline
still completes.
3. Save the output
The agent's response is wrapped in \``latex ... ```fences. Extract the LaTeX code and save toworkspace/drafts/paper.tex`.
4. Run the deterministic gates
# Orphan + fabrication gate: every \cite{KEY} must exist in refs.bib, AND every
# refs.bib entry must come from the verified citation_pool.json (no hand-written
# / fabricated references). Pass the pool as the 3rd arg whenever it exists.
python skills/section-writing-agent/scripts/orphan_cite_gate.py \
workspace/drafts/paper.tex workspace/refs.bib workspace/citation_pool.json
# Latex sanity: matched braces, matched begin/end, no unescaped specials
python skills/section-writing-agent/scripts/latex_sanity.py \
workspace/drafts/paper.tex
# Anti-leakage post-check: no author names, emails, affiliations
python skills/paper-orchestra/scripts/anti_leakage_check.py \
workspace/drafts/paper.tex
If any gate fails, re-prompt the writing call with the gate's error
report appended to the user message and ask the agent to fix the specific
issues. Do NOT try to fix the gate violations by hand — the model needs to
see its own mistakes.
Critical rules from the prompt
These are excerpted from references/prompt.md (App. F.1, pp. 47-49). The
host agent MUST honor them on the writing call:
Existing-content preservation
- DO NOT modify the text, style, or content of sections that are already
filled in
intro_relwork.tex. Preserve Intro + Related Work verbatim.
- Keep the preamble (packages, document class, style) exactly as is.
- Come up with a good title if one is missing. Fill author names if missing
(but the Anti-Leakage Prompt says not to invent real ones — use a
placeholder like "Anonymous Authors" for double-blind).
Data and tables
- Build LaTeX tables for the experimental results.
- Extract numeric values directly from
experimental_log.md. Do not
hallucinate numbers — use the exact values in the log.
- Use the
booktabs package format: \toprule, \midrule, \bottomrule.
- All tables must appear before the Conclusion section, unless they are
explicitly placed in an Appendix.
Citations
- The
outline.json provides citation_hints per subsection. For each hint,
find the matching key in citation_pool.json (by title or content) and
use that exact key in \cite{...}.
- Use ONLY keys from
refs.bib. Inventing or guessing keys violates the
Lit Review Agent's verified pool.
- Read the abstract from
citation_pool.json for the papers you cite.
Use the abstract context to write specific, accurate sentences about
those works — not generic "[A, B] proposed methods for X".
Writing content
- Write the missing sections following
outline.json's section_plan
structure exactly. Hierarchy rule: if 4.1 exists, 4.2 must exist.
- Use formal mathematical equations, notations, and definitions where
appropriate AND directly supported by
idea.md or experimental_log.md.
Do not hallucinate math. Do not use complex math just for the sake
of it.
- Always provide detailed ablation studies and qualitative analysis of the
experimental results: what worked, what does not, and why.
- Optional: discuss limitations and future work at the end.
- If you put anything in the Appendix, the Appendix section appears AFTER
the References section, on a fresh new page.
Figures and visual fidelity
- You are being given the actual image files of the figures. You MUST
describe them faithfully and accurately. Do NOT hallucinate
interpretations that contradict the visual evidence in the plots.
- Use ALL of the figures provided in
figures/. Use the exact filenames
including extensions (e.g., .png) in your \includegraphics commands.
- DO NOT merge or group multiple figures into one display.
- If the paper is in a 2-column format, prefer single-column figures
(
\begin{figure}) unless they are very wide.
- All figures must appear before the Conclusion section, unless explicitly
in the Appendix.
- Refine the captions if necessary, but they are already provided in
captions.json and should generally be used as-is.
- Do NOT include "Figure X" in the caption text — LaTeX handles numbering.
Style
- Adopt the tone of a top-tier ML conference paper: dense, objective,
technical.
- Match the indentation and spacing style of the original
template.tex.
Do not change the overall LaTeX style.
LaTeX integrity
- The output must compile flawlessly out-of-the-box.
- All
\begin{X} must match a \end{X} (e.g., \begin{figure*} must be
closed with \end{figure*}, not \end{figure}).
- DO NOT change
\usepackage[capitalize]{cleveref} to
\usepackage[capitalize]{cleverref} — there is no cleverref.sty.
- Always emit
\clearpage immediately before \bibliographystyle{...}.
Without it, figures deferred by LaTeX's float algorithm will appear inside
or after the References section — a hard-to-spot layout defect that only
shows up in the compiled PDF. \clearpage forces all pending floats to be
output before the bibliography starts. See
references/latex-table-patterns.md for details.
- Cross-references: prefer
Figure~\ref{fig:X} and Table~\ref{tab:Y}
over bare \ref{fig:X}. This is necessary when cleveref is unavailable
and produces readable prose in all cases. Use \cref{...} only when
cleveref.sty is confirmed present.
Output format
- Wrap the full updated
template.tex in \``latex ... ````.
- The previously empty sections should now be filled.
- Previously filled sections (Intro, Related Work) should remain mostly
untouched; only adjust for consistency purposes.
Resources
references/prompt.md — verbatim Section Writing Agent prompt from App. F.1
references/latex-table-patterns.md — booktabs rules + table-from-log examples
references/figure-integration.md — \includegraphics, 2-column handling, placement
scripts/extract_metrics.py — markdown tables in experimental_log → JSON
scripts/latex_sanity.py — unmatched braces, env mismatches, specials
scripts/orphan_cite_gate.py — every \cite{KEY} exists in refs.bib
1---2name: section-writing-agent3description: Step 4 of the PaperOrchestra pipeline (arXiv:2604.05018). ONE single multimodal LLM call that drafts the remaining paper sections (Abstract, Methodology, Experiments, Conclusion), extracts numeric values from experimental_log.md into LaTeX booktabs tables, splices the generated figures from Step 2, and merges everything into the template that already contains Intro + Related Work from Step 3. TRIGGER when the orchestrator delegates Step 4 or when the user asks to "write the methodology and experiments sections" or "fill in the rest of the paper".4---56# Section Writing Agent (Step 4)78Faithful implementation of the Section Writing Agent from PaperOrchestra9(Song et al., 2026, arXiv:2604.05018, §4 Step 4, App. F.1 pp. 47–49).1011**Cost: ONE LLM call** (App. B: "Section Writing Agent (1 call): A single,12comprehensive multimodal call to draft and compile the complete LaTeX13manuscript"). Do NOT split this into per-section calls — the paper14explicitly designs it as one comprehensive call so the model can maintain15global coherence across sections.1617## Inputs1819- `workspace/outline.json` — the master plan20- `workspace/inputs/idea.md` — technical details21- `workspace/inputs/experimental_log.md` — raw data for tables and qualitative analysis22- `workspace/drafts/intro_relwork.tex` — the template **with Intro + Related23 Work already filled in by Step 3**. This is your starting point. The24 preamble, package list, style, and the two pre-filled sections must be25 preserved verbatim.26- `workspace/citation_pool.json` — the citation map (`{key, title, abstract}`27 for each verified paper)28- `workspace/refs.bib` — the BibTeX file29- `workspace/inputs/conference_guidelines.md` — formatting rules30- `workspace/figures/` — the actual PNG files from Step 2 (used as31 multimodal vision input!)32- `workspace/figures/captions.json` — caption text per figure_id33- `workspace/tex_profile.json` — TeX package availability flags (written by34 `check_tex_packages.py` at Step 0). **Read this before generating any35 LaTeX.** It tells you which packages are installed so you select the right36 cross-reference pattern, font packages, etc. before you write — not after37 you try to compile.3839## Output4041- `workspace/drafts/paper.tex` — the complete LaTeX paper, with all sections42 filled. The Step 5 Refinement Agent will iterate on this file.4344## How to do it4546### 0.5. Read tex_profile.json and select LaTeX patterns4748Before composing the prompt, read `workspace/tex_profile.json` and apply49these rules to every LaTeX choice in the generated paper:5051| Profile flag | True → use | False → use instead |52|---|---|---|53| `use_cleveref` | `\cref{fig:X}`, `\cref{tab:Y}` | `Figure~\ref{fig:X}`, `Table~\ref{tab:Y}` |54| `use_nicefrac` | `\nicefrac{a}{b}` | `$a/b$` |55| `use_microtype` | `\usepackage{microtype}` | omit the line |56| `use_t1_fontenc` | `\usepackage[T1]{fontenc}` | omit the line |5758If `tex_profile.json` does not exist (old workspace), default to the safe59fallback column (no cleveref, no nicefrac, no microtype, no T1 fontenc).6061### 1. Pre-extract metrics from the experimental log6263Run the deterministic helper:6465```bash66python skills/section-writing-agent/scripts/extract_metrics.py \67 --log workspace/inputs/experimental_log.md \68 --out workspace/metrics.json69```7071This parses the `## 2. Raw Numeric Data` section's markdown tables into72structured JSON. The Section Writing Agent uses this to construct LaTeX73booktabs tables without re-deriving values from raw text. Read74`references/latex-table-patterns.md` for the booktabs conventions.7576### 2. Compose the prompt and make ONE multimodal call7778Load `references/prompt.md` (verbatim Section Writing Agent prompt from App.79F.1). Prepend the Anti-Leakage Prompt from80`../paper-orchestra/references/anti-leakage-prompt.md`.8182The user message contains:8384- `outline.json` — full content85- `idea.md` — full content86- `experimental_log.md` — full content (tables AND prose)87- `intro_relwork.tex` — full content (this becomes `template.tex` for the prompt)88- `citation_pool.json` — full content (becomes `citation_map.json`)89- `conference_guidelines.md` — full content90- `figures_list` — array of `{figure_id, filename, caption}` from91 `captions.json` and the file listing92- **The actual figure PNGs** as multimodal image inputs, so the model can93 visually inspect them and write accurate descriptions / refer to them94 correctly in the prose.9596If your host LLM has no vision input, fall back to text-only mode: pass the97captions in `captions.json` as descriptions and tell the agent it cannot see98the images directly. Quality drops noticeably (the paper notes that visual99grounding measurably improves figure-text alignment), but the pipeline100still completes.101102### 3. Save the output103104The agent's response is wrapped in `\`\`\`latex ... \`\`\`` fences. Extract105the LaTeX code and save to `workspace/drafts/paper.tex`.106107### 4. Run the deterministic gates108109```bash110# Orphan + fabrication gate: every \cite{KEY} must exist in refs.bib, AND every111# refs.bib entry must come from the verified citation_pool.json (no hand-written112# / fabricated references). Pass the pool as the 3rd arg whenever it exists.113python skills/section-writing-agent/scripts/orphan_cite_gate.py \114 workspace/drafts/paper.tex workspace/refs.bib workspace/citation_pool.json115116# Latex sanity: matched braces, matched begin/end, no unescaped specials117python skills/section-writing-agent/scripts/latex_sanity.py \118 workspace/drafts/paper.tex119120# Anti-leakage post-check: no author names, emails, affiliations121python skills/paper-orchestra/scripts/anti_leakage_check.py \122 workspace/drafts/paper.tex123```124125If any gate fails, **re-prompt the writing call** with the gate's error126report appended to the user message and ask the agent to fix the specific127issues. Do NOT try to fix the gate violations by hand — the model needs to128see its own mistakes.129130## Critical rules from the prompt131132These are excerpted from `references/prompt.md` (App. F.1, pp. 47-49). The133host agent MUST honor them on the writing call:134135### Existing-content preservation136137- DO NOT modify the text, style, or content of sections that are already138 filled in `intro_relwork.tex`. Preserve Intro + Related Work verbatim.139- Keep the preamble (packages, document class, style) **exactly** as is.140- Come up with a good title if one is missing. Fill author names if missing141 (but the Anti-Leakage Prompt says not to invent real ones — use a142 placeholder like "Anonymous Authors" for double-blind).143144### Data and tables145146- Build LaTeX tables for the experimental results.147- Extract numeric values directly from `experimental_log.md`. **Do not148 hallucinate numbers** — use the exact values in the log.149- Use the `booktabs` package format: `\toprule`, `\midrule`, `\bottomrule`.150- All tables must appear before the Conclusion section, unless they are151 explicitly placed in an Appendix.152153### Citations154155- The `outline.json` provides citation_hints per subsection. For each hint,156 find the matching key in `citation_pool.json` (by title or content) and157 use that exact key in `\cite{...}`.158- **Use ONLY keys from `refs.bib`.** Inventing or guessing keys violates the159 Lit Review Agent's verified pool.160- **Read the abstract** from `citation_pool.json` for the papers you cite.161 Use the abstract context to write specific, accurate sentences about162 those works — not generic "[A, B] proposed methods for X".163164### Writing content165166- Write the missing sections following `outline.json`'s `section_plan`167 structure exactly. Hierarchy rule: if 4.1 exists, 4.2 must exist.168- Use formal mathematical equations, notations, and definitions where169 appropriate AND directly supported by `idea.md` or `experimental_log.md`.170 **Do not hallucinate math.** Do not use complex math just for the sake171 of it.172- Always provide detailed ablation studies and qualitative analysis of the173 experimental results: what worked, what does not, and why.174- Optional: discuss limitations and future work at the end.175- If you put anything in the Appendix, the Appendix section appears AFTER176 the References section, on a fresh new page.177178### Figures and visual fidelity179180- You are being given the actual image files of the figures. You MUST181 describe them faithfully and accurately. Do NOT hallucinate182 interpretations that contradict the visual evidence in the plots.183- Use ALL of the figures provided in `figures/`. Use the exact filenames184 including extensions (e.g., `.png`) in your `\includegraphics` commands.185- DO NOT merge or group multiple figures into one display.186- If the paper is in a 2-column format, prefer single-column figures187 (`\begin{figure}`) unless they are very wide.188- All figures must appear before the Conclusion section, unless explicitly189 in the Appendix.190- Refine the captions if necessary, but they are already provided in191 `captions.json` and should generally be used as-is.192- Do NOT include "Figure X" in the caption text — LaTeX handles numbering.193194### Style195196- Adopt the tone of a top-tier ML conference paper: dense, objective,197 technical.198- Match the indentation and spacing style of the original `template.tex`.199 Do not change the overall LaTeX style.200201### LaTeX integrity202203- The output must compile flawlessly out-of-the-box.204- All `\begin{X}` must match a `\end{X}` (e.g., `\begin{figure*}` must be205 closed with `\end{figure*}`, not `\end{figure}`).206- DO NOT change `\usepackage[capitalize]{cleveref}` to207 `\usepackage[capitalize]{cleverref}` — there is no `cleverref.sty`.208- **Always emit `\clearpage` immediately before `\bibliographystyle{...}`.**209 Without it, figures deferred by LaTeX's float algorithm will appear inside210 or after the References section — a hard-to-spot layout defect that only211 shows up in the compiled PDF. `\clearpage` forces all pending floats to be212 output before the bibliography starts. See213 `references/latex-table-patterns.md` for details.214- **Cross-references**: prefer `Figure~\ref{fig:X}` and `Table~\ref{tab:Y}`215 over bare `\ref{fig:X}`. This is necessary when `cleveref` is unavailable216 and produces readable prose in all cases. Use `\cref{...}` only when217 `cleveref.sty` is confirmed present.218219### Output format220221- Wrap the full updated `template.tex` in `\`\`\`latex ... \`\`\``.222- The previously empty sections should now be filled.223- Previously filled sections (Intro, Related Work) should remain mostly224 untouched; only adjust for consistency purposes.225226## Resources227228- `references/prompt.md` — verbatim Section Writing Agent prompt from App. F.1229- `references/latex-table-patterns.md` — booktabs rules + table-from-log examples230- `references/figure-integration.md` — `\includegraphics`, 2-column handling, placement231- `scripts/extract_metrics.py` — markdown tables in experimental_log → JSON232- `scripts/latex_sanity.py` — unmatched braces, env mismatches, specials233- `scripts/orphan_cite_gate.py` — every `\cite{KEY}` exists in refs.bib