# Solver Benchmark Mandatory Checks Before Committing Reports

> Sub-skill of solver-benchmark: Mandatory Checks Before Committing Reports (+2).

- Skill: `vamseeachanta/solver-benchmark-mandatory-checks-before-committing-reports` (Agent Skill)
- Install (CLI): `npx skillmds@latest add vamseeachanta/solver-benchmark-mandatory-checks-before-committing-reports`
- Raw SKILL.md: https://api.skillmd.com/api/skills/vamseeachanta/solver-benchmark-mandatory-checks-before-committing-reports/raw
- Safety review: PASS (external: skill-scanner PASS, skillspector PASS)
- Works with: Claude Code, Claude.ai, OpenAI Codex
- Category: Coding & Dev Tools
- Author: vamseeachanta (https://skillmd.com/u/vamseeachanta)
- Updated: 2026-09-17
- Page: https://skillmd.com/skills/vamseeachanta/solver-benchmark-mandatory-checks-before-committing-reports

---


# Mandatory Checks Before Committing Reports (+2)

## Mandatory Checks Before Committing Reports


```
[ ] Master summary verdict matches individual report content
[ ] "Headings: N" shows the correct count (not 0 for cases with wave headings defined)
[ ] DOF plots contain actual data (not flat lines from empty heading arrays)
[ ] All physics sections present: hydrostatics, load RAOs, roll damping, mesh quality
[ ] Navigation links between combined report and per-body reports work
```

## Known Bug: `diff.headings` Returns Empty After `Calculate()`


**Affected cases**: `full_qtf` analysis type, certain bi-symmetric configurations, fixed-DOF bodies.

**Symptom**: Report header shows `Headings: 0 (°)` even though wave headings are
defined in spec.yml. DOF plots appear empty because heading data is missing.

**Root cause**: `OrcFxAPI.Diffraction.headings` may return an empty array after
`Calculate()` is called in memory. The property is only reliably populated after
`LoadResults()` from a saved `.owr` file.

**Workaround**: Pass the saved `.owr` path to the report generator via:

*See sub-skills for full details.*

## Regenerating Stale Reports


```bash
# Regenerate a single case (re-runs OrcaWave — takes ~30-120s)
uv run python scripts/benchmark/validate_owd_vs_spec.py --case 2.2

# Regenerate master summary only (fast — reads cached JSON, no OrcaWave run)
uv run python scripts/benchmark/validate_owd_vs_spec.py --summary-only

# Regenerate all cases (slow — runs OrcaWave for each)
uv run python scripts/benchmark/validate_owd_vs_spec.py --all
```