Session Corpus Audit

Session Corpus Audit

Analyze session signals to identify quality trends and waste patterns.

Data source

Session signals live at .Codex/state/session-signals/YYYY-MM-DD.jsonl. Each line is a JSON object with: session_id, transcript_path, cwd, permission_mode, hook_event_name, stop_hook_active, last_assistant_message.

Audit procedure

1. Collect recent signals

# Last 7 days of session signals
for f in $(ls -t .Codex/state/session-signals/*.jsonl | head -7); do
  echo "=== $(basename $f) ==="
  wc -l "$f"
  cat "$f"
done

2. Identify high-churn sessions

• Sessions that fired multiple Stop hooks (restarts/crashes)
• Sessions with last_assistant_message indicating errors or blocks
• Sessions ending with permission denials

3. Estimate tool-call volume

• Check .Codex/state/session-governor/tool-call-count for daily totals
• Flag any day exceeding 500 tool calls (potential runaway session)

4. Detect recurring patterns

• Same error messages across sessions (systemic issues)
• Sessions that ended mid-task (unreleased wip labels, uncommitted changes)
• Permission mode patterns (bypassPermissions vs default)

5. Produce quality report

Output a markdown report with:

• Session count by day (last 7 days)
• High-churn sessions with root cause
• Recurring error patterns
• Waste estimate (sessions that produced no commits)
• Recommendations for workflow improvement

When to use

• Weekly quality review
• After a day with many session restarts
• When investigating tool-call ceiling hits