Atomic Unit Recall Aggregate

Aggregate per-unit ACU/Nugget match judgments into a final recall score — normalized length-penalized recall for ACU, or V_strict/A_strict (+ run-level ranking, with an explicit per-topic-unreliability caveat) for Nugget. Use this as the final step of the atomic-unit chain, after atomic-unit-matching; this SOP's existence closes a gap the original pipeline design was missing — without it, per-unit match judgments were never actually summed into the score the source methodologies report.

yogsoth-ai bc2c8c6 2 files · 3.9 KB Updated

File contents

Atomic Unit Recall Aggregate

Final aggregation step of the atomic-unit chain — normalized recall (ACU) or V_strict/A_strict + run-level ranking (Nugget). Added specifically to fix coverage-audit finding S5: the original graph's atomic-unit chain was a dead end at matching, with no node computing the actual reported score.

Execution

Subagent — spawned via spawn-agent skill.

Nugget's Reliability Caveat Is Load-Bearing

Nugget-style per-topic scores are documented as unreliable (Kendall τ=0.297–0.539) — only run-level aggregation across multiple candidates is trustworthy (τ=0.887). This SOP must carry that caveat forward in its output whenever it runs Nugget-style aggregation on a single candidate; do not silence it for a cleaner-looking report.

Available SOPs

SOP When to use
spawn-agent Spawn a customized CC subagent with full MCP tool access.

yogsoth-ai/paper-reading/tree/main/skills/atomic-unit-recall-aggregate commit bc2c8c636d

Frequently asked questions

npx skillmds@latest add yogsoth-ai/atomic-unit-recall-aggregate