yogsoth-ai Protocol Element Extraction SOP
Extract all evaluation protocol parameters from a paper's description of how it evaluated on a specific benchmark. Captures the implementation details that affect reproducibility.
Input
- paper_content: Full text or relevant sections of the paper
- benchmark_name: The specific benchmark whose evaluation protocol to extract
Procedure
- Locate evaluation/experimental setup sections
- Extract all protocol parameters across 5 categories
- Flag parameters that are ambiguous or unstated
- Compare against original benchmark protocol (if known)
- Note any deviations or innovations in protocol
Output
Structured protocol specification with completeness assessment.
Available SOPs
Optional, no fixed order; the final leaf is always a sop.
| SOP | When to use |
|---|---|
| spawn-agent | Spawn a customized CC subagent with full MCP tool access. Used by SOPs that declare execution: subagent. |