yogsoth-ai Benchmark Sweep
Systematically scan all known solutions in a domain, catalog their properties, and identify gaps where no solution exists.
State Ledger
| Resource | Target | Current | % |
|---|---|---|---|
| web-search | 30 | 0 | 0% |
| web-research | 10 | 0 | 0% |
| paper-overview | 30 | 0 | 0% |
| paper-search | 20 | 0 | 0% |
| paper-research | 8 | 0 | 0% |
HARD-GATE
Cannot exit strategy until ≥80% of each budget line is consumed OR yield targets are met with justification for remaining budget.
Available Tactics
| Tactic | Role |
|---|---|
| coverage-analysis | Inventory → crossing → intersection evaluation pipeline |
| evaluation-filtering | Score and filter generated gap-filling ideas |
Available SOPs
| SOP | Role |
|---|---|
| benchmark-inventory | Catalog all known solutions with performance/applicability/limitations |
| method-problem-crossing | Build cross-reference matrix from inventory |
| intersection-evaluation | Annotate matrix cells as explored/partial/unexplored |
| enumeration-synthesis | Synthesize sweep findings into structured report |
Execution Guidance
- Inventory: Run benchmark-inventory to catalog all known methods
- Structure: Use method-problem-crossing to organize into matrix form
- Evaluate: Run intersection-evaluation to find gaps
- Generate: For each gap, brainstorm potential solutions
- Filter: Apply evaluation-filtering to rank gap-filling ideas
- Synthesize: Produce final report via enumeration-synthesis
Available Tactics
Optional, no fixed order; the final leaf is always a sop.
| Tactic | When to use |
|---|---|
| coverage-analysis | Systematic coverage evaluation pipeline — benchmark inventory, method-problem crossing, and intersection evaluation to map explored vs unexplored solution space. |
Available SOPs
Optional, no fixed order; the final leaf is always a sop.
| SOP | When to use |
|---|---|
| creative-ideation-benchmark-inventory | Catalog all known solutions/methods in a domain with performance, applicability, and limitations. |
| enumeration-synthesis | Synthesize all systematic enumeration outputs into a structured idea report with prioritized recommendations. |
| intersection-evaluation | Evaluate exploration status of each cell in a method×problem matrix, annotating as explored, partial, or unexplored. |
| method-problem-crossing | Build method×problem cross-reference matrix showing which methods have been applied to which problems. |