Score Extraction

Extract (Task, Dataset, Metric, Score, Conditions) tuples from a paper

yogsoth-ai Updated 512 repo stars
No DARE runtime: 271 SKILL.md files executed by any capable agent, instead of a seven-layer framework stack

File contents

Score Extraction

Purpose

Parse a paper's results sections, tables, and figures to extract all reported performance scores as structured tuples. Each tuple captures the full context needed for fair comparison: what was measured, on what data, under what conditions.

Input Schema

Field Type Description
paper_content string Full paper text (markdown format)
target_tasks string[] Tasks to focus extraction on (empty = extract all)

Output Schema

{
  "paper_title": "string",
  "scores": [
    {
      "method": "string",
      "task": "string",
      "dataset": "string",
      "split": "test|val|dev|train",
      "metric": "string",
      "score": 0.0,
      "score_std": null,
      "num_runs": null,
      "is_primary_result": true,
      "is_ablation": false,
      "table_reference": "string",
      "notes": "string"
    }
  ],
  "baselines_reported": ["string"],
  "extraction_confidence": "high|medium|low"
}

yogsoth-ai/de-anthropocentric-research-engine commit 9ade288f7c

Frequently asked questions

npx get-skill add yogsoth-ai/score-extraction