Score Extraction

Extract (Task, Dataset, Metric, Score, Conditions) tuples from a paper

yogsoth-ai 9ade288 2 files · 3.8 KB Updated

File contents

Score Extraction

Purpose

Parse a paper's results sections, tables, and figures to extract all reported performance scores as structured tuples. Each tuple captures the full context needed for fair comparison: what was measured, on what data, under what conditions.

Input Schema

Field Type Description
paper_content string Full paper text (markdown format)
target_tasks string[] Tasks to focus extraction on (empty = extract all)

Output Schema

{
  "paper_title": "string",
  "scores": [
    {
      "method": "string",
      "task": "string",
      "dataset": "string",
      "split": "test|val|dev|train",
      "metric": "string",
      "score": 0.0,
      "score_std": null,
      "num_runs": null,
      "is_primary_result": true,
      "is_ablation": false,
      "table_reference": "string",
      "notes": "string"
    }
  ],
  "baselines_reported": ["string"],
  "extraction_confidence": "high|medium|low"
}

yogsoth-ai/de-anthropocentric-research-engine/tree/main/skills/score-extraction commit 9ade288f7c

Frequently asked questions

npx skillmds@latest add yogsoth-ai/score-extraction