Paper Reproduction

Reproduce ML/AI papers by turning claims into runnable notebooks, metrics, and traceable gaps. Use for paper replication plans and reproduction reports.

Lanma-ctrl Updated

File contents

Paper Reproduction Skill

Use this skill when reproducing a paper or blog-post experiment.

Workflow

  1. Capture paper metadata: title, link, claimed contribution, target metric.
  2. Convert the paper into a small reproduction checklist:
    • dataset
    • baseline
    • implementation assumptions
    • evaluation metric
    • expected result
  3. Start with the smallest runnable notebook before scaling up.
  4. Record deviations from the original paper explicitly.
  5. Produce a short reproduction report: what matched, what did not, and likely reasons.

For this demo

Use a toy synthetic regression task instead of a real paper so the full loop is quick and local.

Lanma-ctrl/codex-skills-paper-repro-demo/tree/main/skills/paper-reproduction commit ee57e744bf

Frequently asked questions

npx skillmds@latest add lanma-ctrl/paper-reproduction