Reproducibility Third Party Verification

(Proposal, unverified) Attempt to verify a paper's reported results by actually executing its released code/scripts against its own reported configuration — the only SOP in this package whose action type is code execution rather than text reading/judgment. Use this after unit-classification has extracted the paper's reported configuration/hyperparameters as classified units; "not_attempted" is a correct, common output when the paper's own reporting is too incomplete to run, not a failure of this SOP.

yogsoth-ai Updated 512 repo stars

File contents

yogsoth-ai/paper-reading commit a709b5d2f1

Frequently asked questions

npx get-skill add yogsoth-ai/reproducibility-third-party-verification