Paper Experiments

Plan, preregister and run a small, honest evaluation study on a free or tiny budget: pick the design habits of strong benchmark papers, write the plan before the data, use free model access behind a guard that cannot spend, run a grid of package versions and models, and report null results. Use when a paper needs real experiments, when someone asks how top benchmark papers run theirs, how to run LLM evals for free, or how to preregister. Triggers: 'run experiments for the paper', 'free model evals', 'preregister', 'cheap eval budget', 'how do viral benchmark papers do experiments'.

pooriaarab Updated 1 repo stars

File contents

pooriaarab/skills commit 7b16ecdec7

Frequently asked questions

npx get-skill add pooriaarab/paper-experiments