Run Benchmark

Execute a LongMemEval benchmark run - drives per-item hypothesis generation and LLM-as-judge scoring with checkpointing, resumable, capped at 500 items by default

tmuskal Updated 3 repo stars

File contents

tmuskal/arc-agi-benchmarker commit de08a3545a Runs: tmuskal/report

Frequently asked questions

npx get-skill add tmuskal/run-benchmark-2