Open Benchmark Methodology

Mandatory for VerilogEval, VerilogEval-v2, VerilogEval-Human, CVDP, RTLLM, PyHDL-Eval, RTL-Repo, MetRex, ResBench, ChipAgentsBench, benchmark, pass@1, benchmark floor/defect, run/rerun/score benchmark, or interpreting benchmark results. Enforces one general product entry, clean-room blind evaluation, Program First plus independent AI review/backup, official host scoring, evidence-backed triage, and capture of general enhancements.

vibeic Updated

File contents

vibeic/vibe-ic commit a0c837c87b

Frequently asked questions

npx get-skill add vibeic/open-benchmark-methodology