Sample Human Evals With Strata

Use when you can only human-review a fraction of outputs. Draws a stratified random sample so the estimate generalises and the interval is reportable.

jiayaoqijia Updated 81 repo stars

File contents

jiayaoqijia/cryptoskill commit 94d967d899

Frequently asked questions

npx get-skill add jiayaoqijia/sample-human-evals-with-strata