Measure Inter Annotator Agreement

Use when several humans label the same eval items. Measures agreement before treating any label set as a target the model is scored against.

jiayaoqijia Updated 81 repo stars

File contents

jiayaoqijia/cryptoskill commit 1c2b290741

Frequently asked questions

npx get-skill add jiayaoqijia/measure-inter-annotator-agreement