Review LLM Annotations And Improve Prompt

Calculate agreement between human ground truth and machine labels for a text LLM judge metric, then analyze transcripts and reviewer notes to propose an improved metric prompt. One metric at a time.

coval-ai Updated 3 repo stars

File contents

coval-ai/coval-external-skills commit f04f6c6b2d

Frequently asked questions

npx get-skill add coval-ai/review-llm-annotations-and-improve-prompt