Align Human

Use when the user has a judge/grader and human-labeled data, and wants to measure how well the judge agrees with humans, detect systematic biases, determine whether automatic evaluation can replace human review, or build a human-reduction roadmap. Also use when the user mentions calibration, TPR/TNR, judge validation, inter-rater agreement, Cohen's kappa, bias detection, or "is my automatic evaluation trustworthy." Merges the calibrate and align functions into one skill.

gabrielmoreira Updated 20 repo stars

File contents

gabrielmoreira/agent-skills-mirror commit 90b1cee420

Frequently asked questions

npx get-skill add gabrielmoreira/align-human