Validate Evaluator

Calibrate an LLM judge against human labels using data splits, TPR/TNR, and bias correction. Use after writing a judge prompt (write-judge-prompt) when you need to verify alignment before trusting its outputs. Do NOT use for code-based evaluators (those are deterministic; test with standard unit tests).

build-with-dhiraj Updated 5 repo stars

File contents

build-with-dhiraj/ai-workflow-framework-portability-kit commit a1929c3622

Frequently asked questions

npx get-skill add build-with-dhiraj/validate-evaluator