Objective Correctness Adjudication

Use this skill when a user wants evaluator data where the judge must decide which answer is actually correct, logically valid, or verifier-passing, especially in hard reasoning, math, coding, or knowledge tasks. Trigger it when people ask for things like 'make judge data that tests real correctness', 'compare correct and incorrect solutions', 'focus on logic before style', or 'build hard evaluator tasks that humans may misjudge'. Plain-language examples include: 'test whether the judge can pick the actually right answer', 'make response pairs with one correct and one wrong', 'evaluate reasoning quality objectively', and 'create judge data for hard math or coding answers'.

dingxingdi Updated 1 repo stars

File contents

dingxingdi/paper_fast_search_backup commit 92116407c5

Frequently asked questions

npx get-skill add dingxingdi/objective-correctness-adjudication-2