- Judge design rule, measured: two one-sentence atomic questions composed in code beat any single question that folds two judgments together (TypeSafe's own guidance). Hill-climb prompt changes with
eval/tools/earn.py(paired bootstrap) and read the usage-floor ladder witheval/tools/schedule.py; a clause stays only if it earns its place. - Judgment eval harness:
packages/pi-extension/eval/. Session transcripts, labels, worksheets, and results stay in gitignoredeval/local/. See that README for the corpus contract and label rubric.
Judge Evaluation
Use when changing or evaluating judge prompts, scoring thresholds, usage floors, or judgment eval corpora.
Judge Evaluation by kunchenguid · 56e4de6
npx get-skill add kunchenguid/judge-evaluation 
File contents
---name: judge-evaluationdescription: Use when changing or evaluating judge prompts, scoring thresholds, usage floors, or judgment eval corpora.user-invocable: falsemetadata: source: https://skillmd.com/skills/kunchenguid/judge-evaluation internal: true---- Judge design rule, measured: two one-sentence atomic questions composed in code beat any single question that folds two judgments together (TypeSafe's own guidance). Hill-climb prompt changes with `eval/tools/earn.py` (paired bootstrap) and read the usage-floor ladder with `eval/tools/schedule.py`; a clause stays only if it earns its place.- Judgment eval harness: `packages/pi-extension/eval/`. Session transcripts, labels, worksheets, and results stay in gitignored `eval/local/`. See that README for the corpus contract and label rubric.
kunchenguid/compact-adviser commit 56e4de6d9f
Frequently asked questions
Run npx get-skill add kunchenguid/judge-evaluation in your terminal (requires Node.js), paste this page's agent-chat prompt into Claude, Cursor, or any MCP-connected agent, or download the SKILL.md file and copy it into your agent's skills directory.
Use when changing or evaluating judge prompts, scoring thresholds, usage floors, or judgment eval corpora. It is listed under Coding & Dev Tools on SkillMD.
This skill has not completed SkillMD's automated safety review yet. Independent scanners report: SkillSpector: PASS, Skill Scanner: PASS. Capability flags: docs only. SkillMD never runs a skill's scripts for you; review the SKILL.md before installing.
This skill is tagged as working with Claude Code, Claude.ai, OpenAI Codex. SKILL.md is an open format, so most agents that read a skills directory can load it too.
Yes. Installing skills from SkillMD is free, and the skill stays under its author's original license.
kunchenguid (@kunchenguid) published this skill. Their other Agent Skills are listed on their SkillMD profile.