Skill Output Scoring
Core Workflow
- Identify the output, scenario, target artifact, and scoring rubric.
- Score each criterion with brief evidence, not just a number.
- Separate output quality from prompt quality and missing context.
- Call out blockers before averages.
- Compare baseline and skill-enabled scores when both exist.
- Recommend keep, revise, split, merge, defer, or retire based on the score and risks.
Safety Rules
- Do not average away high-risk failures.
- Do not treat polished writing as correctness.
- Do not score claims as correct without evidence or source material.
- Escalate when the output affects production, security, legal, finance, employment, medical, compliance, or customer commitments.
Deliverable Shape
For scoring reports, provide:
- Scenario and artifact
- Rubric used
- Score table
- Blockers
- Improvements and regressions
- Confidence level
- Decision recommendation
References
- Read
references/skill-output-scoring-checklist.mdwhen scoring or comparing agent skill outputs.