Audit Skill Completeness
Purpose
Evaluates a single skill directory against 8 quality categories derived from Anthropic's official skills repository. Each category is scored 0-3, producing an overall completeness percentage and actionable recommendations for improvement.
When to Use
Invoke this skill when:
- Pre-marketplace publication review - verify skill meets quality standards
- Post-creation quality check - evaluate newly created skills
- Skill improvement planning - identify specific quality gaps
- Comparing local skills to Anthropic patterns - benchmark against official standards
- Marketplace readiness assessment - determine if skill is publication-ready
Workflow
Step 1: Discovery
Read the skill directory structure:
skill-path/
├── SKILL.md # Required - main skill definition
├── scripts/ # Optional - executable automation
├── references/ # Optional - supporting documentation
└── assets/ # Optional - reusable output resources
Actions:
- Verify SKILL.md exists
- Check for scripts/, references/, assets/ directories
- Read SKILL.md frontmatter and body
- List all files in each directory
Validation:
- If SKILL.md missing, report error and exit
- If path is not a directory, report error and exit
Step 2: Evaluate Quality Categories
Run through each of the 8 categories using the detailed checklist in Skill Completeness Checklist.
Quality Categories:
| Category |
Evaluates |
Key Indicators |
| 1. Preparation |
Prerequisites met before work begins |
Environment verification, input inspection, metadata extraction scripts |
| 2. Progression |
Concrete steps with right level of control |
Clear sequence, deterministic scripts, working examples, decision trees |
| 3. Verification |
Output correctness confirmed before success |
Explicit verification steps, automated checks, error-correction loops, acceptance criteria |
| 4. Scripts |
Executable automation for core operations |
Repetitive operations scripted, --help support, edge case handling, tested output |
| 5. Examples |
Teaching through demonstration |
Working code with imports, exact input→output pairs, common cases, edge case handling |
| 6. Anti-Patterns |
Explicit "what NOT to do" |
Known failure modes documented, bad output shown, corrections side-by-side |
| 7. References |
Domain knowledge AI cannot generate |
API/schema/format documentation, organized sections, linked from workflow steps |
| 8. Assets |
Reusable output resources bundled |
Templates, fonts, images, boilerplate the AI uses (not reads) |
Evaluation Process:
For each category:
- Read the category definition from Skill Completeness Checklist
- Review checklist items for that category
- Search SKILL.md and supporting files for evidence
- Score 0-3 based on rubric (below)
- Document findings with file:line references
Step 3: Score and Report
Calculate overall score and write report to .claude/audits/completeness-report-{skill-slug}.md.
Report Structure:
# Skill Completeness Report: {skill-name}
**Evaluated:** {timestamp}
**Skill Path:** {absolute-path}
## Overall Score: {percentage}% ({score}/24)
| Category | Score | Label | Findings |
|----------|-------|-------|----------|
| 1. Preparation | 2 | Adequate | Environment checks present, missing metadata extraction |
| 2. Progression | 3 | Exemplary | Clear workflow, deterministic scripts, decision tree |
| ... | ... | ... | ... |
## Category Details
### 1. Preparation (2/3 - Adequate)
**What was evaluated:**
- Environment verification before starting
- Input inspection before acting
- Metadata extraction scripts
**Evidence found:**
- ✅ Environment check at SKILL.md:45-50
- ✅ Input validation at SKILL.md:65
- ❌ No metadata extraction script in scripts/
**Recommendation:**
Add a script to extract structured metadata from inputs so the AI operates on verified data instead of assumptions.
### 2. Progression (3/3 - Exemplary)
...
## Recommendations for Improvement
1. **High Priority:** Add metadata extraction script (Preparation)
2. **Medium Priority:** Include anti-pattern examples (Anti-Patterns)
3. **Low Priority:** Add visual validation examples (Verification)
## Reference
This audit follows patterns from Anthropic's official skills repository:
- https://github.com/anthropics/skills
Checklist: [Skill Completeness Checklist](./references/skill-completeness-checklist.md)
Output Location:
Report written to .claude/audits/completeness-report-{skill-slug}.md
If .claude/audits/ does not exist, create it.
Scoring Rubric
Each category is scored 0-3 based on presence and quality of evidence:
| Score |
Label |
Meaning |
Criteria |
| 0 |
None |
Category not addressed |
No evidence found for any checklist items |
| 1 |
Minimal |
Basic attempt, significant gaps |
1-2 checklist items present, core patterns missing |
| 2 |
Adequate |
Meets expectations, minor gaps |
3-4 checklist items present, core patterns followed |
| 3 |
Exemplary |
Exceeds expectations, Anthropic patterns |
All or most checklist items present, matches Anthropic quality |
Overall Score Calculation:
Sum of category scores / 24 * 100 = percentage
Scoring Guidelines:
Preparation (0-3):
- 0: No environment checks, no input validation, no metadata extraction
- 1: Environment checks OR input validation present
- 2: Environment checks AND input validation present
- 3: Environment checks, input validation, AND metadata extraction scripts
Progression (0-3):
- 0: No clear workflow, AI must generate all code
- 1: Workflow defined but no scripts or examples
- 2: Workflow defined with scripts OR examples
- 3: Workflow defined with scripts AND examples AND decision trees
Verification (0-3):
- 0: No verification steps mentioned
- 1: Manual verification suggested but not enforced
- 2: Verification steps defined with acceptance criteria
- 3: Automated verification scripts with error-correction loops
Scripts (0-3):
- 0: No scripts provided
- 1: 1-2 scripts, limited functionality
- 2: 3-5 scripts covering core operations
- 3: 6+ scripts, --help support, comprehensive coverage
Examples (0-3):
- 0: No examples provided
- 1: Abstract examples or pseudocode only
- 2: Working examples with imports and realistic data
- 3: Working examples covering common AND edge cases
Anti-Patterns (0-3):
- 0: No anti-patterns documented
- 1: Anti-patterns mentioned but not shown
- 2: Anti-patterns shown with corrections
- 3: Anti-patterns shown with corrections AND reasoning
References (0-3):
- 0: No reference material
- 1: External links only (not bundled)
- 2: 1-2 reference files in references/
- 3: 3+ reference files, organized by topic, linked from workflow
Assets (0-3):
- 0: No assets provided
- 1: 1-2 asset files
- 2: 3-5 asset files, organized
- 3: 6+ asset files or comprehensive asset library
Output Format
Report filename: completeness-report-{skill-slug}.md
Where {skill-slug} is the skill directory name (e.g., audit-skill-completeness → completeness-report-audit-skill-completeness.md)
Report sections:
- Header - skill name, path, timestamp
- Overall Score - percentage and raw score
- Summary Table - all categories with scores
- Category Details - for each category:
- Score and label
- What was evaluated (checklist items)
- Evidence found (file:line references)
- Recommendations for improvement
- Recommendations Summary - prioritized list
- Reference - link to checklist and Anthropic repository
Quality Categories Reference
All 8 categories are detailed in Skill Completeness Checklist with:
- Checklist items for each category
- Examples from Anthropic's official skills
- Patterns observed across creative, document, and developer skills
- Rationale for why each pattern matters
Additional Resources
1---2name: 659-description-skill-f704848d3description: Evaluate a single skill's quality against 8 completeness categories derived from Anthropic's official skills repository. Scores preparation, progression, verification, scripts, examples, anti-patterns, references, and assets. Generates scored report to .claude/audits/. Use when auditing skill quality, checking marketplace readiness, evaluating skill completeness score, performing pre-publication evaluation, or comparing to Anthropic skills.4---56# Audit Skill Completeness78## Purpose910Evaluates a single skill directory against 8 quality categories derived from Anthropic's official skills repository. Each category is scored 0-3, producing an overall completeness percentage and actionable recommendations for improvement.1112## When to Use1314Invoke this skill when:1516- Pre-marketplace publication review - verify skill meets quality standards17- Post-creation quality check - evaluate newly created skills18- Skill improvement planning - identify specific quality gaps19- Comparing local skills to Anthropic patterns - benchmark against official standards20- Marketplace readiness assessment - determine if skill is publication-ready2122## Workflow2324### Step 1: Discovery2526Read the skill directory structure:2728```29skill-path/30├── SKILL.md # Required - main skill definition31├── scripts/ # Optional - executable automation32├── references/ # Optional - supporting documentation33└── assets/ # Optional - reusable output resources34```3536**Actions:**37381. Verify SKILL.md exists392. Check for scripts/, references/, assets/ directories403. Read SKILL.md frontmatter and body414. List all files in each directory4243**Validation:**4445- If SKILL.md missing, report error and exit46- If path is not a directory, report error and exit4748### Step 2: Evaluate Quality Categories4950Run through each of the 8 categories using the detailed checklist in [Skill Completeness Checklist](./references/skill-completeness-checklist.md).5152**Quality Categories:**5354| Category | Evaluates | Key Indicators |55|----------|-----------|----------------|56| **1. Preparation** | Prerequisites met before work begins | Environment verification, input inspection, metadata extraction scripts |57| **2. Progression** | Concrete steps with right level of control | Clear sequence, deterministic scripts, working examples, decision trees |58| **3. Verification** | Output correctness confirmed before success | Explicit verification steps, automated checks, error-correction loops, acceptance criteria |59| **4. Scripts** | Executable automation for core operations | Repetitive operations scripted, --help support, edge case handling, tested output |60| **5. Examples** | Teaching through demonstration | Working code with imports, exact input→output pairs, common cases, edge case handling |61| **6. Anti-Patterns** | Explicit "what NOT to do" | Known failure modes documented, bad output shown, corrections side-by-side |62| **7. References** | Domain knowledge AI cannot generate | API/schema/format documentation, organized sections, linked from workflow steps |63| **8. Assets** | Reusable output resources bundled | Templates, fonts, images, boilerplate the AI uses (not reads) |6465**Evaluation Process:**6667For each category:68691. Read the category definition from [Skill Completeness Checklist](./references/skill-completeness-checklist.md)702. Review checklist items for that category713. Search SKILL.md and supporting files for evidence724. Score 0-3 based on rubric (below)735. Document findings with file:line references7475### Step 3: Score and Report7677Calculate overall score and write report to `.claude/audits/completeness-report-{skill-slug}.md`.7879**Report Structure:**8081```markdown82# Skill Completeness Report: {skill-name}8384**Evaluated:** {timestamp}85**Skill Path:** {absolute-path}8687## Overall Score: {percentage}% ({score}/24)8889| Category | Score | Label | Findings |90|----------|-------|-------|----------|91| 1. Preparation | 2 | Adequate | Environment checks present, missing metadata extraction |92| 2. Progression | 3 | Exemplary | Clear workflow, deterministic scripts, decision tree |93| ... | ... | ... | ... |9495## Category Details9697### 1. Preparation (2/3 - Adequate)9899**What was evaluated:**100- Environment verification before starting101- Input inspection before acting102- Metadata extraction scripts103104**Evidence found:**105- ✅ Environment check at SKILL.md:45-50106- ✅ Input validation at SKILL.md:65107- ❌ No metadata extraction script in scripts/108109**Recommendation:**110Add a script to extract structured metadata from inputs so the AI operates on verified data instead of assumptions.111112### 2. Progression (3/3 - Exemplary)113114...115116## Recommendations for Improvement1171181. **High Priority:** Add metadata extraction script (Preparation)1192. **Medium Priority:** Include anti-pattern examples (Anti-Patterns)1203. **Low Priority:** Add visual validation examples (Verification)121122## Reference123124This audit follows patterns from Anthropic's official skills repository:125- https://github.com/anthropics/skills126127Checklist: [Skill Completeness Checklist](./references/skill-completeness-checklist.md)128```129130**Output Location:**131132Report written to `.claude/audits/completeness-report-{skill-slug}.md`133134If `.claude/audits/` does not exist, create it.135136## Scoring Rubric137138Each category is scored 0-3 based on presence and quality of evidence:139140| Score | Label | Meaning | Criteria |141|-------|-------|---------|----------|142| **0** | None | Category not addressed | No evidence found for any checklist items |143| **1** | Minimal | Basic attempt, significant gaps | 1-2 checklist items present, core patterns missing |144| **2** | Adequate | Meets expectations, minor gaps | 3-4 checklist items present, core patterns followed |145| **3** | Exemplary | Exceeds expectations, Anthropic patterns | All or most checklist items present, matches Anthropic quality |146147**Overall Score Calculation:**148149```150Sum of category scores / 24 * 100 = percentage151```152153**Scoring Guidelines:**154155- **Preparation (0-3):**156 - 0: No environment checks, no input validation, no metadata extraction157 - 1: Environment checks OR input validation present158 - 2: Environment checks AND input validation present159 - 3: Environment checks, input validation, AND metadata extraction scripts160161- **Progression (0-3):**162 - 0: No clear workflow, AI must generate all code163 - 1: Workflow defined but no scripts or examples164 - 2: Workflow defined with scripts OR examples165 - 3: Workflow defined with scripts AND examples AND decision trees166167- **Verification (0-3):**168 - 0: No verification steps mentioned169 - 1: Manual verification suggested but not enforced170 - 2: Verification steps defined with acceptance criteria171 - 3: Automated verification scripts with error-correction loops172173- **Scripts (0-3):**174 - 0: No scripts provided175 - 1: 1-2 scripts, limited functionality176 - 2: 3-5 scripts covering core operations177 - 3: 6+ scripts, --help support, comprehensive coverage178179- **Examples (0-3):**180 - 0: No examples provided181 - 1: Abstract examples or pseudocode only182 - 2: Working examples with imports and realistic data183 - 3: Working examples covering common AND edge cases184185- **Anti-Patterns (0-3):**186 - 0: No anti-patterns documented187 - 1: Anti-patterns mentioned but not shown188 - 2: Anti-patterns shown with corrections189 - 3: Anti-patterns shown with corrections AND reasoning190191- **References (0-3):**192 - 0: No reference material193 - 1: External links only (not bundled)194 - 2: 1-2 reference files in references/195 - 3: 3+ reference files, organized by topic, linked from workflow196197- **Assets (0-3):**198 - 0: No assets provided199 - 1: 1-2 asset files200 - 2: 3-5 asset files, organized201 - 3: 6+ asset files or comprehensive asset library202203## Output Format204205Report filename: `completeness-report-{skill-slug}.md`206207Where `{skill-slug}` is the skill directory name (e.g., `audit-skill-completeness` → `completeness-report-audit-skill-completeness.md`)208209Report sections:2102111. **Header** - skill name, path, timestamp2122. **Overall Score** - percentage and raw score2133. **Summary Table** - all categories with scores2144. **Category Details** - for each category:215 - Score and label216 - What was evaluated (checklist items)217 - Evidence found (file:line references)218 - Recommendations for improvement2195. **Recommendations Summary** - prioritized list2206. **Reference** - link to checklist and Anthropic repository221222## Quality Categories Reference223224All 8 categories are detailed in [Skill Completeness Checklist](./references/skill-completeness-checklist.md) with:225226- Checklist items for each category227- Examples from Anthropic's official skills228- Patterns observed across creative, document, and developer skills229- Rationale for why each pattern matters230231## Additional Resources232233- [Skill Completeness Checklist](./references/skill-completeness-checklist.md) - detailed quality categories, checklist items, and examples from Anthropic's official skills repository