SKILL+ Improve
Use this skill when a Skill already exists and the user wants to know whether it is well composed, whether agents can use it effectively, and how to evolve it without making it worse.
This skill combines static audit, live behavior validation, validation-gated editing, and human adoption checkpoints.
Inputs
Collect or infer:
- Path or content of the existing skill folder.
- Target harnesses: Codex, Hermes, Claude Code, OpenCode, or custom.
- Existing evals, test prompts, traces, benchmark results, user complaints, or failure logs.
- Desired improvement goal: routing, structure, behavior, outcome, safety, portability, or maintainability.
- Risk level: file mutation, external send, deployment, permissions, privacy, finance, legal, or irreversible actions.
If the user only asks "is this skill good?", run audit and produce an improvement plan before editing.
Workflow
1. Snapshot And Protect
Before editing:
- Confirm the skill path and whether it is inside a git repo.
- Inspect
SKILL.md, resources, examples, scripts, and evals.
- Preserve existing user changes.
- For git repos, prefer branch/commit-based tracking.
- Do not use destructive rollback such as
git reset --hard.
If no version control exists, make a timestamped file backup before edits.
2. Static Audit
Score the skill across:
| Area |
Purpose |
| Routing |
Agent can discover the skill from description. |
| Contract |
Goal, inputs, outputs, verification, boundaries, and handoff are explicit. |
| Runtime Boundary |
Long knowledge is progressively loaded from resources. |
| Reusability |
No hidden local coupling, stale paths, or overlapping scope. |
| Safety |
High-risk actions have gates, blacklists, and human approval. |
| Signal Density |
No filler, generic model-known advice, or bloated examples. |
| Self-Consistency |
Description, body, resources, examples, and scripts agree. |
Cap the score at 60 for critical failures:
- Missing or non-functional description.
- Hardcoded secrets.
- Destructive action without approval boundary.
- Persona override unrelated to task.
SKILL.md so large that routing and contract are buried.
- Output contract contradicts workflow or resources.
3. Runtime And Behavior Audit
Check whether the skill changes agent behavior:
- Does the target harness discover it?
- Does the agent read it when the task should trigger it?
- Does it add specific tool order, checks, fallback, or evidence behavior?
- Does it avoid known failures?
- Does it preserve existing successful behaviors?
For Codex, check .agents/skills/<skill>/SKILL.md discovery. For Hermes or custom harnesses, identify the skill discovery and injection contract before scoring runtime behavior.
4. Build Or Select Evaluation Tasks
Use the strongest available evaluation:
no-skill baseline
old-skill baseline
candidate-skill run
held-out test run
human review for high-risk or subjective tasks
If no benchmark exists, create 2 to 3 test prompts from real usage, but mark the run as dry_run. A skill cannot be called production-ready from dry-run evidence alone.
5. Choose The Improvement Mode
Pick one mode:
| Mode |
Use when |
repair |
The skill has broken routing, missing contract, bad links, unsafe instructions, or stale paths. |
edit |
The skill is mostly right but needs a targeted behavior, failure, or runtime boundary improvement. |
split |
The skill has multiple unrelated load triggers or bloated scope. |
merge |
Multiple skills overlap and confuse routing. |
deprecate |
The skill is stale, unsafe, unused, or superseded. |
Do not change multiple independent dimensions in one optimization round unless the user explicitly asks for a broad refactor.
6. Generate Candidate Edit
Use bounded edits:
- Add, delete, replace, or move specific sections.
- Preserve proven useful guidance.
- Keep the edit small enough to attribute outcome change.
- Put long details into
references/, examples/, scripts/, or evals/.
- Record why the edit should improve behavior.
For repeated failures, encode them as:
If <symptom>, first <repair>. If still failing, <fallback or handoff>.
7. Validate With A Gate
Use SkillOpt-style strict validation:
candidate_score = select_metric(hard, soft, mixed)
accept if candidate_score > current_score
reject otherwise
new best if candidate_score > best_score
Use:
hard for deterministic exact checks.
soft for partial-credit tasks.
mixed for office workflows with both hard artifacts and quality judgment.
Rejected edits are evidence. Save why they failed so the next round does not repeat them.
8. Apply Darwin-Style Ratchet
Each round must end in one of:
| Status |
Meaning |
keep |
Evidence improved and no critical regression appeared. |
revert |
Candidate failed gate or introduced unacceptable regression. |
hold |
Evidence is mixed or insufficient; do not publish. |
stop |
Marginal gain is too small, risk is too high, or human rejects. |
Use independent review when possible. The same context that made an edit should not be the only judge of that edit.
Human checkpoint is mandatory when:
- The edit changes safety gates, permissions, external send behavior, destructive actions, or release status.
- The validation is subjective.
- The improvement is based only on LLM judge output.
- The dry-run ratio is high.
9. Report
Return:
improvement-report.md
schema-audit.md
eval-report.json or eval-summary.md
recommended-patches.json when not editing directly
updated SKILL.md when safe to edit
CHANGELOG entry when publishing
The report must include:
- Before score and after score.
- Changed files.
- Gate decision: keep, revert, hold, or stop.
- Evidence used: static audit, routing test, behavior test, outcome test, human review.
- Rejected edits or remaining risks.
- Next recommended round.
Verification
Before finishing:
- Re-run static audit after edits.
- Check that the description still matches the body.
- Check resource links and load conditions.
- Confirm no secrets, local-only paths, or unsafe actions were introduced.
- Confirm evaluation evidence is labeled as full test, selection run, dry run, or human-only review.
- If a change is kept, record why it is better than the previous skill.
Boundaries
- Do not call a skill improved because it reads better. Require behavior or outcome evidence when possible.
- Do not rely on the same agent context for both editing and final scoring.
- Do not use
git reset --hard as routine rollback.
- Do not optimize for rubric points by adding bloat.
- Do not publish a high-risk skill without human review.
- Do not delete major content, weaken safety gates, or change external-send behavior without explicit user confirmation.
Runtime Resources
Load references/source-mechanics.md when you need exact mechanics from SkillOpt, darwin-skill, Skill-Schema-V2, Trace2Skill, EvoSkill, and SkillLens.
1---2name: skillplus-improve3description: Load when auditing, scoring, optimizing, evolving, repairing, refactoring, upgrading, validating, or deciding keep/revert for an existing Agent Skill, SKILL.md, skill folder, project skill library, Codex/Hermes skill, or darwin/SkillOpt-style skill improvement loop.4---56# SKILL+ Improve78Use this skill when a Skill already exists and the user wants to know whether it is well composed, whether agents can use it effectively, and how to evolve it without making it worse.910This skill combines static audit, live behavior validation, validation-gated editing, and human adoption checkpoints.1112## Inputs1314Collect or infer:1516- Path or content of the existing skill folder.17- Target harnesses: Codex, Hermes, Claude Code, OpenCode, or custom.18- Existing evals, test prompts, traces, benchmark results, user complaints, or failure logs.19- Desired improvement goal: routing, structure, behavior, outcome, safety, portability, or maintainability.20- Risk level: file mutation, external send, deployment, permissions, privacy, finance, legal, or irreversible actions.2122If the user only asks "is this skill good?", run audit and produce an improvement plan before editing.2324## Workflow2526### 1. Snapshot And Protect2728Before editing:2930- Confirm the skill path and whether it is inside a git repo.31- Inspect `SKILL.md`, resources, examples, scripts, and evals.32- Preserve existing user changes.33- For git repos, prefer branch/commit-based tracking.34- Do not use destructive rollback such as `git reset --hard`.3536If no version control exists, make a timestamped file backup before edits.3738### 2. Static Audit3940Score the skill across:4142| Area | Purpose |43|---|---|44| Routing | Agent can discover the skill from `description`. |45| Contract | Goal, inputs, outputs, verification, boundaries, and handoff are explicit. |46| Runtime Boundary | Long knowledge is progressively loaded from resources. |47| Reusability | No hidden local coupling, stale paths, or overlapping scope. |48| Safety | High-risk actions have gates, blacklists, and human approval. |49| Signal Density | No filler, generic model-known advice, or bloated examples. |50| Self-Consistency | Description, body, resources, examples, and scripts agree. |5152Cap the score at 60 for critical failures:5354- Missing or non-functional description.55- Hardcoded secrets.56- Destructive action without approval boundary.57- Persona override unrelated to task.58- `SKILL.md` so large that routing and contract are buried.59- Output contract contradicts workflow or resources.6061### 3. Runtime And Behavior Audit6263Check whether the skill changes agent behavior:6465- Does the target harness discover it?66- Does the agent read it when the task should trigger it?67- Does it add specific tool order, checks, fallback, or evidence behavior?68- Does it avoid known failures?69- Does it preserve existing successful behaviors?7071For Codex, check `.agents/skills/<skill>/SKILL.md` discovery. For Hermes or custom harnesses, identify the skill discovery and injection contract before scoring runtime behavior.7273### 4. Build Or Select Evaluation Tasks7475Use the strongest available evaluation:7677```text78no-skill baseline79old-skill baseline80candidate-skill run81held-out test run82human review for high-risk or subjective tasks83```8485If no benchmark exists, create 2 to 3 test prompts from real usage, but mark the run as `dry_run`. A skill cannot be called production-ready from dry-run evidence alone.8687### 5. Choose The Improvement Mode8889Pick one mode:9091| Mode | Use when |92|---|---|93| `repair` | The skill has broken routing, missing contract, bad links, unsafe instructions, or stale paths. |94| `edit` | The skill is mostly right but needs a targeted behavior, failure, or runtime boundary improvement. |95| `split` | The skill has multiple unrelated load triggers or bloated scope. |96| `merge` | Multiple skills overlap and confuse routing. |97| `deprecate` | The skill is stale, unsafe, unused, or superseded. |9899Do not change multiple independent dimensions in one optimization round unless the user explicitly asks for a broad refactor.100101### 6. Generate Candidate Edit102103Use bounded edits:104105- Add, delete, replace, or move specific sections.106- Preserve proven useful guidance.107- Keep the edit small enough to attribute outcome change.108- Put long details into `references/`, `examples/`, `scripts/`, or `evals/`.109- Record why the edit should improve behavior.110111For repeated failures, encode them as:112113```text114If <symptom>, first <repair>. If still failing, <fallback or handoff>.115```116117### 7. Validate With A Gate118119Use SkillOpt-style strict validation:120121```text122candidate_score = select_metric(hard, soft, mixed)123124accept if candidate_score > current_score125reject otherwise126127new best if candidate_score > best_score128```129130Use:131132- `hard` for deterministic exact checks.133- `soft` for partial-credit tasks.134- `mixed` for office workflows with both hard artifacts and quality judgment.135136Rejected edits are evidence. Save why they failed so the next round does not repeat them.137138### 8. Apply Darwin-Style Ratchet139140Each round must end in one of:141142| Status | Meaning |143|---|---|144| `keep` | Evidence improved and no critical regression appeared. |145| `revert` | Candidate failed gate or introduced unacceptable regression. |146| `hold` | Evidence is mixed or insufficient; do not publish. |147| `stop` | Marginal gain is too small, risk is too high, or human rejects. |148149Use independent review when possible. The same context that made an edit should not be the only judge of that edit.150151Human checkpoint is mandatory when:152153- The edit changes safety gates, permissions, external send behavior, destructive actions, or release status.154- The validation is subjective.155- The improvement is based only on LLM judge output.156- The dry-run ratio is high.157158### 9. Report159160Return:161162```text163improvement-report.md164schema-audit.md165eval-report.json or eval-summary.md166recommended-patches.json when not editing directly167updated SKILL.md when safe to edit168CHANGELOG entry when publishing169```170171The report must include:172173- Before score and after score.174- Changed files.175- Gate decision: keep, revert, hold, or stop.176- Evidence used: static audit, routing test, behavior test, outcome test, human review.177- Rejected edits or remaining risks.178- Next recommended round.179180## Verification181182Before finishing:183184- Re-run static audit after edits.185- Check that the description still matches the body.186- Check resource links and load conditions.187- Confirm no secrets, local-only paths, or unsafe actions were introduced.188- Confirm evaluation evidence is labeled as full test, selection run, dry run, or human-only review.189- If a change is kept, record why it is better than the previous skill.190191## Boundaries192193- Do not call a skill improved because it reads better. Require behavior or outcome evidence when possible.194- Do not rely on the same agent context for both editing and final scoring.195- Do not use `git reset --hard` as routine rollback.196- Do not optimize for rubric points by adding bloat.197- Do not publish a high-risk skill without human review.198- Do not delete major content, weaken safety gates, or change external-send behavior without explicit user confirmation.199200## Runtime Resources201202Load `references/source-mechanics.md` when you need exact mechanics from SkillOpt, darwin-skill, Skill-Schema-V2, Trace2Skill, EvoSkill, and SkillLens.