Skill Creator
Modified by basicly on 2026-10-02 from anthropics/skills skill-creator at 8a1541c4 (Apache-2.0, see LICENSE.txt).
Create a skill, test it on real prompts, measure it, and improve it until the user is
satisfied. This skill owns the eval loop.
The loop:
- Decide what the skill does and roughly how.
- Write a draft as a
skill.yaml source.
- Write the trigger cases and task cases in
evals.yaml, then run a few task cases with and without the skill.
- Evaluate the results with the user, both by reading them and by the numbers.
- Rewrite the skill from the feedback and from flaws that the benchmark shows.
- Repeat. Then add task cases and run again at a larger scale.
Find out where the user is in this loop and continue from there. A user with a draft goes
straight to the eval step. A user who wants no formal evals gets a quick draft and a
conversation. Description tuning comes last.
Capture the intent
The conversation may already hold the workflow, for example "turn this into a skill".
Then take the answers from it first: the tools used, the order of steps, the corrections
the user made, the input and output formats. Ask only for missing facts that change the result.
- What does the skill let the agent do?
- When does it trigger: which phrases and situations?
- What is the expected output?
- Does it need task cases? A skill with a verifiable output (a file transform, data
extraction, generated code, fixed workflow steps) benefits from them. A skill with a
subjective output (writing style, design) often does not. Suggest a default and let the
user decide.
Ask about edge cases, formats, example files, success criteria and dependencies before
you write task cases. Before you build, check that no installed or published skill
already does the job: the find-skills skill does that search.
Read when needed
- Before source authoring, read authoring;
catalog-authoring owns catalog format and projections.
- For trigger cases, test runs with and without the skill, grading and timing, read evaluation. The run with the skill and the run without it may go to parallel agents; you write the skill yourself.
- For feedback, blind comparison, description tuning or evaluator script commands, read improvement. Execute the scripts; do not paste their source into the prompt.
- Read grader, comparator, analyzer or schemas only for the step that names it.
- Done when every task case passes with the skill, graded by an agent that did not write it, every trigger case passes in
basicly catalog lint, and basicly skills-check passes.
1---2name: skill-creator3description: Writes a new skill or improves one with evals, a benchmark, graded versions and description tuning. Use when adding a new skill to the catalog, turning a workflow into a skill, comparing runs with and without a skill, or when a skill never gets picked up.4license: Apache-2.05metadata:6 source: https://skillmd.com/skills/niksavis/skill-creator7 upstream: anthropics/skills skills/skill-creator8 source-commit: 8a1541c4a3ffa5a20a5a91de0dcf3f0bab1d1ef49 modified-by: basicly 2026-10-0210---1112<!-- Generated by `basicly skills-build` from skill.yaml. Do not edit; edit the source. -->1314# Skill Creator1516> Modified by basicly on 2026-10-02 from anthropics/skills skill-creator at 8a1541c4 (Apache-2.0, see `LICENSE.txt`).1718Create a skill, test it on real prompts, measure it, and improve it until the user is19satisfied. This skill owns the eval loop.2021The loop:22231. Decide what the skill does and roughly how.242. Write a draft as a `skill.yaml` source.253. Write the trigger cases and task cases in `evals.yaml`, then run a few task cases with and without the skill.264. Evaluate the results with the user, both by reading them and by the numbers.275. Rewrite the skill from the feedback and from flaws that the benchmark shows.286. Repeat. Then add task cases and run again at a larger scale.2930Find out where the user is in this loop and continue from there. A user with a draft goes31straight to the eval step. A user who wants no formal evals gets a quick draft and a32conversation. Description tuning comes last.3334## Capture the intent3536The conversation may already hold the workflow, for example "turn this into a skill".37Then take the answers from it first: the tools used, the order of steps, the corrections38the user made, the input and output formats. Ask only for missing facts that change the result.39401. What does the skill let the agent do?412. When does it trigger: which phrases and situations?423. What is the expected output?434. Does it need task cases? A skill with a verifiable output (a file transform, data44 extraction, generated code, fixed workflow steps) benefits from them. A skill with a45 subjective output (writing style, design) often does not. Suggest a default and let the46 user decide.4748Ask about edge cases, formats, example files, success criteria and dependencies before49you write task cases. Before you build, check that no installed or published skill50already does the job: the `find-skills` skill does that search.5152## Read when needed5354- Before source authoring, read [authoring](references/authoring.md); `catalog-authoring` owns catalog format and projections.55- For trigger cases, test runs with and without the skill, grading and timing, read [evaluation](references/evaluation.md). The run with the skill and the run without it may go to parallel agents; you write the skill yourself.56- For feedback, blind comparison, description tuning or evaluator script commands, read [improvement](references/improvement.md). Execute the scripts; do not paste their source into the prompt.57- Read [grader](references/grader.md), [comparator](references/comparator.md), [analyzer](references/analyzer.md) or [schemas](references/schemas.md) only for the step that names it.58- Done when every task case passes with the skill, graded by an agent that did not write it, every trigger case passes in `basicly catalog lint`, and `basicly skills-check` passes.