Openai Plugin Eval Improve Skill

Turn plugin-eval findings into a concrete rewrite brief for a Codex skill. Use when the user already evaluated a skill and now wants Codex to improve it, especially after asking what to fix first.

yanacuti1121 5b46302 1.3 KB Updated 2 repo stars

File contents

Improve Skill

Use this skill after plugin-eval has already produced findings for a local skill.

Workflow

  1. Run plugin-eval analyze <skill-path> --brief-out <brief.json>.
  2. Read the improvement brief and group work into required fixes versus recommended fixes.
  3. Apply the skill-creator guidance from /Users/benlesh/.codex/skills/skill-creator/SKILL.md.
  4. Re-run the evaluation and compare before and after outputs.

Chat Requests To Recognize

  • Improve this skill based on the evaluation.
  • Rewrite this skill using the plugin-eval findings.
  • What should I fix first in this skill?

Focus Areas

  • reduce trigger and invoke token costs
  • keep SKILL.md compact
  • move bulky details into references or scripts
  • improve trigger descriptions
  • fix broken links and manifest/frontmatter issues

Commands

plugin-eval analyze <skill-path> --brief-out ./skill-brief.json
plugin-eval compare before.json after.json

Reference

  • ../../references/chat-first-workflows.md

yanacuti1121/Yana-AI/tree/main/core/skills/openai--plugin-eval--improve-skill commit 5b463022b1

Frequently asked questions

npx skillmds add yanacuti1121/openai-plugin-eval-improve-skill