Profile My skills Saved My plugins Edit profile Submit a skill

Harnessay

Profile Claude Code transcripts. /harnessay = context budget report + skill candidates, /harnessay eval = skill regression tests. Triggers - "harnessay", "context report", "where did my tokens go", "skill candidates", "skill regression"

nks0614 Updated
Docs & Writing

File contents

harnessay

All scripts live in this skill's base directory (shown above as "Base directory for this skill" — referred to as $SKILL_DIR below). Python 3.8+, stdlib only.

Default (report)

  1. Run:
    python3 "$SKILL_DIR/harnessay.py" -o <scratchpad>/report.html
    If the user asks about a specific period ("this month", "since the fix"), add --since YYYY-MM-DD.
  2. Relay the stdout headline sentence to the user.
  3. Send report.html to the user (if headless, just give the path).
  4. Summarize the top 5 rows of the report's "Skill candidates" section with their personal/project suggestion. Never auto-create skills — the user decides what to promote.

eval (skill regression tests)

If the arguments contain "eval":

python3 "$SKILL_DIR/evalrun.py"
  • Pass through --only <id-substring> and a custom tasks.json path if given. Golden tasks live in $SKILL_DIR/eval/tasks.json by default; users can point to their own file.
  • Report the pass rate and the first lines of output for any FAIL.
  • Results accumulate in results.jsonl next to the tasks file; no extra saving needed.

nks0614/harnessay/tree/main/skills/harnessay commit bc04404609

Browse category

Frequently asked questions

npx skillmds@latest add nks0614/harnessay