Skill Eval Loop

Run the observe-analyze-iterate loop on promptfoo evals for a skill collection. Promptfoo-specific — assumes promptfoo is installed, tests live in YAML, and results are in the standard SQLite DB at ~/.promptfoo/promptfoo.db. Use when the user has a promptfoo eval suite and wants to diagnose failures, fix them, and re-run targeted tests. Triggers on phrases like "eval failed", "analyze the promptfoo eval", "iterate on skills", or any request to improve skills based on promptfoo output.

stuffbucket Updated 4 repo stars

File contents

stuffbucket/skills commit 90e20c4e79

Frequently asked questions

npx get-skill add stuffbucket/skill-eval-loop