Dspy Prompt Optimizer

Tunes prompts iteratively using reflection and success metrics. Use for: optimize this prompt, dspy tune, improve prompt with reflection, `self-refine-loop`.

Stijnman Updated

File contents

DSPy Prompt Optimizer

When to Use

  • User says optimize this prompt or task matches this capability
  • User says dspy tune or task matches this capability
  • User says improve prompt with reflection or task matches this capability

Workflow

  1. Capture baseline prompt and 2-3 example inputs with desired outputs.
  2. Run baseline; score outputs against criteria.
  3. Generate 3 prompt variants addressing failures.
  4. Test variants; pick best by score.
  5. Return optimized prompt with before/after metrics.

Integrations

  • self-refine-loop
  • auto-tester
  • hyper-skill-tester

Error Handling

Failure Response
No examples Ask for 2 input/output pairs minimum.
Overfitting one example Require 3+ diverse examples.

Gotchas

  • Keep prompt under 2000 tokens unless user needs longer.

Example

Input: User request matching triggers above. Output: Structured result per workflow with integrations invoked as needed.

Stijnman/grok-custom-skills/tree/main/.grok/skills/dspy-prompt-optimizer commit a5e2c42420

Frequently asked questions

npx skillmds@latest add stijnman/dspy-prompt-optimizer