jmagly Diversity Tuning Skill
Triggers
Alternate expressions and non-obvious activations (primary phrases are matched automatically from the skill description):
- "mode collapse" → RLHF pattern mitigation via diversity tuning
- "RLHF collapse" → same
- "VS parameters" → Verbalized Sampling parameter adjustment shorthand
Purpose
Interactively tune Verbalized Sampling parameters to find the right diversity level for a given task.
Parameters
| Parameter | Default | Range | Description |
|---|---|---|---|
| k | 5 | 3-20 | Number of responses to generate |
| threshold | 0.1 | 0.01-1.0 | Probability filter threshold |
| variant | standard | standard/cot/multi | VS prompt variant |
Presets
| Preset | k | threshold | variant | Use Case |
|---|---|---|---|---|
| conservative | 3 | 1.0 | standard | Minimal diversity, high confidence |
| moderate | 5 | 0.1 | standard | Balanced (default) |
| creative | 8 | 0.05 | cot | High diversity for ideation |
| maximum | 12 | 0.01 | multi | Maximum exploration |
Usage
# Apply a preset
"tune diversity to creative"
# Custom parameters
"set diversity k=8 threshold=0.05"
# A/B comparison
"compare diversity: moderate vs creative for tagline generation"
A/B Comparison Mode
When comparing presets:
- Generate outputs using preset A
- Generate outputs using preset B
- Show side-by-side comparison
- Measure diversity metrics:
- Unique n-gram ratio
- Average pairwise edit distance
- Semantic cluster count
- Recommend the better preset for the task
References
- @$AIWG_ROOT/agentic/code/addons/aiwg-utils/rules/vague-discretion.md — Measurable diversity thresholds and tuning criteria
- @$AIWG_ROOT/agentic/code/addons/aiwg-utils/rules/instruction-comprehension.md — Parsing tuning parameters accurately
- @$AIWG_ROOT/docs/extensions/overview.md — Extension system architecture
- @$AIWG_ROOT/agentic/code/addons/voice-framework/README.md — Voice framework for style diversity context