Multi-Model
Use the bundled runner:
python3 "${CLAUDE_PLUGIN_ROOT}/skills/multi-model/scripts/multi_model.py".
Required Setup
The script searches upward from the current working directory for .env.
Required variables:
ARENA_MODELS- Either
ARENA_OPENAI_BASE_URL(single endpoint) orARENA_PROVIDER_<NAME>_BASE_URL(multi-provider) - Optional keys:
ARENA_OPENAI_API_KEY,ARENA_PROVIDER_<NAME>_API_KEY
Single-endpoint example:
ARENA_MODELS=qwen3:8b,deepseek-r1:14b
How to run
python3 "${CLAUDE_PLUGIN_ROOT}/skills/multi-model/scripts/multi_model.py" \
--prompt "<task>" --iters 5 --max-judges 3 --json
Useful flags: --out, --temperature, --max-tokens, --timeout.
Execution Policy
- Rotate writer model by iteration.
- Let other models judge and score.
- Keep the highest average-score answer as current best.
- Return best answer, or full transcript with
--json.
Safety Rules
- Never print API keys or secret values from
.env. - Refer to model identity only as numeric IDs (
Model 0,Model 1, ...). - Do not expose provider/model names in prompts or user-facing output.