Routing Calibration

Use when calibrating or validating a maintained routing recipe against live model backends, including probe manifests and evidence reports.

vllm-project b7e73fe 830 B Updated

File contents

Routing calibration

Use tools/dev/router-calibration/router_calibration_loop.py and the versioned probe schema in config/schemas/recipe-probes-v1.schema.json. Keep recipe changes in the local checkout; remote systems are validation mirrors only.

Treat endpoint credentials, hostnames, and private fleet details as secrets. Before a live run, validate the probe manifest and identify the exact recipe, backend, and rollback point. Record the evaluated inputs, outputs, and observed quality rather than inferring success from process health.

Run make check, then make verify DOMAIN=maintained-recipes for live recipe verification.

vllm-project/semantic-router/tree/main/tools/agent/skills/routing-calibration commit b7e73fe55b

Frequently asked questions

npx skillmds@latest add vllm-project/routing-calibration