Routing Architecture

LiteLLM-RS Routing Architecture. Covers 7 routing strategies over immutable routing snapshots (ArcSwap) with atomic/DashMap state, health-aware deployment selection with cooldown circuit breaker, model-keyed fallback chains, and load balancing. Use when selecting or tuning a routing strategy, or configuring failover, health checks, and load balancing.

majiayu000 Updated 735 repo stars

File contents

majiayu000/litellm-rs commit 408ff9a8d5

Frequently asked questions

npx get-skill add majiayu000/routing-architecture