Vllm Serving Planner

Use when planning, reviewing, or tuning vLLM or OpenAI-compatible LLM serving for throughput, latency, KV-cache pressure, batching, quantization, prefix caching, or multimodal serving.

mouadja02 Updated 13 repo stars

File contents

mouadja02/skills commit 812468db35

Frequently asked questions

npx get-skill add mouadja02/vllm-serving-planner