LLM Serving Capacity Planner

Parse SGLang/vLLM startup logs to explain GPU memory use and request capacity. Use for KV cache budget, mem-fraction-static comparisons, OOM triage, and max-concurrency estimates.

bbuf Updated

File contents

bbuf/ai-infra-auto-driven-skills commit a6c088ba1b

Frequently asked questions

npx get-skill add bbuf/llm-serving-capacity-planner