Sglang

Structured Generation Language for LLM serving. RadixAttention prefix caching, constrained decoding (JSON, grammar), OpenAI-compatible API, and multi-turn optimization. Fast inference with structured output guarantees.

mkurman Updated 327 repo stars
Picture from the README

File contents

mkurman/zorai commit 6e2fcc54c4

Frequently asked questions

npx get-skill add mkurman/sglang