Sglang Runtime Context

How SGLang's runtime configuration and process-global state are organized (RuntimeContext tiers, publish + namespace config bags, the pristine ServerArgs seed, override entry points, resource/stream/buffer leases, per-forward flags), the CI guardrails that enforce the design, and the idioms for developing and testing against it. Load this before touching server_args, model overrides, module-level state, or per-forward state in sglang.

antgroup Updated 41 repo stars
Organizations adopting SGLang

File contents

antgroup/sglang commit 3c8d651fea

Frequently asked questions

npx get-skill add antgroup/sglang-runtime-context