Vllm Setup

Deploy a vLLM inference server on an NVIDIA DGX Station GB300 with validated container, GPU targeting, and tuning parameters. Use when the user asks to serve a model with vLLM, start a vLLM endpoint, or set up OpenAI-compatible inference on DGX Station.

NVIDIA Updated 23k repo stars
NVIDIA DGX Spark

File contents

nvidia/dgx-spark-playbooks commit 15d260960f

Frequently asked questions

npx get-skill add nvidia/vllm-setup