Serve Model

Use when serving a cached model on one GPU with vLLM, checking a local completion endpoint, or diagnosing startup and inference failures in the single-node quickstart.

NVIDIA Updated 23k repo stars

File contents

nvidia/deepops commit a8715b5256

Frequently asked questions

npx get-skill add nvidia/serve-model