Results for “vllm”
6 skills
huggingface Hf Cloud Sagemaker Production Defaults
Creates SageMaker endpoints (real-time or async) with autoscaling, CloudWatch alarms, and tagging enabled by default, then smoke-tests them before declaring success.
10.8k · bundle
huggingface Hf Cloud Serving Image Selection
Selects the correct SageMaker serving container image URI for HuggingFace model deployments, prioritizing HuggingFace-curated Deep Learning Containers over generic alternatives.
10.8k · bundle
More results
nvidia Vss Deploy Dense Captioning
Deploy a standalone RT-VLM dense-captioning microservice and exercise its REST API endpoints for file upload, caption generation, streaming, chat completions, and Kafka integration.
2.2k · bundle
nvidia Jetson Inference Mem Tune
Recommends an inference runtime and memory-related launch flags for LLM/VLM workloads on NVIDIA Jetson devices, based on a live memory audit snapshot.
2.2k · bundle
nvidia Vss Deploy Profile
Selects, configures, deploys, verifies, debugs, or tears down a VSS profile (base, search, lvs, warehouse, edge) for NVIDIA's video search and summarization stack.
2.2k · bundle
nvidia Deepstream Sop
Build, deploy, evaluate, debug, and measure latency for a GPU-accelerated FastAPI service that detects whether operators perform assembly-line steps in order via event boundary detection and VLM classification.
2.2k · bundle