Results for “dsl-vm”
22 skills
nvidia Vss Deploy Detection Tracking 3d
Deploy and operate the RTVI-CV-3D microservice for multi-camera 3D detection and tracking, supporting sample datasets, custom videos, and RTSP streams.
2.2k · bundle
nvidia Vss Deploy Dense Captioning
Deploy a standalone RT-VLM dense-captioning microservice and exercise its REST API endpoints for file upload, caption generation, streaming, chat completions, and Kafka integration.
2.2k · bundle
nvidia Vss Deploy Detection Tracking 2d
Deploy, debug, and operate the RTVI-CV 2D detection/tracking microservice and call its REST API for stream management, health checks, and metrics.
2.2k · bundle
nvidia Vss Deploy Video Embedding
Deploy and operate the VSS 3.2 GA RT-Embed Video Embedding microservice using Docker Compose, covering GPU prerequisites, REST API usage for file uploads, text/video embeddings, live RTSP streams, Redis/Kafka/OTel integration, and troubleshooting.
2.2k · bundle
nvidia Vss Summarize Video
Summarize recorded video clips using the LVS microservice with a VLM fallback, producing a narrative summary with timestamped events.
2.2k · bundle
nvidia Jetson LLM Serve
Serve LLMs and VLMs on NVIDIA Jetson devices using vLLM or SGLang with optimized Docker containers and quantization presets.
2.2k · bundle
nvidia Vss Deploy Profile
Selects, configures, deploys, verifies, debugs, or tears down a VSS profile (base, search, lvs, warehouse, edge) for NVIDIA's video search and summarization stack.
2.2k · bundle
nvidia Vss Query Analytics
Queries video analytics incidents, alerts, metrics, and sensor data from Elasticsearch via the VA-MCP server.
2.2k · bundle
nvidia Dynamo Interconnect Check
Validates that a Dynamo deployment's NIXL/UCX/NCCL interconnect is ready for disaggregated serving over RDMA/NVLink. Use after deploying a disagg or multi-node recipe to confirm KV transport is correct, or use troubleshoot for already-failed pods.
2.2k · bundle
ichichuang Serving Llms Vllm
Serves LLMs with high throughput using vLLM's PagedAttention and continuous batching. Use when deploying production LLM APIs, optimizing inference latency/throughput, or serving models with limited GPU memory. Supports OpenAI-compatible endpoints, quantization (GPTQ/AWQ/FP8), and tensor parallelism.
0 · bundle
orchestra-research Serving Llms Vllm
Deploy and serve LLMs with high throughput using vLLM's PagedAttention and continuous batching. Supports OpenAI-compatible endpoints, quantization (GPTQ/AWQ/FP8), and tensor parallelism for production inference.
10.4k · bundle
jiachen-t-wang Snli Ve Visual Entailment Dataset Arxiv 1901 06706v1
SNLI-VE: Visual Entailment Dataset
6
orchestra-research Tensorrt LLM
Optimizes LLM inference with NVIDIA TensorRT for maximum throughput and lowest latency on NVIDIA GPUs (A100/H100).
10.4k · bundle
tianhao909 Serving Llms Vllm
Serves LLMs with high throughput using vLLM's PagedAttention and continuous batching. Use when deploying production LLM APIs, optimizing inference latency/throughput, or serving models with limited GPU memory. Supports OpenAI-compatible endpoints, quantization (GPTQ/AWQ/FP8), and tensor parallelism.
1 · bundle
qcmuu Serving Llms Vllm
Serves LLMs with high throughput using vLLM's PagedAttention and continuous batching. Use when deploying production LLM APIs, optimizing inference latency/throughput, or serving models with limited GPU memory. Supports OpenAI-compatible endpoints, quantization (GPTQ/AWQ/FP8), and tensor parallelism.
0 · bundle
jiachen-t-wang Docvqa A Dataset For Vqa On Document Images Arxiv 2007 00398
DocVQA: A Dataset for VQA on Document Images
6
aniruddhaadak80 Serving Llms Vllm
vLLM: high-throughput LLM serving, OpenAI API, quantization.
0 · bundle
jiachen-t-wang Glamm Pixel Grounding Large Multimodal Model Arxiv 2311 0335
GLaMM: Pixel Grounding Large Multimodal Model
6
q2805187159 Serving Llms Vllm
Serves LLMs with high throughput using vLLM's PagedAttention and continuous batching. Use when deploying production LLM APIs, optimizing inference latency/throughput, or serving models with limited GPU memory. Supports OpenAI-compatible endpoints, quantization (GPTQ/AWQ/FP8), and tensor parallelism.
3 · bundle
nvidia Vss Manage Video Io Storage
Manage VIOS and NvStreamer REST API operations for video input/output and storage, including sensors, streams, snapshots, clips, and recordings.
2.2k · bundle
nvidia Vss Ask Video
Ask visual questions about video clips using a VSS agent's video_understanding tool, requiring a fresh look at frames rather than prior metadata or search results.
2.2k · bundle
orchestra-research Deepspeed
Provides expert guidance for distributed training with DeepSpeed, covering ZeRO optimization stages, pipeline parallelism, FP16/BF16/FP8, 1-bit Adam, and sparse attention.
10.4k · bundle