Plugins

2 plugins

GKE Batch & Inference

For teams running batch/HPC and AI/ML inference workloads on GKE with specialized hardware.

2 skills · plugin

Deploy AI Inference on GKE

Deploy and optimize AI/ML inference workloads on GKE using GPUs, TPUs, and model servers.

3 skills · plugin

Results for “inference”

4 skills

Deploys and optimizes AI/ML inference workloads on GKE, using GPUs, TPUs, and model servers.

Tao Run Inference Service

Start, query, and stop a TAO inference microservice for a specific network architecture by delegating container execution to the appropriate platform skill.

More results

Tao Run On Slurm

Submit and manage TAO training, evaluation, and inference jobs on SLURM GPU clusters over SSH with sbatch/srun, Pyxis/Enroot containers, and Lustre-backed storage.

Vss Deploy Video Embedding

Deploy and operate the VSS 3.2 GA RT-Embed Video Embedding microservice using Docker Compose, covering GPU prerequisites, REST API usage for file uploads, text/video embeddings, live RTSP streams, Redis/Kafka/OTel integration, and troubleshooting.