Plugins

2 plugins

GKE Batch & Inference

For teams running batch/HPC and AI/ML inference workloads on GKE with specialized hardware.

2 skills · plugin

Deploy AI Inference on GKE

Deploy and optimize AI/ML inference workloads on GKE using GPUs, TPUs, and model servers.

3 skills · plugin

Results for “inference”

5 skills

Search the web and extract content from URLs using Tavily and Exa APIs via the inference.sh CLI.

AI RAG Pipeline

Build RAG pipelines that combine web search and LLMs for research, fact-checking, and grounded responses using the inference.sh CLI.

More results

Load pre-trained models from Hugging Face Hub, run pipeline inference, generate text, and fine-tune models on NLP, vision, audio, and multimodal tasks using the Transformers library.

30.2k · bundle

Assessing Vector And Embedding Weaknesses

Test vector stores for embedding inversion, cross-tenant leakage, and poisoning.

24.6k · bundle

Vss Deploy Video Embedding

Deploy and operate the VSS 3.2 GA RT-Embed Video Embedding microservice using Docker Compose, covering GPU prerequisites, REST API usage for file uploads, text/video embeddings, live RTSP streams, Redis/Kafka/OTel integration, and troubleshooting.