Plugins

2 plugins

GKE Batch & Inference

For teams running batch/HPC and AI/ML inference workloads on GKE with specialized hardware.

2 skills · plugin

Deploy AI Inference on GKE

Deploy and optimize AI/ML inference workloads on GKE using GPUs, TPUs, and model servers.

3 skills · plugin

Results for “inference”

3 skills

Manages the lifecycle of large language models in production, covering model versioning, prompt management, inference optimization, and cost control.

More results

Operates AI infrastructure as a production dependency: manages GPU utilization, MCP servers, LLM gateways, inference pipelines, token costs, semantic caching, and model observability.

Graphsignal Profiler

Set up GPU profiling, tracing, and monitoring for inference workloads using vLLM, SGLang, PyTorch, and dstack services via the Graphsignal Profiler sidecar.