Plugins
2 pluginsResults for “inference”
12 skillsGke Inference
Deploys and optimizes AI/ML inference workloads on GKE, using GPUs, TPUs, and model servers.
14.4k
Agent Platform Inference
Authenticates and connects to Google Cloud Agent Platform for inference with Gemini and third-party OpenMaaS models (Llama, DeepSeek, Qwen). Generates code for multiple SDKs, configures endpoints, and troubleshoots common errors.
14.4k · bundle
AI Infra
Operates AI infrastructure as a production dependency: manages GPU utilization, MCP servers, LLM gateways, inference pipelines, token costs, semantic caching, and model observability.
2
Hf CLI
Manage Hugging Face Hub resources via the `hf` CLI: download and upload models, datasets, and spaces; manage buckets, cache, collections, discussions, and inference endpoints; run SQL queries on datasets.
2 · bundle
Tao Run On Brev
Manage NVIDIA Brev GPU instances for TAO training, evaluation, and inference using the Brev CLI and Docker.
2.2k · bundle
More results
Modal Serverless Gpu
Run ML workloads on Modal's serverless GPU cloud platform with auto-scaling, pay-per-second pricing, and Python-native infrastructure.
10.4k · bundle
Modal
Deploy and serve AI/ML models on Modal's serverless cloud platform with on-demand GPUs, autoscaling containers, persistent storage, and scheduled jobs.
30.2k · bundle
Lambda Labs Gpu Cloud
Manage and use Lambda Labs GPU cloud instances for ML training and inference with SSH access, persistent filesystems, and multi-node clusters.
10.4k · bundle
Agent Tools
Runs 150+ AI apps in the cloud via the inference.sh CLI, covering image generation, video creation, LLMs, web search, 3D generation, and Twitter automation.
1 · bundle
Python Azure Iot Edge Modules
Design, implement, and validate Python-based IoT Edge modules for telemetry processing, local inference, protocol translation, and edge-to-cloud integration.
36.2k · bundle
Modal Serverless Gpu
Run ML workloads on Modal's serverless GPU cloud: deploy models as auto-scaling APIs, run batch jobs, and schedule tasks with pay-per-second GPU pricing.
2
Hf Cloud Sagemaker Deployment Planner
Plans and coordinates the deployment of a model to Amazon SageMaker AI, selecting the appropriate pathway (real-time, serverless, async, batch, or Bedrock CMI) based on model type, traffic, latency, and cost constraints.
10.8k