Plugins

2 plugins

GKE Batch & Inference

For teams running batch/HPC and AI/ML inference workloads on GKE with specialized hardware.

2 skills · plugin

Deploy AI Inference on GKE

Deploy and optimize AI/ML inference workloads on GKE using GPUs, TPUs, and model servers.

3 skills · plugin

Results for “inference”

15 skills

Access 100+ LLMs including Claude, Gemini, Kimi, and GLM via the inference.sh CLI with automatic fallback and cost optimization.

Control a headless browser to navigate pages, click elements, fill forms, take screenshots, record video, and execute JavaScript using Playwright and inference.sh.

AI Automation Workflows

Build automated AI workflows combining multiple models and services for batch processing, scheduled tasks, event-driven pipelines, and agent loops using the inference.sh CLI.

Build AI applications with the inference.sh Python SDK: run apps, build agents, and integrate with 250+ models using sync/async, streaming, file uploads, and a tool builder API.

Agent Platform Inference

Authenticates and connects to Google Cloud Agent Platform for inference with Gemini and third-party OpenMaaS models (Llama, DeepSeek, Qwen). Generates code for multiple SDKs, configures endpoints, and troubleshoots common errors.

14.4k · bundle

Add a batteries-included agent component to React/Next.js apps with runtime, streaming, human-in-the-loop approvals, and client-side tools.

More results

Run 250+ AI apps from the command line: generate images and videos, call LLMs, search the web, create 3D models, and automate Twitter posts.

Integrate 250+ AI models into JavaScript/TypeScript apps with streaming, file uploads, and agent tooling.

Deepstream Generate Pipeline

Builds and validates DeepStream GStreamer pipelines through an interactive questionnaire and a BM25 retrieval engine over 270+ verified pipelines.

Generate, predict, and embed protein sequences and structures using ESM3, ESMC, and ESMFold2 with local or cloud inference.

30.2k · bundle

orchestra-research

Evaluating Cosmos Policy

Evaluate NVIDIA Cosmos Policy on LIBERO and RoboCasa simulation environments with headless GPU evaluation and inference profiling.

10.4k · bundle

Graphsignal Profiler

Set up GPU profiling, tracing, and monitoring for inference workloads using vLLM, SGLang, PyTorch, and dstack services via the Graphsignal Profiler sidecar.

Provides isolated, agent-native sandboxes for code execution, live preview URLs, browser automation, and access to 50+ tools via CLI or HTTP, with no SDK or API keys required.

Hugging Science

Discovers and uses scientific datasets, models, blog posts, and interactive demos from a curated catalog for AI/ML work in domains like biology, chemistry, physics, and genomics.

30.2k · bundle

Turns a Bankr agent wallet into a keyless identity on the SIGNA agent network: resolve any identity to a messageable wallet, send and read wallet-signed DMs, invoke capabilities, and run a decentralized brain.