Plugins

1 plugin

GKE Batch & Inference

For teams running batch/HPC and AI/ML inference workloads on GKE with specialized hardware.

2 skills · plugin

Results for “batch-inference”

3 skills

AI Automation Workflows

Build automated AI workflows combining multiple models and services for batch processing, scheduled tasks, event-driven pipelines, and agent loops using the inference.sh CLI.

More results

Build AI applications with the inference.sh Python SDK: run apps, build agents, and integrate with 250+ models using sync/async, streaming, file uploads, and a tool builder API.

Bundles a prompt with selected files into a one-shot request for another model, supporting API and browser engines with session reattachment.