Plugins

2 plugins

GKE Batch & Inference

For teams running batch/HPC and AI/ML inference workloads on GKE with specialized hardware.

2 skills · plugin

Deploy AI Inference on GKE

Deploy and optimize AI/ML inference workloads on GKE using GPUs, TPUs, and model servers.

3 skills · plugin

Results for “inference”

5 skills

Prompt Engineering

Learn and apply prompt engineering techniques for LLMs, image generators, and video models using the inference.sh CLI.

Run Fireworks-hosted open-weight model councils that compare responses and synthesize a final answer.

42.4k · bundle

More results

Nemotron Policy Generator

Generates custom safety policies for NVIDIA Nemotron content-safety guardrails, producing a Markdown policy, JSON taxonomy, and inference prompts from rough user input.

Video Prompting Guide

Learn best practices for writing effective AI video generation prompts, covering shot types, camera movements, lighting, style keywords, and model-specific tips for Veo, Seedance, Wan, Grok, and others.

orchestra-research

Guarantee valid JSON, XML, or code structure during text generation using Pydantic models for type-safe outputs, supporting local models (Transformers, vLLM, llama.cpp) and maximizing inference speed with structured generation.

10.4k · bundle