Together Batch Inference

High-volume, asynchronous offline inference at up to 50% lower cost via Together AI's Batch API. Prepare JSONL inputs, upload files, create jobs, poll status, and download outputs. Reach for it whenever the user needs non-interactive bulk inference rather than real-time chat or evaluation jobs.

togethercomputer Updated 40 repo stars

File contents

togethercomputer/skills commit 857645af6c

Frequently asked questions

npx get-skill add togethercomputer/together-batch-inference-2