Inference Tune Sweep

Search a bounded inference serving configuration matrix, compare every cell with a named baseline, and select a throughput or latency champion. Uses the checked-in campaign, evidence, baseline, aggregation, and report tools. Use when asked to tune batching, concurrency, KV cache, CUDA graph, or related serving settings for an existing deployment.

cfregly Updated 4 repo stars

File contents

cfregly/claude-gpu-perf-tune commit 5ff4f5804d

Frequently asked questions

npx get-skill add cfregly/inference-tune-sweep