Vllm Prefix Cache Bench

This is a skill for benchmarking the efficiency of automatic prefix caching in vLLM using fixed prompts, real-world datasets, or synthetic prefix/suffix patterns. Use when the user asks to benchmark prefix caching hit rate, caching efficiency, or repeated-prompt performance in vLLM.

vllm-project Updated

File contents

vllm-project/vllm-skills commit 38cce3b3a1

Frequently asked questions

npx get-skill add vllm-project/vllm-prefix-cache-bench