Vllm Xpu Profile

Profile a running vLLM-XPU server with torch.profiler around a window of real requests, either via /start_profile and /stop_profile HTTP endpoints or via vllm bench --profile for offline runs. Use to find the dominant op under real concurrent traffic. Not for pure PyTorch (use torch-xpu-profile), SYCL kernel-level signal (use xpu-profile-unitrace), throughput numbers (use vllm-xpu-bench), or non-vLLM servers.

intel Updated 122 repo stars

File contents

intel/gpu-ai-skills commit e67d42a28f

Frequently asked questions

npx get-skill add intel/vllm-xpu-profile