Serving Llms Vllm

vLLM: high-throughput LLM serving, OpenAI API, quantization.

S3YED Updated

File contents

S3YED/appie-kit commit a88dd45c19

Frequently asked questions

npx get-skill add s3yed/serving-llms-vllm