Serving Llms Vllm

vLLM: high-throughput LLM serving, OpenAI API, quantization.

nativ3ai Updated 193 repo stars
Hermes Agent

File contents

nativ3ai/hermes-agent-camel commit a88dd45c19

Frequently asked questions

npx get-skill add nativ3ai/serving-llms-vllm