vLLM

Serves LLMs with high throughput using vLLM's PagedAttention and continuous batching. Use when deploying production LLM APIs, optimizing inference latency/throughput, or serving models with limited GPU memory. Supports OpenAI-compatible endpoints, quantization (GPTQ/AWQ/FP8), and tensor parallelism.

agentic-in Updated 586 repo stars
Elephant Agent follows a personal path with people, places, risks, rhythms, decisions, and a Personal Model

File contents

agentic-in/elephant-agent commit 21d037013c

Frequently asked questions

npx get-skill add agentic-in/vllm