How do I install the Litellm Docs skill?

Run npx skillmds@latest add wenerme/litellm-docs in your terminal (requires Node.js), paste this page's agent-chat prompt into Claude, Cursor, or any MCP-connected agent, or download the SKILL.md file and copy it into your agent's skills directory.

Is Litellm Docs safe to use?

This skill has not completed SkillMD's automated safety review yet. SkillMD never runs a skill's scripts for you; review the SKILL.md before installing.

Which AI agents work with Litellm Docs?

This skill is tagged as working with Claude Code, Claude.ai, OpenAI Codex. SKILL.md is an open format, so most agents that read a skills directory can load it too.

Is Litellm Docs free to use?

Yes. Installing skills from SkillMD is free, and the skill stays under its author's original license.

Who published Litellm Docs?

wenerme (@wenerme) published this skill. Their other Agent Skills are listed on their SkillMD profile.

Litellm Docs by wenerme — Agent Skill

Name: Litellm Docs
Author: wenerme

Litellm Docs

LiteLLM documentation — unified Python SDK and proxy server for 100+ LLM providers (OpenAI, Anthropic, Google, Azure, AWS Bedrock, Vertex AI, Cohere, Mistral, Ollama, vLLM, etc). Covers completion, embedding, image generation, audio, reranking, fine-tuning API; LiteLLM Proxy server (load balancing, rate limiting, virtual keys, spend tracking, SSO, RBAC, guardrails); caching (Redis, S3, in-memory); observability (Langfuse, Datadog, Prometheus, OpenTelemetry); secret managers (AWS, Azure, GCP, HashiCorp Vault); and provider-specific configuration. USE THIS SKILL WHEN the user asks about LiteLLM proxy setup, multi-provider LLM routing, model fallbacks, spend tracking, or calling any LLM API through LiteLLM.

wenerme 3e715d7 2.8 KB Updated Sep 17, 2026

File contents

LiteLLM Documentation

Official docs for LiteLLM — call 100+ LLM APIs using the OpenAI format (Python SDK + Proxy Server).

CRITICAL: grep references/ for keywords before answering.

Reference Index (664 docs)

Providers (170 docs)

references/providers/ — Provider-specific guides for OpenAI, Anthropic, Azure, AWS Bedrock, Google Vertex AI, Gemini, Cohere, Mistral, Groq, Together AI, Fireworks, Deepseek, Ollama, vLLM, Hugging Face, Replicate, Perplexity, Cerebras, Sambanova, xAI, and 80+ more

Proxy Server (168 docs)

references/proxy/ — LiteLLM Proxy (OpenAI-compatible gateway)
- Config, deployment (Docker, Kubernetes, Helm)
- Virtual keys, spend tracking, budgets, rate limiting
- Load balancing, fallbacks, routing, model groups
- SSO/RBAC, audit logs, guardrails, content moderation
- UI dashboard, team management, tag-based routing

Completion & API (30 docs)

references/completion/ — Chat completion, streaming, function calling, tool use, vision, JSON mode, prompt caching, batch API, token usage

Tutorials (57 docs)

references/tutorials/ — Step-by-step guides for common tasks

Observability (43 docs)

references/observability/ — Langfuse, Datadog, Prometheus, OpenTelemetry, Lunary, Helicone, Traceloop, custom callbacks

Pass-through APIs (15 docs)

references/pass_through/ — Direct provider API pass-through (Anthropic, Vertex, Bedrock, Cohere, etc.)

Search & Reranking (13 docs)

references/search/ — Web search, reranking providers

Caching (3 docs)

references/caching/ — Redis, S3, in-memory caching strategies

Embedding (3 docs)

references/embedding/ — Text embedding providers and configuration

Secret Managers (9 docs)

references/secret_managers/ — AWS Secrets Manager, Azure Key Vault, GCP Secret Manager, HashiCorp Vault

Extras

references/extras/ — Contributing, debugging, LangChain integration
Root-level docs: references/index.md, references/rules.md, references/exception_mapping.md, references/budget_manager.md, etc.

---name: litellm-docsdescription: LiteLLM documentation — unified Python SDK and proxy server for 100+ LLM providers (OpenAI, Anthropic, Google, Azure, AWS Bedrock, Vertex AI, Cohere, Mistral, Ollama, vLLM, etc). Covers completion, embedding, image generation, audio, reranking, fine-tuning API; LiteLLM Proxy server (load balancing, rate limiting, virtual keys, spend tracking, SSO, RBAC, guardrails); caching (Redis, S3, in-memory); observability (Langfuse, Datadog, Prometheus, OpenTelemetry); secret managers (AWS, Azure, GCP, HashiCorp Vault); and provider-specific configuration. USE THIS SKILL WHEN the user asks about LiteLLM proxy setup, multi-provider LLM routing, model fallbacks, spend tracking, or calling any LLM API through LiteLLM.---# LiteLLM DocumentationOfficial docs for [LiteLLM](https://github.com/BerriAI/litellm) — call 100+ LLM APIs using the OpenAI format (Python SDK + Proxy Server).CRITICAL: grep `references/` for keywords before answering.## Reference Index (664 docs)### Providers (170 docs)- `references/providers/` — Provider-specific guides for OpenAI, Anthropic, Azure, AWS Bedrock, Google Vertex AI, Gemini, Cohere, Mistral, Groq, Together AI, Fireworks, Deepseek, Ollama, vLLM, Hugging Face, Replicate, Perplexity, Cerebras, Sambanova, xAI, and 80+ more### Proxy Server (168 docs)- `references/proxy/` — LiteLLM Proxy (OpenAI-compatible gateway) - Config, deployment (Docker, Kubernetes, Helm) - Virtual keys, spend tracking, budgets, rate limiting - Load balancing, fallbacks, routing, model groups - SSO/RBAC, audit logs, guardrails, content moderation - UI dashboard, team management, tag-based routing### Completion & API (30 docs)- `references/completion/` — Chat completion, streaming, function calling, tool use, vision, JSON mode, prompt caching, batch API, token usage### Tutorials (57 docs)- `references/tutorials/` — Step-by-step guides for common tasks### Observability (43 docs)- `references/observability/` — Langfuse, Datadog, Prometheus, OpenTelemetry, Lunary, Helicone, Traceloop, custom callbacks### Pass-through APIs (15 docs)- `references/pass_through/` — Direct provider API pass-through (Anthropic, Vertex, Bedrock, Cohere, etc.)### Search & Reranking (13 docs)- `references/search/` — Web search, reranking providers### Caching (3 docs)- `references/caching/` — Redis, S3, in-memory caching strategies### Embedding (3 docs)- `references/embedding/` — Text embedding providers and configuration### Secret Managers (9 docs)- `references/secret_managers/` — AWS Secrets Manager, Azure Key Vault, GCP Secret Manager, HashiCorp Vault### Extras- `references/extras/` — Contributing, debugging, LangChain integration- Root-level docs: `references/index.md`, `references/rules.md`, `references/exception_mapping.md`, `references/budget_manager.md`, etc.

Frequently asked questions