Liter Llm

Liter Llm from kreuzberg-dev/plugins.

by @kreuzberg-dev 7 skills

Skills in this plugin

7
  1. ▌
    Liter LLM · kreuzberg-dev
    Universal LLM API client for 143 providers with native bindings for 14 languages. Use when writing code that calls LLM APIs via liter-llm in Python, TypeScript, Rust, Go, Java, C#, Ruby, PHP, Elixir, WASM, or C, when running the OpenAI-compatible proxy, or when calling LLMs through the MCP server. Covers chat, streaming, tool calling, embeddings, image generation, speech, transcription, moderation, web search, OCR, reranking, provider routing, middleware, and configuration.
    887 repo stars
  2. ▌
    Calling Llms · kreuzberg-dev
    Use when sending chat completions through liter-llm and routing to a specific provider via the `provider/model` prefix. Covers the chat call shape, provider routing, model_hint, message roles, and error categories.
    887 repo stars
  3. ▌
    Tool Calling · kreuzberg-dev
    Use when defining functions/tools for an LLM to call through liter-llm, or requesting structured JSON outputs. Covers tool schemas, tool_calls handling, and response formats.
    887 repo stars
  4. ▌
    Running The Proxy · kreuzberg-dev
    Use when running the `liter-llm api` OpenAI-compatible gateway — virtual keys, per-key rate limits, budgets, cost tracking, and model routing. Covers the TOML config and the 22 REST endpoints.
    887 repo stars
  5. ▌
    Streaming Responses · kreuzberg-dev
    Use when streaming tokens incrementally from an LLM via liter-llm over SSE or async iterators. Covers chat_stream, delta handling, and null-content chunks.
    887 repo stars
  6. ▌
    Using The MCP Server · kreuzberg-dev
    Use when calling LLM APIs through the liter-llm MCP server's 22 tools, and to decide when MCP beats the CLI or SDK. Covers the tool surface, the auto-installing launcher, and authentication.
    887 repo stars
  7. ▌
    Embeddings And Search · kreuzberg-dev
    Use when generating embeddings, calling the 12 web-search providers, or running OCR over documents with the 4 OCR providers through liter-llm. Covers embed, search, and ocr methods plus reranking.
    887 repo stars