Streaming Architecture

LiteLLM-RS Streaming Architecture. Covers UnifiedSSEParser line buffering, the SSETransformer trait, UnifiedSSEStream backpressure and overflow guarding, provider-specific transformers, and server-side SSE emission. Use when debugging SSE parsing, writing or modifying a provider stream transformer, wiring the stream processing pipeline, or tuning the stream idle timeout.

majiayu000 Updated 735 repo stars

File contents

majiayu000/litellm-rs commit d664d10d25

Frequently asked questions

npx get-skill add majiayu000/streaming-architecture