Understanding Streamlit architecture
Streamlit is a client-server application with bidirectional WebSocket communication using Protocol Buffers.
Use this file as a quick mental model and navigation index; use references/backend.md, references/frontend.md, and references/communication.md for implementation details.
Concepts glossary
| Concept |
Description |
Key files |
| Command |
Any function exposed in Streamlit's public API (st.* namespace). Commands can create elements/widgets, control execution flow, or configure app behavior. |
lib/streamlit/delta_generator.py, lib/streamlit/elements/, lib/streamlit/commands/ |
| Element |
Umbrella term for all UI components in Streamlit: widgets, containers, and display elements. Represented in Element.proto as a oneof union of ~50+ types. |
proto/streamlit/proto/Element.proto, lib/streamlit/elements/ |
| Widget |
Interactive element (button, slider, text_input) that typically triggers a rerun on user interaction. Value accessible via return value or st.session_state. Widgets that support on_change="ignore" update in the browser without rerunning until something else does. Some elements become widgets conditionally (e.g., dataframe/chart with on_select). |
lib/streamlit/elements/widgets/, frontend/lib/src/components/widgets/ |
| Display Element |
Non-interactive element (text, markdown, image, chart) that renders content without triggering reruns by itself. |
lib/streamlit/elements/, frontend/lib/src/components/elements/ |
| Container |
Layout block that groups elements spatially (sidebar, columns, expander, tabs, form). Represented as BlockNode in the element tree. |
lib/streamlit/elements/layouts.py, Block.proto |
| DeltaGenerator |
The st object; API entry point that queues UI deltas. Uses mixin pattern to compose all st.* commands. |
lib/streamlit/delta_generator.py |
| Session State |
Per-session dictionary (st.session_state) persisting data across reruns. Stores widget values and user variables. |
lib/streamlit/runtime/state/session_state.py |
| Rerun |
Re-execution of the user script for the current page. Triggered by widget interactions, st.rerun(), file changes, or fragment timers. Rebuilds the element tree while preserving session state. |
lib/streamlit/runtime/scriptrunner/script_runner.py, lib/streamlit/commands/execution_control.py |
| Form |
Container (st.form) that batches widget inputs, deferring reruns until form submission. |
lib/streamlit/elements/form.py, WidgetStateManager.ts |
| Fragment |
Decorator (@st.fragment) enabling partial reruns of specific UI sections without full script re-execution. |
lib/streamlit/runtime/fragment.py |
| Caching |
Decorators (@st.cache_data, @st.cache_resource) that memoize function results to avoid redundant computation. |
lib/streamlit/runtime/caching/ |
| Pages |
Multipage app system using st.navigation() and st.Page() or auto-discovery from pages/ directory. |
lib/streamlit/navigation/, lib/streamlit/runtime/pages_manager.py |
| Config |
App configuration via .streamlit/config.toml controlling server, client, and theme settings. |
lib/streamlit/config.py, lib/streamlit/config_option.py |
| Theming |
Customizable UI themes (Light/Dark/Custom) defined in config or via theme editor. |
lib/streamlit/runtime/theme_util.py, frontend/lib/src/theme/ |
| Secrets |
Secure credential storage via .streamlit/secrets.toml (local) or platform settings (deployed). Accessed via st.secrets. |
lib/streamlit/runtime/secrets.py |
| Connection |
Database/service abstraction (st.connection) with built-in caching and secrets integration. |
lib/streamlit/connections/ |
| Custom Components |
User-built extensions using React/iframe. v1 (legacy): declare_component() API. v2 (current): Bidirectional components with improved state management. |
frontend/component-lib/, frontend/component-v2-lib/, lib/streamlit/components/v1/, lib/streamlit/components/v2/ |
| Static File Serving |
Files in static/ directory served directly via /app/static/* (when static serving is enabled). |
lib/streamlit/web/server/server.py, lib/streamlit/web/server/starlette/starlette_routes.py |
| App Testing |
Testing framework (AppTest) for simulating user interactions and inspecting rendered output. |
lib/streamlit/testing/ |
Core mental model
flowchart TB
subgraph Backend["Backend (Python)"]
Script[User Script]
DG[DeltaGenerator]
Runtime[Runtime/AppSession]
end
subgraph Protocol["WebSocket + Protobuf"]
FM[ForwardMsg]
BM[BackMsg]
end
subgraph Frontend["Frontend (React)"]
App[App.tsx]
Tree[AppRoot Tree]
Renderer[ElementNodeRenderer]
WSM[WidgetStateManager]
end
Script --> DG
DG --> FM
FM --> App
App --> Tree
Tree --> Renderer
Renderer --> WSM
WSM -->|User interaction| BM
BM --> Runtime
Runtime -->|Rerun| Script
Key insight: Script execution is rerun-driven: most widget interactions trigger reruns (full app or fragment-scoped). State persists via st.session_state and caching decorators.
Execution model
Streamlit's execution model differs from traditional web frameworks:
Rerun triggers:
- Widget interaction: User clicks button, moves slider, etc. (widgets with
on_change="ignore" update without a rerun)
- Source code change: File watcher detects script modification
st.rerun(): Explicit programmatic rerun
- Fragment timer:
@st.fragment(run_every=...) periodic reruns
Execution order nuances:
- Scripts execute top-to-bottom on every rerun
- Callbacks first:
on_change/on_click handlers run before the main script body
- Fragments typically isolate reruns: Widget interactions inside
@st.fragment usually rerun only that fragment
- Keyed fragment reruns:
st.rerun("<key>") from a widget callback reruns only the named @st.fragment(key=...) fragment(s)
- Control flow exceptions:
st.stop(), st.rerun(), st.switch_page() raise exceptions to halt/redirect execution
Session isolation:
- Each browser tab = separate
AppSession with its own SessionState
- Refreshing the page creates a new session (unless reconnecting within TTL)
- No shared state between sessions (use external storage for multi-user state)
What persists across reruns (within a session):
st.session_state values
- Cached function results (
@st.cache_data, @st.cache_resource)
- Uploaded files
- Fragment registrations
What resets on each rerun:
- Local variables in script
- Widget return values (re-read from
SessionState)
- Element tree (rebuilt from scratch, then diffed)
Architecture layers
Backend (Python)
| Component |
File |
Purpose |
| Runtime |
lib/streamlit/runtime/runtime.py |
Singleton managing app lifecycle and sessions |
| AppSession |
lib/streamlit/runtime/app_session.py |
Per-browser-tab: ScriptRunner + SessionState + ForwardMsgQueue |
| ScriptRunner |
lib/streamlit/runtime/scriptrunner/script_runner.py |
Executes user scripts in separate thread |
| DeltaGenerator |
lib/streamlit/delta_generator.py |
API entry point using mixin pattern |
| SessionState |
lib/streamlit/runtime/state/session_state.py |
Widget values and user variables |
| Elements |
lib/streamlit/elements/ |
Backend implementation of st.* commands |
For backend deep dive: See references/backend.md
Frontend (TypeScript/React)
| Component |
File |
Purpose |
| App |
frontend/app/src/App.tsx |
Central orchestrator |
| AppRoot |
frontend/lib/src/render-tree/AppRoot.ts |
Immutable element tree with 4 containers |
| ElementNodeRenderer |
frontend/lib/src/components/core/Block/ElementNodeRenderer.tsx |
Maps protos to React components |
| WidgetStateManager |
frontend/lib/src/WidgetStateManager.ts |
Widget state, forms, query params |
| ConnectionManager |
frontend/connection/src/ConnectionManager.ts |
WebSocket state machine |
For frontend deep dive: See references/frontend.md
Communication (Protobuf)
| Proto |
Purpose |
ForwardMsg.proto |
Server to client: deltas, session events, navigation |
BackMsg.proto |
Client to server: rerun requests with widget states |
Element.proto |
~50+ element types in oneof type union |
WidgetStates.proto |
Widget values: trigger_value, string_value, bool_value, etc. |
Location: proto/streamlit/proto/
For protocol deep dive: See references/communication.md
Essential concepts (quick map)
- Layout system: Width/height parameters for elements, flexbox containers, and responsive sizing.
- Deep dive: references/layout.md
- Script rerun model: Widget interaction ->
BackMsg (ClientState) -> backend updates SessionState -> script rerun -> ForwardMsg deltas.
- Deep dive:
references/communication.md#widget-interaction-to-script-rerun
- Delta path system: Elements are addressed by delta paths (for example
[0, 2, 3]) to support efficient tree updates.
- Deep dive:
references/communication.md#delta-ui-changes
active_script_hash semantics: ForwardMsg.metadata.active_script_hash scopes node ownership across multipage and fragment reruns.
- Deep dive:
references/communication.md#forwardmsg-metadata-active_script_hash
- Element tree structure: Frontend
AppRoot maintains main, sidebar, event, and bottom containers with BlockNode/ElementNode.
- Deep dive:
references/frontend.md#element-tree-frontendlibsrcrender-tree
- Element identity semantics: Delta paths decide where a node lives; element IDs decide whether stateful elements can reconnect to prior state after remounts.
- Deep dive:
references/element-identity.md
- Fragments (
@st.fragment): Fragment interactions usually trigger fragment-scoped reruns and update only affected regions. A widget callback can also target named fragments with st.rerun("<key>") when the fragment was declared with @st.fragment(key=...).
- Deep dive: references/backend.md
Element identity
- Delta path controls where a node is placed in the render tree.
- Element ID controls whether a stateful element can reconnect to prior state after remounts.
- Widgets use the ID to connect frontend
WidgetStateManager state, BackMsg.WidgetStates, backend SessionState, callbacks, and st.session_state.
- Some non-widgets also use IDs for frontend-only reconstruction (for example chart view state or media autoplay guards).
- Delta-path changes can remount elements, but a stable
element.id can still let React preserve a leaf when it remains under the same rendered parent list.
Deep dive: references/element-identity.md
Key implementation patterns
- Backend mixin composition:
DeltaGenerator composes st.* API via mixins.
- Deep dive:
references/backend.md#deltagenerator-libstreamlitdelta_generatorpy
- Frontend visitor pattern: Render-tree updates/staleness cleanup use visitors.
- Deep dive:
references/frontend.md#visitor-pattern
- Message deduplication:
ForwardMsg.hash + ref_hash with frontend ForwardMsgCache reduces bandwidth.
- Deep dive:
references/communication.md#message-caching
Quick reference: adding features
- Proto definition:
proto/streamlit/proto/<Element>.proto
- Register in Element.proto: Add to
oneof type
- Backend mixin:
lib/streamlit/elements/<element>.py
- Frontend component:
frontend/lib/src/components/elements/<Element>/ or frontend/lib/src/components/widgets/<Element>/ (depending on element vs widget)
- Register in ElementNodeRenderer: Add case to switch statement
- Compile protos:
make protobuf
See wiki/new-feature-guide.md for a detailed implementation guide.
Maintaining this documentation
When making changes that impact any of the concepts documented here (Runtime, AppSession, DeltaGenerator, element tree, communication protocol, element identity, etc.), update the relevant sections in this skill's files (SKILL.md, references/backend.md, references/frontend.md, references/communication.md, references/element-identity.md) to keep them accurate.
1---2name: understanding-streamlit-architecture3description: Explains Streamlit's internal architecture including backend runtime, frontend rendering, and WebSocket communication. Use when debugging cross-layer issues, understanding how features work end-to-end, planning architectural changes, or onboarding to the codebase. Covers ForwardMsg/BackMsg protocol, script rerun model, element tree, widget state management, and more.4---56# Understanding Streamlit architecture78Streamlit is a client-server application with bidirectional WebSocket communication using Protocol Buffers.9Use this file as a quick mental model and navigation index; use `references/backend.md`, `references/frontend.md`, and `references/communication.md` for implementation details.1011## Concepts glossary1213| Concept | Description | Key files |14|---------|-------------|-----------|15| **Command** | Any function exposed in Streamlit's public API (`st.*` namespace). Commands can create elements/widgets, control execution flow, or configure app behavior. | `lib/streamlit/delta_generator.py`, `lib/streamlit/elements/`, `lib/streamlit/commands/` |16| **Element** | Umbrella term for all UI components in Streamlit: widgets, containers, and display elements. Represented in `Element.proto` as a `oneof` union of ~50+ types. | `proto/streamlit/proto/Element.proto`, `lib/streamlit/elements/` |17| **Widget** | Interactive element (button, slider, text_input) that typically triggers a rerun on user interaction. Value accessible via return value or `st.session_state`. Widgets that support `on_change="ignore"` update in the browser without rerunning until something else does. Some elements become widgets conditionally (e.g., dataframe/chart with `on_select`). | `lib/streamlit/elements/widgets/`, `frontend/lib/src/components/widgets/` |18| **Display Element** | Non-interactive element (text, markdown, image, chart) that renders content without triggering reruns by itself. | `lib/streamlit/elements/`, `frontend/lib/src/components/elements/` |19| **Container** | Layout block that groups elements spatially (sidebar, columns, expander, tabs, form). Represented as `BlockNode` in the element tree. | `lib/streamlit/elements/layouts.py`, `Block.proto` |20| **DeltaGenerator** | The `st` object; API entry point that queues UI deltas. Uses mixin pattern to compose all `st.*` commands. | `lib/streamlit/delta_generator.py` |21| **Session State** | Per-session dictionary (`st.session_state`) persisting data across reruns. Stores widget values and user variables. | `lib/streamlit/runtime/state/session_state.py` |22| **Rerun** | Re-execution of the user script for the current page. Triggered by widget interactions, `st.rerun()`, file changes, or fragment timers. Rebuilds the element tree while preserving session state. | `lib/streamlit/runtime/scriptrunner/script_runner.py`, `lib/streamlit/commands/execution_control.py` |23| **Form** | Container (`st.form`) that batches widget inputs, deferring reruns until form submission. | `lib/streamlit/elements/form.py`, `WidgetStateManager.ts` |24| **Fragment** | Decorator (`@st.fragment`) enabling partial reruns of specific UI sections without full script re-execution. | `lib/streamlit/runtime/fragment.py` |25| **Caching** | Decorators (`@st.cache_data`, `@st.cache_resource`) that memoize function results to avoid redundant computation. | `lib/streamlit/runtime/caching/` |26| **Pages** | Multipage app system using `st.navigation()` and `st.Page()` or auto-discovery from `pages/` directory. | `lib/streamlit/navigation/`, `lib/streamlit/runtime/pages_manager.py` |27| **Config** | App configuration via `.streamlit/config.toml` controlling server, client, and theme settings. | `lib/streamlit/config.py`, `lib/streamlit/config_option.py` |28| **Theming** | Customizable UI themes (Light/Dark/Custom) defined in config or via theme editor. | `lib/streamlit/runtime/theme_util.py`, `frontend/lib/src/theme/` |29| **Secrets** | Secure credential storage via `.streamlit/secrets.toml` (local) or platform settings (deployed). Accessed via `st.secrets`. | `lib/streamlit/runtime/secrets.py` |30| **Connection** | Database/service abstraction (`st.connection`) with built-in caching and secrets integration. | `lib/streamlit/connections/` |31| **Custom Components** | User-built extensions using React/iframe. **v1 (legacy)**: `declare_component()` API. **v2 (current)**: Bidirectional components with improved state management. | `frontend/component-lib/`, `frontend/component-v2-lib/`, `lib/streamlit/components/v1/`, `lib/streamlit/components/v2/` |32| **Static File Serving** | Files in `static/` directory served directly via `/app/static/*` (when static serving is enabled). | `lib/streamlit/web/server/server.py`, `lib/streamlit/web/server/starlette/starlette_routes.py` |33| **App Testing** | Testing framework (`AppTest`) for simulating user interactions and inspecting rendered output. | `lib/streamlit/testing/` |3435## Core mental model3637```mermaid38flowchart TB39 subgraph Backend["Backend (Python)"]40 Script[User Script]41 DG[DeltaGenerator]42 Runtime[Runtime/AppSession]43 end4445 subgraph Protocol["WebSocket + Protobuf"]46 FM[ForwardMsg]47 BM[BackMsg]48 end4950 subgraph Frontend["Frontend (React)"]51 App[App.tsx]52 Tree[AppRoot Tree]53 Renderer[ElementNodeRenderer]54 WSM[WidgetStateManager]55 end5657 Script --> DG58 DG --> FM59 FM --> App60 App --> Tree61 Tree --> Renderer62 Renderer --> WSM63 WSM -->|User interaction| BM64 BM --> Runtime65 Runtime -->|Rerun| Script66```6768**Key insight**: Script execution is rerun-driven: most widget interactions trigger reruns (full app or fragment-scoped). State persists via `st.session_state` and caching decorators.6970## Execution model7172Streamlit's execution model differs from traditional web frameworks:7374**Rerun triggers**:751. **Widget interaction**: User clicks button, moves slider, etc. (widgets with `on_change="ignore"` update without a rerun)762. **Source code change**: File watcher detects script modification773. **`st.rerun()`**: Explicit programmatic rerun784. **Fragment timer**: `@st.fragment(run_every=...)` periodic reruns7980**Execution order nuances**:81- Scripts execute **top-to-bottom** on every rerun82- **Callbacks first**: `on_change`/`on_click` handlers run *before* the main script body83- **Fragments typically isolate reruns**: Widget interactions inside `@st.fragment` usually rerun only that fragment84- **Keyed fragment reruns**: `st.rerun("<key>")` from a widget callback reruns only the named `@st.fragment(key=...)` fragment(s)85- **Control flow exceptions**: `st.stop()`, `st.rerun()`, `st.switch_page()` raise exceptions to halt/redirect execution8687**Session isolation**:88- Each browser tab = separate `AppSession` with its own `SessionState`89- Refreshing the page creates a new session (unless reconnecting within TTL)90- No shared state between sessions (use external storage for multi-user state)9192**What persists across reruns** (within a session):93- `st.session_state` values94- Cached function results (`@st.cache_data`, `@st.cache_resource`)95- Uploaded files96- Fragment registrations9798**What resets on each rerun**:99- Local variables in script100- Widget return values (re-read from `SessionState`)101- Element tree (rebuilt from scratch, then diffed)102103## Architecture layers104105### Backend (Python)106107| Component | File | Purpose |108|-----------|------|---------|109| Runtime | `lib/streamlit/runtime/runtime.py` | Singleton managing app lifecycle and sessions |110| AppSession | `lib/streamlit/runtime/app_session.py` | Per-browser-tab: ScriptRunner + SessionState + ForwardMsgQueue |111| ScriptRunner | `lib/streamlit/runtime/scriptrunner/script_runner.py` | Executes user scripts in separate thread |112| DeltaGenerator | `lib/streamlit/delta_generator.py` | API entry point using mixin pattern |113| SessionState | `lib/streamlit/runtime/state/session_state.py` | Widget values and user variables |114| Elements | `lib/streamlit/elements/` | Backend implementation of `st.*` commands |115116**For backend deep dive**: See [references/backend.md](references/backend.md)117118### Frontend (TypeScript/React)119120| Component | File | Purpose |121|-----------|------|---------|122| App | `frontend/app/src/App.tsx` | Central orchestrator |123| AppRoot | `frontend/lib/src/render-tree/AppRoot.ts` | Immutable element tree with 4 containers |124| ElementNodeRenderer | `frontend/lib/src/components/core/Block/ElementNodeRenderer.tsx` | Maps protos to React components |125| WidgetStateManager | `frontend/lib/src/WidgetStateManager.ts` | Widget state, forms, query params |126| ConnectionManager | `frontend/connection/src/ConnectionManager.ts` | WebSocket state machine |127128**For frontend deep dive**: See [references/frontend.md](references/frontend.md)129130### Communication (Protobuf)131132| Proto | Purpose |133|-------|---------|134| `ForwardMsg.proto` | Server to client: deltas, session events, navigation |135| `BackMsg.proto` | Client to server: rerun requests with widget states |136| `Element.proto` | ~50+ element types in `oneof type` union |137| `WidgetStates.proto` | Widget values: `trigger_value`, `string_value`, `bool_value`, etc. |138139**Location**: `proto/streamlit/proto/`140141**For protocol deep dive**: See [references/communication.md](references/communication.md)142143## Essential concepts (quick map)144145- **Layout system**: Width/height parameters for elements, flexbox containers, and responsive sizing.146 - Deep dive: [references/layout.md](references/layout.md)147- **Script rerun model**: Widget interaction -> `BackMsg` (`ClientState`) -> backend updates `SessionState` -> script rerun -> `ForwardMsg` deltas.148 - Deep dive: `references/communication.md#widget-interaction-to-script-rerun`149- **Delta path system**: Elements are addressed by delta paths (for example `[0, 2, 3]`) to support efficient tree updates.150 - Deep dive: `references/communication.md#delta-ui-changes`151- **`active_script_hash` semantics**: `ForwardMsg.metadata.active_script_hash` scopes node ownership across multipage and fragment reruns.152 - Deep dive: `references/communication.md#forwardmsg-metadata-active_script_hash`153- **Element tree structure**: Frontend `AppRoot` maintains `main`, `sidebar`, `event`, and `bottom` containers with `BlockNode`/`ElementNode`.154 - Deep dive: `references/frontend.md#element-tree-frontendlibsrcrender-tree`155- **Element identity semantics**: Delta paths decide where a node lives; element IDs decide whether stateful elements can reconnect to prior state after remounts.156 - Deep dive: `references/element-identity.md`157- **Fragments (`@st.fragment`)**: Fragment interactions usually trigger fragment-scoped reruns and update only affected regions. A widget callback can also target named fragments with `st.rerun("<key>")` when the fragment was declared with `@st.fragment(key=...)`.158 - Deep dive: [references/backend.md](references/backend.md#fragment-system-stfragment)159160## Element identity161162- **Delta path** controls where a node is placed in the render tree.163- **Element ID** controls whether a stateful element can reconnect to prior state after remounts.164- **Widgets** use the ID to connect frontend `WidgetStateManager` state, `BackMsg.WidgetStates`, backend `SessionState`, callbacks, and `st.session_state`.165- **Some non-widgets** also use IDs for frontend-only reconstruction (for example chart view state or media autoplay guards).166- **Delta-path changes can remount elements**, but a stable `element.id` can still let React preserve a leaf when it remains under the same rendered parent list.167168Deep dive: `references/element-identity.md`169170## Key implementation patterns171172- **Backend mixin composition**: `DeltaGenerator` composes `st.*` API via mixins.173 - Deep dive: `references/backend.md#deltagenerator-libstreamlitdelta_generatorpy`174- **Frontend visitor pattern**: Render-tree updates/staleness cleanup use visitors.175 - Deep dive: `references/frontend.md#visitor-pattern`176- **Message deduplication**: `ForwardMsg.hash` + `ref_hash` with frontend `ForwardMsgCache` reduces bandwidth.177 - Deep dive: `references/communication.md#message-caching`178179## Quick reference: adding features1801811. **Proto definition**: `proto/streamlit/proto/<Element>.proto`1822. **Register in Element.proto**: Add to `oneof type`1833. **Backend mixin**: `lib/streamlit/elements/<element>.py`1844. **Frontend component**: `frontend/lib/src/components/elements/<Element>/` or `frontend/lib/src/components/widgets/<Element>/` (depending on element vs widget)1855. **Register in ElementNodeRenderer**: Add case to switch statement1866. **Compile protos**: `make protobuf`187188See `wiki/new-feature-guide.md` for a detailed implementation guide.189190## Maintaining this documentation191192When making changes that impact any of the concepts documented here (Runtime, AppSession, DeltaGenerator, element tree, communication protocol, element identity, etc.), update the relevant sections in this skill's files (`SKILL.md`, `references/backend.md`, `references/frontend.md`, `references/communication.md`, `references/element-identity.md`) to keep them accurate.