CloudBase Agent Python SDK
Build production-ready AI agent backends with multi-framework support, streaming
protocol, rich tools, persistent memory, and full observability.
Note: This skill is for Python projects only.
When to use this skill
Use this skill for AI agent development when you need to:
- Deploy AI agents as HTTP services with AG-UI protocol support
- Build agent backends using LangGraph, CrewAI, or LlamaIndex frameworks
- Create custom agent adapters implementing the AbstractAgent interface
- Understand AG-UI protocol events and message streaming
- Build production-ready agent servers with FastAPI
Do NOT use for:
- Simple AI model calling without agent capabilities (use
ai-model-* skills)
- CloudBase cloud functions (use
cloud-functions skill)
- CloudRun backend services without agent features (use
cloudrun-development skill)
- TypeScript/JavaScript agent projects (use
cloudbase-agent skill, refer to the ts/ sub-directory)
How to use this skill (for a coding agent)
Choose the right adapter
- Use LangGraph adapter for stateful, graph-based workflows
- Use CrewAI adapter for multi-agent collaboration patterns
- Build custom adapter for specialized agent logic
Write agent code — follow the adapter-specific doc from the Routing table
Deploy the agent server — follow the blocking deployment pipeline in agent-deployment
Routing (Execution Order)
⚠️ Deployment is a BLOCKING 4-step pipeline. Steps marked ✅ BLOCKING
must be completed AND verified before proceeding to the next step.
Do NOT call manageAgent until all blocking steps pass.
| Step |
Task |
Document |
Blocking? |
| 0 |
Choose adapter & write agent code |
See "Adapter Selection" below |
— |
| 1 |
Ensure Python 3.10 |
agent-deployment § Step 1 |
✅ BLOCKING |
| 2 |
Build env/ (one-shot) |
agent-deployment § Step 2 |
✅ BLOCKING |
| 3 |
Verify env/ integrity |
agent-deployment § Step 3 |
✅ BLOCKING |
| 4 |
Deploy with manageAgent |
agent-deployment § Step 4 |
— |
Adapter Selection (Step 0)
| Framework |
Read |
Install |
| LangGraph (stateful graphs) |
adapter-langgraph |
cloudbase-agent-langgraph |
| CrewAI (multi-agent crews) |
adapter-development |
cloudbase-agent-crewai |
| Coze platform |
adapter-coze |
cloudbase-agent-coze |
| Custom / raw FastAPI |
server-quickstart + adapter-development |
cloudbase-agent-server |
Additional References (read on demand, NOT required for deployment)
| Task |
Read |
| Server setup, middleware, multi-agent, CORS |
server-quickstart |
| Authentication and user context |
authentication |
Quick Start (Framework-Agnostic)
Prerequisites: Python >= 3.10 is required.
1. Install dependencies (pick ONE adapter):
# Option A: LangGraph-based agent
pip install cloudbase-agent-langgraph
# Option B: CrewAI-based agent
pip install cloudbase-agent-crewai
# Option C: Custom / minimal
pip install cloudbase-agent-server
2. Create server entry point:
# server.py — this pattern works with ANY adapter
import os
from dotenv import load_dotenv
load_dotenv()
from cloudbase_agent.server import AgentServiceApp, AgentCreatorResult
# Import your agent (framework-specific, see adapter docs)
# from agents.chat.agent import create_my_agent
def create_agent() -> AgentCreatorResult:
agent = create_my_agent() # Your agent factory
return {"agent": agent}
app = AgentServiceApp()
app.set_cors_config(allow_origins=["*"])
if __name__ == "__main__":
port = int(os.environ.get("SCF_RUNTIME_PORT", "9000"))
app.run(create_agent, port=port, host="0.0.0.0")
3. Deploy to CloudBase:
Follow the 4-step deployment pipeline in agent-deployment.
Architecture
Client (React / MiniProgram / curl)
│ HTTP POST + SSE streaming
▼
┌─────────────────────────────────────────────┐
│ AgentServiceApp (FastAPI) │
│ ├─ /send-message ← AG-UI SSE │
│ ├─ /chat/completions ← OpenAI-compat │
│ └─ Middleware chain (onion model) │
├─────────────────────────────────────────────┤
│ Agent Layer │
│ ├─ LangGraphAgent ├─ CrewAIAgent │
│ ├─ LlamaIndexAgent ├─ CozeAgent/DifyAgent │
│ └─ BaseAgent (extend for custom) │
├──────────────────┬──────────────────────────┤
│ Tools │ Storage │
│ Bash/FS/Code/MCP│ Memory + LongTermMemory │
├─────────────────────────────────────────────┤
│ Observability (OpenTelemetry + Langfuse) │
└─────────────────────────────────────────────┘
Installation
CloudBase Agent Python SDK is published to PyPI as separate packages. Note: PyPI package names use hyphens (cloudbase-agent-*), and Python imports use the same namespace (cloudbase_agent.*).
# Core + Server + LangGraph (most common)
pip install cloudbase-agent-langgraph
# Individual packages
pip install cloudbase-agent-core # Core framework
pip install cloudbase-agent-server # FastAPI server
pip install cloudbase-agent-langgraph # LangGraph integration
pip install cloudbase-agent-tools # Tool system
pip install cloudbase-agent-storage # Memory/Storage
pip install cloudbase-agent-observability # OpenTelemetry/Langfuse
pip install cloudbase-agent-coze # Coze platform
pip install cloudbase-agent-crewai # CrewAI integration
Import Note: All packages share the cloudbase_agent namespace:
# After installing cloudbase-agent-langgraph, import from cloudbase_agent
from cloudbase_agent.langgraph import LangGraphAgent
from cloudbase_agent.server import AgentServiceApp
from cloudbase_agent.tools import create_bash_tool
Reference Documents
Based on what the user needs, read the corresponding reference document.
Only read the relevant reference — don't load all of them.
| User Need |
Reference |
What It Covers |
| Deploying agent to CloudBase |
Read agent-deployment |
manageAgent MCP tool (MUST USE), 4-step blocking pipeline, Python 3.10, env/ build, verification |
| Server setup, deployment, middleware, multi-agent, CORS |
Read references/server.md |
AgentServiceApp 3 deployment methods, middleware (generator/yield/onion model), multi-agent server, Agent Creator pattern, health checks |
| LangGraph agent, callbacks, tool proxy, HITL, checkpoints |
Read adapter-langgraph |
LangGraphAgent constructor, AgentCallback protocol, ToolProxy, human-in-the-loop with interrupt(), TDAICheckpointSaver, client-defined tools |
| Tools: bash, filesystem, code execution, MCP, custom tools |
Read references/tools.md |
create_bash_tool, 8 file tools, code executors, MCPToolkit/CloudBaseMCPServer, @tool decorator, BaseTool, framework adapters |
| Memory, persistence, short/long-term, MySQL, MongoDB |
Read references/storage.md |
InMemoryMemory, TDAIMemory, MySQLMemory, MongoDBMemory, TDAILongTermMemory, Mem0LongTermMemory, LangGraph checkpoint |
| Tracing, monitoring, Langfuse, OpenTelemetry |
Read references/observability.md |
ConsoleTraceConfig, OTLPTraceConfig, setup_observability, env vars, manual observation spans |
| Common patterns, JWT auth, MCP integration, production |
Read references/recipes.md |
JWT middleware, MCP + LangGraph, production deployment, adding tools to agents, client-defined tools |
Key Imports Quick Reference
# Server
from cloudbase_agent.server import AgentServiceApp, AgentCreatorResult
from cloudbase_agent.server import create_send_message_adapter, create_openai_adapter
from cloudbase_agent.server import RunAgentInput, OpenAIChatCompletionRequest
# Agents
from cloudbase_agent.langgraph import LangGraphAgent
from cloudbase_agent.crewai import CrewAIAgent
# Tools
from cloudbase_agent.tools import create_bash_tool, create_read_tool, create_write_tool
from cloudbase_agent.tools import MCPToolkit, CloudBaseMCPServer, CloudBaseTool
from cloudbase_agent.tools import tool, BaseTool # custom tools
# Storage
from cloudbase_agent.storage import InMemoryMemory, TDAIMemory
from cloudbase_agent.storage import TDAILongTermMemory, Mem0LongTermMemory
from cloudbase_agent.langgraph import TDAICheckpointSaver, TDAIStore
# Observability
from cloudbase_agent.observability import ConsoleTraceConfig, OTLPTraceConfig, setup_observability
# Schemas
from cloudbase_agent.schemas import Message, MessageRole, StreamEvent, EventType
Project Structure Convention
my-agent-project/
├── agents/
│ ├── agentic_chat/agent.py # build_workflow() → agent instance
│ ├── human_in_the_loop/agent.py
│ └── __init__.py
├── server.py # Main entry: AgentServiceApp().run(...)
├── scf_bootstrap # CloudBase startup script (required for deployment)
├── .env # OPENAI_API_KEY, etc.
└── requirements.txt
Environment Variables
| Variable |
Purpose |
OPENAI_API_KEY |
OpenAI API key |
AUTO_TRACES_STDOUT |
Enable console tracing (true) |
LANGFUSE_PUBLIC_KEY / LANGFUSE_SECRET_KEY |
Langfuse keys |
TDAI_ENDPOINT / TDAI_API_KEY |
TDAI memory/checkpoint endpoint |
SCF_RUNTIME_PORT |
CloudBase runtime port (set automatically during deployment) |
Key Design Decisions
- Agent Creator Pattern: Every request creates a fresh agent via factory function. Supports cleanup callbacks for resource release.
- Dual Protocol: Every agent supports both AG-UI native (SSE + rich events) and OpenAI-compatible (
/chat/completions).
- Middleware = Generator: Use
yield — pre-yield = pre-processing, post-yield = post-processing (onion model).
- Namespace Package:
cloudbase_agent spans multiple PyPI packages (cloudbase-agent-core, cloudbase-agent-server, cloudbase-agent-langgraph, etc.). PyPI names use hyphens, but all imports use from cloudbase_agent.xxx import ....
- Observability Auto-Integration: Install
cloudbase-agent-observability and tracing works automatically — zero config needed.
- Deploy with manageAgent: Always use the
manageAgent MCP tool for CloudBase deployment. Follow the 4-step blocking pipeline in agent-deployment.
1---2name: cloudbase-agent-python3description: Build production-ready AI agent backends using the CloudBase Agent Python SDK — create agents with LangGraph/CrewAI/LlamaIndex, serve them via FastAPI with AG-UI protocol streaming + OpenAI-compatible endpoints, add tools (bash, filesystem, MCP, code execution), memory (in-memory, TDAI, MySQL, MongoDB), observability (OpenTelemetry/Langfuse), and middleware (auth, logging). Use this skill when the user wants to create an AI agent server, build a chatbot backend, set up human-in-the-loop workflows, integrate MCP tools, add agent observability, or deploy an agent API — even if they don't explicitly mention 'CloudBase Agent.'4---56# CloudBase Agent Python SDK78Build production-ready AI agent backends with multi-framework support, streaming9protocol, rich tools, persistent memory, and full observability.1011> **Note:** This skill is for **Python** projects only.1213## When to use this skill1415Use this skill for **AI agent development** when you need to:1617- Deploy AI agents as HTTP services with AG-UI protocol support18- Build agent backends using LangGraph, CrewAI, or LlamaIndex frameworks19- Create custom agent adapters implementing the AbstractAgent interface20- Understand AG-UI protocol events and message streaming21- Build production-ready agent servers with FastAPI2223**Do NOT use for:**2425- Simple AI model calling without agent capabilities (use `ai-model-*` skills)26- CloudBase cloud functions (use `cloud-functions` skill)27- CloudRun backend services without agent features (use `cloudrun-development` skill)28- TypeScript/JavaScript agent projects (use `cloudbase-agent` skill, refer to the `ts/` sub-directory)2930## How to use this skill (for a coding agent)31321. **Choose the right adapter**33 - Use LangGraph adapter for stateful, graph-based workflows34 - Use CrewAI adapter for multi-agent collaboration patterns35 - Build custom adapter for specialized agent logic36372. **Write agent code** — follow the adapter-specific doc from the Routing table38393. **Deploy the agent server** — follow the **blocking deployment pipeline** in [agent-deployment](agent-deployment.md)4041## Routing (Execution Order)4243> ⚠️ **Deployment is a BLOCKING 4-step pipeline.** Steps marked ✅ BLOCKING44> must be completed AND verified before proceeding to the next step.45> Do NOT call `manageAgent` until all blocking steps pass.4647| Step | Task | Document | Blocking? |48| ---- | ------------------------------------- | ------------------------------------------------ | ----------- |49| 0 | **Choose adapter & write agent code** | See "Adapter Selection" below | — |50| 1 | **Ensure Python 3.10** | [agent-deployment](agent-deployment.md) § Step 1 | ✅ BLOCKING |51| 2 | **Build env/ (one-shot)** | [agent-deployment](agent-deployment.md) § Step 2 | ✅ BLOCKING |52| 3 | **Verify env/ integrity** | [agent-deployment](agent-deployment.md) § Step 3 | ✅ BLOCKING |53| 4 | **Deploy with manageAgent** | [agent-deployment](agent-deployment.md) § Step 4 | — |5455### Adapter Selection (Step 0)5657| Framework | Read | Install |58| --------------------------- | ----------------------------------------------------------------------------------------- | --------------------------- |59| LangGraph (stateful graphs) | [adapter-langgraph](adapter-langgraph.md) | `cloudbase-agent-langgraph` |60| CrewAI (multi-agent crews) | [adapter-development](adapter-development.md) | `cloudbase-agent-crewai` |61| Coze platform | [adapter-coze](adapter-coze.md) | `cloudbase-agent-coze` |62| Custom / raw FastAPI | [server-quickstart](server-quickstart.md) + [adapter-development](adapter-development.md) | `cloudbase-agent-server` |6364### Additional References (read on demand, NOT required for deployment)6566| Task | Read |67| ------------------------------------------- | ----------------------------------------- |68| Server setup, middleware, multi-agent, CORS | [server-quickstart](server-quickstart.md) |69| Authentication and user context | [authentication](authentication.md) |7071## Quick Start (Framework-Agnostic)7273**Prerequisites:** Python >= 3.10 is required.7475**1. Install dependencies (pick ONE adapter):**7677```bash78# Option A: LangGraph-based agent79pip install cloudbase-agent-langgraph8081# Option B: CrewAI-based agent82pip install cloudbase-agent-crewai8384# Option C: Custom / minimal85pip install cloudbase-agent-server86```8788**2. Create server entry point:**8990```python91# server.py — this pattern works with ANY adapter92import os93from dotenv import load_dotenv94load_dotenv()9596from cloudbase_agent.server import AgentServiceApp, AgentCreatorResult9798# Import your agent (framework-specific, see adapter docs)99# from agents.chat.agent import create_my_agent100101def create_agent() -> AgentCreatorResult:102 agent = create_my_agent() # Your agent factory103 return {"agent": agent}104105app = AgentServiceApp()106app.set_cors_config(allow_origins=["*"])107108if __name__ == "__main__":109 port = int(os.environ.get("SCF_RUNTIME_PORT", "9000"))110 app.run(create_agent, port=port, host="0.0.0.0")111```112113**3. Deploy to CloudBase:**114115Follow the **4-step deployment pipeline** in [agent-deployment](agent-deployment.md).116117---118119## Architecture120121```plain122Client (React / MiniProgram / curl)123 │ HTTP POST + SSE streaming124 ▼125┌─────────────────────────────────────────────┐126│ AgentServiceApp (FastAPI) │127│ ├─ /send-message ← AG-UI SSE │128│ ├─ /chat/completions ← OpenAI-compat │129│ └─ Middleware chain (onion model) │130├─────────────────────────────────────────────┤131│ Agent Layer │132│ ├─ LangGraphAgent ├─ CrewAIAgent │133│ ├─ LlamaIndexAgent ├─ CozeAgent/DifyAgent │134│ └─ BaseAgent (extend for custom) │135├──────────────────┬──────────────────────────┤136│ Tools │ Storage │137│ Bash/FS/Code/MCP│ Memory + LongTermMemory │138├─────────────────────────────────────────────┤139│ Observability (OpenTelemetry + Langfuse) │140└─────────────────────────────────────────────┘141```142143## Installation144145CloudBase Agent Python SDK is published to PyPI as separate packages. **Note: PyPI package names use hyphens (`cloudbase-agent-*`), and Python imports use the same namespace (`cloudbase_agent.*`)**.146147```bash148# Core + Server + LangGraph (most common)149pip install cloudbase-agent-langgraph150151# Individual packages152pip install cloudbase-agent-core # Core framework153pip install cloudbase-agent-server # FastAPI server154pip install cloudbase-agent-langgraph # LangGraph integration155pip install cloudbase-agent-tools # Tool system156pip install cloudbase-agent-storage # Memory/Storage157pip install cloudbase-agent-observability # OpenTelemetry/Langfuse158pip install cloudbase-agent-coze # Coze platform159pip install cloudbase-agent-crewai # CrewAI integration160```161162**Import Note**: All packages share the `cloudbase_agent` namespace:163164```python165# After installing cloudbase-agent-langgraph, import from cloudbase_agent166from cloudbase_agent.langgraph import LangGraphAgent167from cloudbase_agent.server import AgentServiceApp168from cloudbase_agent.tools import create_bash_tool169```170171## Reference Documents172173Based on what the user needs, read the corresponding reference document.174**Only read the relevant reference — don't load all of them.**175176| User Need | Reference | What It Covers |177| ---------------------------------------------------------- | ---------------------------------------------- | -------------------------------------------------------------------------------------------------------------------------------------------- |178| **Deploying agent to CloudBase** | Read [agent-deployment](agent-deployment.md) | **manageAgent MCP tool (MUST USE)**, 4-step blocking pipeline, Python 3.10, env/ build, verification |179| Server setup, deployment, middleware, multi-agent, CORS | Read `references/server.md` | AgentServiceApp 3 deployment methods, middleware (generator/yield/onion model), multi-agent server, Agent Creator pattern, health checks |180| LangGraph agent, callbacks, tool proxy, HITL, checkpoints | Read [adapter-langgraph](adapter-langgraph.md) | LangGraphAgent constructor, AgentCallback protocol, ToolProxy, human-in-the-loop with interrupt(), TDAICheckpointSaver, client-defined tools |181| Tools: bash, filesystem, code execution, MCP, custom tools | Read `references/tools.md` | create_bash_tool, 8 file tools, code executors, MCPToolkit/CloudBaseMCPServer, @tool decorator, BaseTool, framework adapters |182| Memory, persistence, short/long-term, MySQL, MongoDB | Read `references/storage.md` | InMemoryMemory, TDAIMemory, MySQLMemory, MongoDBMemory, TDAILongTermMemory, Mem0LongTermMemory, LangGraph checkpoint |183| Tracing, monitoring, Langfuse, OpenTelemetry | Read `references/observability.md` | ConsoleTraceConfig, OTLPTraceConfig, setup_observability, env vars, manual observation spans |184| Common patterns, JWT auth, MCP integration, production | Read `references/recipes.md` | JWT middleware, MCP + LangGraph, production deployment, adding tools to agents, client-defined tools |185186## Key Imports Quick Reference187188```python189# Server190from cloudbase_agent.server import AgentServiceApp, AgentCreatorResult191from cloudbase_agent.server import create_send_message_adapter, create_openai_adapter192from cloudbase_agent.server import RunAgentInput, OpenAIChatCompletionRequest193194# Agents195from cloudbase_agent.langgraph import LangGraphAgent196from cloudbase_agent.crewai import CrewAIAgent197198# Tools199from cloudbase_agent.tools import create_bash_tool, create_read_tool, create_write_tool200from cloudbase_agent.tools import MCPToolkit, CloudBaseMCPServer, CloudBaseTool201from cloudbase_agent.tools import tool, BaseTool # custom tools202203# Storage204from cloudbase_agent.storage import InMemoryMemory, TDAIMemory205from cloudbase_agent.storage import TDAILongTermMemory, Mem0LongTermMemory206from cloudbase_agent.langgraph import TDAICheckpointSaver, TDAIStore207208# Observability209from cloudbase_agent.observability import ConsoleTraceConfig, OTLPTraceConfig, setup_observability210211# Schemas212from cloudbase_agent.schemas import Message, MessageRole, StreamEvent, EventType213```214215## Project Structure Convention216217```plain218my-agent-project/219├── agents/220│ ├── agentic_chat/agent.py # build_workflow() → agent instance221│ ├── human_in_the_loop/agent.py222│ └── __init__.py223├── server.py # Main entry: AgentServiceApp().run(...)224├── scf_bootstrap # CloudBase startup script (required for deployment)225├── .env # OPENAI_API_KEY, etc.226└── requirements.txt227```228229## Environment Variables230231| Variable | Purpose |232| --------------------------------------------- | ------------------------------------------------------------ |233| `OPENAI_API_KEY` | OpenAI API key |234| `AUTO_TRACES_STDOUT` | Enable console tracing (`true`) |235| `LANGFUSE_PUBLIC_KEY` / `LANGFUSE_SECRET_KEY` | Langfuse keys |236| `TDAI_ENDPOINT` / `TDAI_API_KEY` | TDAI memory/checkpoint endpoint |237| `SCF_RUNTIME_PORT` | CloudBase runtime port (set automatically during deployment) |238239## Key Design Decisions2402411. **Agent Creator Pattern**: Every request creates a fresh agent via factory function. Supports cleanup callbacks for resource release.2422. **Dual Protocol**: Every agent supports both AG-UI native (SSE + rich events) and OpenAI-compatible (`/chat/completions`).2433. **Middleware = Generator**: Use `yield` — pre-yield = pre-processing, post-yield = post-processing (onion model).2444. **Namespace Package**: `cloudbase_agent` spans multiple PyPI packages (cloudbase-agent-core, cloudbase-agent-server, cloudbase-agent-langgraph, etc.). PyPI names use hyphens, but all imports use `from cloudbase_agent.xxx import ...`.2455. **Observability Auto-Integration**: Install `cloudbase-agent-observability` and tracing works automatically — zero config needed.2466. **Deploy with manageAgent**: Always use the `manageAgent` MCP tool for CloudBase deployment. Follow the **4-step blocking pipeline** in [agent-deployment](agent-deployment.md).