OpenClaw Debugging
Use this skill when OpenClaw behavior differs between local tests, live models,
providers, code mode, Tool Search, Crabbox, or CI, and the next move should be a
debug signal rather than a guess.
Read First
docs/logging.md for log files, openclaw logs, and targeted debug flags.
docs/reference/test.md for local test commands.
docs/reference/code-mode.md for code-mode exec/wait and tool catalog rules.
- Use
$openclaw-testing for choosing test lanes.
- Use
$crabbox for broad, Docker, package, Linux, live-key, or CI-parity proof.
Default Loop
- State the suspected boundary: config, tool construction, provider payload,
fetch, stream/SSE, transcript replay, worker/runtime, package/dist, or CI.
- Add or enable the narrowest signal that proves that boundary.
- Reproduce with the same provider/model/config. Do not randomly switch models
unless the model itself is the variable being tested.
- Compare configured state with actual run activation.
- Patch the root cause.
- Rerun the exact failing probe, then broaden only if the contract requires it.
Model Transport Logs
Use targeted env flags instead of global debug when the model request shape or
stream timing matters:
OPENCLAW_DEBUG_MODEL_TRANSPORT=1 openclaw gateway
OPENCLAW_DEBUG_MODEL_PAYLOAD=tools OPENCLAW_DEBUG_SSE=events openclaw gateway
OPENCLAW_DEBUG_MODEL_PAYLOAD=full-redacted OPENCLAW_DEBUG_SSE=peek openclaw gateway
Useful flags:
OPENCLAW_DEBUG_MODEL_TRANSPORT=1: request start, fetch response, SDK
headers, first SSE event, stream done, and transport errors at info.
OPENCLAW_DEBUG_MODEL_PAYLOAD=summary: bounded payload summary.
OPENCLAW_DEBUG_MODEL_PAYLOAD=tools: all model-facing tool names.
OPENCLAW_DEBUG_MODEL_PAYLOAD=full-redacted: capped, redacted JSON payload.
Use only while debugging; prompts/message text may still appear.
OPENCLAW_DEBUG_SSE=events: first-event and stream-completion timing.
OPENCLAW_DEBUG_SSE=peek: first five redacted SSE events.
OPENCLAW_DEBUG_CODE_MODE=1: code-mode tool-surface diagnostics.
Watch logs with:
openclaw logs --follow
Common Boundaries
- Config vs activation: config can be enabled while the run disables tools,
is raw, has an empty allowlist, or lacks model tool support. Check the actual
visible tools before enforcing provider payload invariants.
- Tool surface: inspect final model-visible tool names, not only the tool
registry or config. Code mode means exactly
exec and wait only after it
actually activates.
- Provider payload: log fields, model id, service tier, reasoning, input
size, metadata keys, prompt-cache key presence, and tool names before SDK
call.
- Fetch vs SSE: fetch response proves HTTP headers arrived; first SSE event
proves provider body progress. A gap here is a stream/body/provider issue, not
tool execution.
- Worker/dist: run
pnpm build when touching workers, dynamic imports,
package exports, lazy runtime boundaries, or published paths.
- Live keys: check local
~/.profile for key presence/length before saying
live proof is blocked. Never print secrets.
Code Pointers
- Model payload + Responses stream:
src/agents/openai-transport-stream.ts
- Guarded fetch/timing:
src/agents/provider-transport-fetch.ts
- OpenAI/Codex provider wrappers:
src/agents/pi-embedded-runner/openai-stream-wrappers.ts
- Tool construction, Tool Search, code-mode activation:
src/agents/pi-embedded-runner/run/attempt.ts
- Code-mode runtime and worker:
src/agents/code-mode.ts
src/agents/code-mode.worker.ts
- Tool Search catalog:
src/agents/tool-search.ts
Proof Choice
- Single helper/payload bug: local targeted Vitest.
- Docs/logging-only:
pnpm check:docs and git diff --check.
- Worker/dist/lazy import/package surface: targeted tests plus
pnpm build.
- Live provider/model behavior: same provider/model with debug flags and a real
key if available.
- Docker/package/Linux/CI-parity:
$crabbox.
- CI failure: exact SHA, relevant job only, logs only after failure/completion.
Output Habit
Report:
- boundary tested
- exact command/env shape, redacted
- observed signal, such as tool names or first SSE event timing
- fix location
- narrow proof and any remaining risk
1---2name: openclaw-debugging3description: Debug OpenClaw model, provider, tool-surface, code-mode, streaming, and live/Crabbox behavior by choosing the right logs, probes, and proof path before changing code.4---56# OpenClaw Debugging78Use this skill when OpenClaw behavior differs between local tests, live models,9providers, code mode, Tool Search, Crabbox, or CI, and the next move should be a10debug signal rather than a guess.1112## Read First1314- `docs/logging.md` for log files, `openclaw logs`, and targeted debug flags.15- `docs/reference/test.md` for local test commands.16- `docs/reference/code-mode.md` for code-mode exec/wait and tool catalog rules.17- Use `$openclaw-testing` for choosing test lanes.18- Use `$crabbox` for broad, Docker, package, Linux, live-key, or CI-parity proof.1920## Default Loop21221. State the suspected boundary: config, tool construction, provider payload,23 fetch, stream/SSE, transcript replay, worker/runtime, package/dist, or CI.242. Add or enable the narrowest signal that proves that boundary.253. Reproduce with the same provider/model/config. Do not randomly switch models26 unless the model itself is the variable being tested.274. Compare configured state with actual run activation.285. Patch the root cause.296. Rerun the exact failing probe, then broaden only if the contract requires it.3031## Model Transport Logs3233Use targeted env flags instead of global debug when the model request shape or34stream timing matters:3536```bash37OPENCLAW_DEBUG_MODEL_TRANSPORT=1 openclaw gateway38OPENCLAW_DEBUG_MODEL_PAYLOAD=tools OPENCLAW_DEBUG_SSE=events openclaw gateway39OPENCLAW_DEBUG_MODEL_PAYLOAD=full-redacted OPENCLAW_DEBUG_SSE=peek openclaw gateway40```4142Useful flags:4344- `OPENCLAW_DEBUG_MODEL_TRANSPORT=1`: request start, fetch response, SDK45 headers, first SSE event, stream done, and transport errors at `info`.46- `OPENCLAW_DEBUG_MODEL_PAYLOAD=summary`: bounded payload summary.47- `OPENCLAW_DEBUG_MODEL_PAYLOAD=tools`: all model-facing tool names.48- `OPENCLAW_DEBUG_MODEL_PAYLOAD=full-redacted`: capped, redacted JSON payload.49 Use only while debugging; prompts/message text may still appear.50- `OPENCLAW_DEBUG_SSE=events`: first-event and stream-completion timing.51- `OPENCLAW_DEBUG_SSE=peek`: first five redacted SSE events.52- `OPENCLAW_DEBUG_CODE_MODE=1`: code-mode tool-surface diagnostics.5354Watch logs with:5556```bash57openclaw logs --follow58```5960## Common Boundaries6162- **Config vs activation:** config can be enabled while the run disables tools,63 is raw, has an empty allowlist, or lacks model tool support. Check the actual64 visible tools before enforcing provider payload invariants.65- **Tool surface:** inspect final model-visible tool names, not only the tool66 registry or config. Code mode means exactly `exec` and `wait` only after it67 actually activates.68- **Provider payload:** log fields, model id, service tier, reasoning, input69 size, metadata keys, prompt-cache key presence, and tool names before SDK70 call.71- **Fetch vs SSE:** fetch response proves HTTP headers arrived; first SSE event72 proves provider body progress. A gap here is a stream/body/provider issue, not73 tool execution.74- **Worker/dist:** run `pnpm build` when touching workers, dynamic imports,75 package exports, lazy runtime boundaries, or published paths.76- **Live keys:** check local `~/.profile` for key presence/length before saying77 live proof is blocked. Never print secrets.7879## Code Pointers8081- Model payload + Responses stream:82 `src/agents/openai-transport-stream.ts`83- Guarded fetch/timing:84 `src/agents/provider-transport-fetch.ts`85- OpenAI/Codex provider wrappers:86 `src/agents/pi-embedded-runner/openai-stream-wrappers.ts`87- Tool construction, Tool Search, code-mode activation:88 `src/agents/pi-embedded-runner/run/attempt.ts`89- Code-mode runtime and worker:90 `src/agents/code-mode.ts`91 `src/agents/code-mode.worker.ts`92- Tool Search catalog:93 `src/agents/tool-search.ts`9495## Proof Choice9697- Single helper/payload bug: local targeted Vitest.98- Docs/logging-only: `pnpm check:docs` and `git diff --check`.99- Worker/dist/lazy import/package surface: targeted tests plus `pnpm build`.100- Live provider/model behavior: same provider/model with debug flags and a real101 key if available.102- Docker/package/Linux/CI-parity: `$crabbox`.103- CI failure: exact SHA, relevant job only, logs only after failure/completion.104105## Output Habit106107Report:108109- boundary tested110- exact command/env shape, redacted111- observed signal, such as tool names or first SSE event timing112- fix location113- narrow proof and any remaining risk