Building with extended thinking
Extended thinking gives Claude enhanced reasoning capabilities for complex tasks, while providing varying levels of transparency into its step-by-step thought process before it delivers its final answer.
Supported models
Extended thinking is supported in the following models:
- Claude Sonnet 4.5 (
claude-sonnet-4-5-20250929) - Claude Sonnet 4 (
claude-sonnet-4-20250514) - Claude Sonnet 3.7 (
claude-3-7-sonnet-20250219) (deprecated) - Claude Haiku 4.5 (
claude-haiku-4-5-20251001) - Claude Opus 4.5 (
claude-opus-4-5-20251101) - Claude Opus 4.1 (
claude-opus-4-1-20250805) - Claude Opus 4 (
claude-opus-4-20250514)
For more information, see Differences in thinking across model versions.
How extended thinking works
When extended thinking is turned on, Claude creates thinking content blocks where it outputs its internal reasoning. Claude incorporates insights from this reasoning before crafting a final response.
The API response will include thinking content blocks, followed by text content blocks.
Here's an example of the default response format:
{
"content": [
{
"type": "thinking",
"thinking": "Let me analyze this step by step...",
"signature": "WaUjzkypQ2mUEVM36O2TxuC06KN8xyfbJwyem2dw3URve/op91XWHOEBLLqIOMfFG/UvLEczmEsUjavL...."
},
{
"type": "text",
"text": "Based on my analysis..."
}
]
}
For more information about the response format of extended thinking, see the Messages API Reference.
How to use extended thinking
Here is an example of using extended thinking in the Messages API:
import anthropic
client = anthropic.Anthropic()
response = client.messages.create(
model="claude-sonnet-4-5",
max_tokens=16000,
thinking={
"type": "enabled",
"budget_tokens": 10000
},
messages=[{
"role": "user",
"content": "Are there an infinite number of prime numbers such that n mod 4 == 3?"
}]
)
# The response will contain summarized thinking blocks and text blocks
for block in response.content:
if block.type == "thinking":
print(f"\nThinking summary: {block.thinking}")
elif block.type == "text":
print(f"\nResponse: {block.text}")
import Anthropic from '@anthropic-ai/sdk';
const client = new Anthropic();
const response = await client.messages.create({
model: "claude-sonnet-4-5",
max_tokens: 16000,
thinking: {
type: "enabled",
budget_tokens: 10000
},
messages: [{
role: "user",
content: "Are there an infinite number of prime numbers such that n mod 4 == 3?"
}]
});
// The response will contain summarized thinking blocks and text blocks
for (const block of response.content) {
if (block.type === "thinking") {
console.log(`\nThinking summary: ${block.thinking}`);
} else if (block.type === "text") {
console.log(`\nResponse: ${block.text}`);
}
}
import com.anthropic.client.AnthropicClient;
import com.anthropic.client.okhttp.AnthropicOkHttpClient;
import com.anthropic.models.beta.messages.*;
import com.anthropic.models.beta.messages.MessageCreateParams;
import com.anthropic.models.messages.*;
public class SimpleThinkingExample {
public static void main(String[] args) {
AnthropicClient client = AnthropicOkHttpClient.fromEnv();
BetaMessage response = client.beta().messages().create(
MessageCreateParams.builder()
.model(Model.CLAUDE_OPUS_4_0)
.maxTokens(16000)
.thinking(BetaThinkingConfigEnabled.builder().budgetTokens(10000).build())
.addUserMessage("Are there an infinite number of prime numbers such that n mod 4 == 3?")
.build()
);
System.out.println(response);
}
}
To turn on extended thinking, add a thinking object, with the type parameter set to enabled and the budget_tokens to a specified token budget for extended thinking.
The budget_tokens parameter determines the maximum number of tokens Claude is allowed to use for its internal reasoning process. In Claude 4 models, this limit applies to full thinking tokens, and not to the summarized output. Larger budgets can improve response quality by enabling more thorough analysis for complex problems, although Claude may not use the entire budget allocated, especially at ranges above 32k.
budget_tokens must be set to a value less than max_tokens. However, when using interleaved thinking with tools, you can exceed this limit as the token limit becomes your entire context window (200k tokens).
Summarized thinking
With extended thinking enabled, the Messages API for Claude 4 models returns a summary of Claude's full thinking process. Summarized thinking provides the full intelligence benefits of extended thinking, while preventing misuse.
Here are some important considerations for summarized thinking:
- You're charged for the full thinking tokens generated by the original request, not the summary tokens.
- The billed output token count will not match the count of tokens you see in the response.
- The first few lines of thinking output are more verbose, providing detailed reasoning that's particularly helpful for prompt engineering purposes.
- As Anthropic seeks to improve the extended thinking feature, summarization behavior is subject to change.
- Summarization preserves the key ideas of Claude's thinking process with minimal added latency, enabling a streamable user experience and easy migration from Claude Sonnet 3.7 to Claude 4 models.
- Summarization is processed by a different model than the one you target in your requests. The thinking model does not see the summarized output.
In rare cases where you need access to full thinking output for Claude 4 models, contact our sales team.
Streaming thinking
You can stream extended thinking responses using server-sent events (SSE).
When streaming is enabled for extended thinking, you receive thinking content via thinking_delta events.
For more documention on streaming via the Messages API, see Streaming Messages.
Here's how to handle streaming with thinking:
import anthropic
client = anthropic.Anthropic()
with client.messages.stream(
model="claude-sonnet-4-5",
max_tokens=16000,
thinking={"type": "enabled", "budget_tokens": 10000},
messages=[{"role": "user", "content": "What is 27 * 453?"}],
) as stream:
thinking_started = False
response_started = False
for event in stream:
if event.type == "content_block_start":
print(f"\nStarting {event.content_block.type} block...")
# Reset flags for each new block
thinking_started = False
response_started = False
elif event.type == "content_block_delta":
if event.delta.type == "thinking_delta":
if not thinking_started:
print("Thinking: ", end="", flush=True)
thinking_started = True
print(event.delta.thinking, end="", flush=True)
elif event.delta.type == "text_delta":
if not response_started:
print("Response: ", end="", flush=True)
response_started = True
print(event.delta.text, end="", flush=True)
elif event.type == "content_block_stop":
print("\nBlock complete.")
import Anthropic from '@anthropic-ai/sdk';
const client = new Anthropic();
const stream = await client.messages.stream({
model: "claude-sonnet-4-5",
max_tokens: 16000,
thinking: {
type: "enabled",
budget_tokens: 10000
},
messages: [{
role: "user",
content: "What is 27 * 453?"
}]
});
let thinkingStarted = false;
let responseStarted = false;
for await (const event of stream) {
if (event.type === 'content_block_start') {
console.log(`\nStarting ${event.content_block.type} block...`);
// Reset flags for each new block
thinkingStarted = false;
responseStarted = false;
} else if (event.type === 'content_block_delta') {
if (event.delta.type === 'thinking_delta') {
if (!thinkingStarted) {
process.stdout.write('Thinking: ');
thinkingStarted = true;
}
process.stdout.write(event.delta.thinking);
} else if (event.delta.type === 'text_delta') {
if (!responseStarted) {
process.stdout.write('Response: ');
responseStarted = true;
}
process.stdout.write(event.delta.text);
}
} else if (event.type === 'content_block_stop') {
console.log('\nBlock complete.');
}
}
import com.anthropic.client.AnthropicClient;
import com.anthropic.client.okhttp.AnthropicOkHttpClient;
import com.anthropic.core.http.StreamResponse;
import com.anthropic.models.beta.messages.MessageCreateParams;
import com.anthropic.models.beta.messages.BetaRawMessageStreamEvent;
import com.anthropic.models.beta.messages.BetaThinkingConfigEnabled;
import com.anthropic.models.messages.Model;
public class SimpleThinkingStreamingExample {
private static boolean thinkingStarted = false;
private static boolean responseStarted = false;
public static void main(String[] args) {
AnthropicClient client = AnthropicOkHttpClient.fromEnv();
MessageCreateParams createParams = MessageCreateParams.builder()
.model(Model.CLAUDE_OPUS_4_0)
.maxTokens(16000)
.thinking(BetaThinkingConfigEnabled.builder().budgetTokens(10000).build())
.addUserMessage("What is 27 * 453?")
.build();
try (StreamResponse<BetaRawMessageStreamEvent> streamResponse =
client.beta().messages().createStreaming(createParams)) {
streamResponse.stream()
.forEach(event -> {
if (event.isContentBlockStart()) {
System.out.printf("\nStarting %s block...%n",
event.asContentBlockStart()._type());
// Reset flags for each new block
thinkingStarted = false;
responseStarted = false;
} else if (event.isContentBlockDelta()) {
var delta = event.asContentBlockDelta().delta();
if (delta.isBetaThinking()) {
if (!thinkingStarted) {
System.out.print("Thinking: ");
thinkingStarted = true;
}
System.out.print(delta.asBetaThinking().thinking());
System.out.flush();
} else if (delta.isBetaText()) {
if (!responseStarted) {
System.out.print("Response: ");
responseStarted = true;
}
System.out.print(delta.asBetaText().text());
System.out.flush();
}
} else if (event.isContentBlockStop()) {
System.out.println("\nBlock complete.");
}
});
}
}
}
Example streaming output:
event: message_start
data: {"type": "message_start", "message": {"id": "msg_01...", "type": "message", "role": "assistant", "content": [], "model": "claude-sonnet-4-5", "stop_reason": null, "stop_sequence": null}}
event: content_block_start
data: {"type": "content_block_start", "index": 0, "content_block": {"type": "thinking", "thinking": ""}}
event: content_block_delta
data: {"type": "content_block_delta", "index": 0, "delta": {"type": "thinking_delta", "thinking": "Let me solve this step by step:\n\n1. First break down 27 * 453"}}
event: content_block_delta
data: {"type": "content_block_delta", "index": 0, "delta": {"type": "thinking_delta", "thinking": "\n2. 453 = 400 + 50 + 3"}}
// Additional thinking deltas...
event: content_block_delta
data: {"type": "content_block_delta", "index": 0, "delta": {"type": "signature_delta", "signature": "EqQBCgIYAhIM1gbcDa9GJwZA2b3hGgxBdjrkzLoky3dl1pkiMOYds..."}}
event: content_block_stop
data: {"type": "content_block_stop", "index": 0}
event: content_block_start
data: {"type": "content_block_start", "index": 1, "content_block": {"type": "text", "text": ""}}
event: content_block_delta
data: {"type": "content_block_delta", "index": 1, "delta": {"type": "text_delta", "text": "27 * 453 = 12,231"}}
// Additional text deltas...
event: content_block_stop
data: {"type": "content_block_stop", "index": 1}
event: message_delta
data: {"type": "message_delta", "delta": {"stop_reason": "end_turn", "stop_sequence": null}}
event: message_stop
data: {"type": "message_stop"}
The streaming system needs to process content in batches for optimal performance, which can result in this "chunky" delivery pattern, with possible delays between streaming events. We're continuously working to improve this experience, with future updates focused on making thinking content stream more smoothly.
Extended thinking with tool use
Extended thinking can be used alongside tool use, allowing Claude to reason through tool selection and results processing.
When using extended thinking with tool use, be aware of the following limitations:
Tool choice limitation: Tool use with thinking only supports
tool_choice: {"type": "auto"}(the default) ortool_choice: {"type": "none"}. Usingtool_choice: {"type": "any"}ortool_choice: {"type": "tool", "name": "..."}will result in an error because these options force tool use, which is incompatible with extended thinking.Preserving thinking blocks: During tool use, you must pass
thinkingblocks back to the API for the last assistant message. Include the complete unmodified block back to the API to maintain reasoning continuity.
Toggling thinking modes in conversations
You cannot toggle thinking in the middle of an assistant turn, including during tool use loops. The entire assistant turn must operate in a single thinking mode:
- If thinking is enabled, the final assistant turn must start with a thinking block.
- If thinking is disabled, the final assistant turn must not contain any thinking blocks
From the model's perspective, tool use loops are part of the assistant turn. An assistant turn doesn't complete until Claude finishes its full response, which may include multiple tool calls and results.
For example, this sequence is all part of a single assistant turn:
User: "What's the weather in Paris?"
Assistant: [thinking] + [tool_use: get_weather]
User: [tool_result: "20°C, sunny"]
Assistant: [text: "The weather in Paris is 20°C and sunny"]
Even though there are multiple API messages, the tool use loop is conceptually part of one continuous assistant response.
Common error scenarios
You might encounter this error:
Expected `thinking` or `redacted_thinking`, but found `tool_use`.
When `thinking` is enabled, a final `assistant` message must start
with a thinking block (preceding the lastmost set of `tool_use` and
`tool_result` blocks).
This typically occurs when:
- You had thinking disabled during a tool use sequence
- You want to enable thinking again
- Your last assistant message contains tool use blocks but no thinking block
Practical guidance
✗ Invalid: Toggling thinking immediately after tool use
User: "What's the weather?"
Assistant: [tool_use] (thinking disabled)
User: [tool_result]
// Cannot enable thinking here - still in the same assistant turn
✓ Valid: Complete the assistant turn first
User: "What's the weather?"
Assistant: [tool_use] (thinking disabled)
User: [tool_result]
Assistant: [text: "It's sunny"]
User: "What about tomorrow?" (thinking disabled)
Assistant: [thinking] + [text: "..."] (thinking enabled - new turn)
Best practice: Plan your thinking strategy at the start of each turn rather than trying to toggle mid-turn.
Here's a practical example showing how to preserve thinking blocks when providing tool results:
First request - Claude responds with thinking and tool request
response = client.messages.create( model="claude-sonnet-4-5", max_tokens=16000, thinking={ "type": "enabled", "budget_tokens": 10000 }, tools=[weather_tool], messages=[ {"role": "user", "content": "What's the weather in Paris?"} ] )
```typescript TypeScript
const weatherTool = {
name: "get_weather",
description: "Get current weather for a location",
input_schema: {
type: "object",
properties: {
location: { type: "string" }
},
required: ["location"]
}
};
// First request - Claude responds with thinking and tool request
const response = await client.messages.create({
model: "claude-sonnet-4-5",
max_tokens: 16000,
thinking: {
type: "enabled",
budget_tokens: 10000
},
tools: [weatherTool],
messages: [
{ role: "user", content: "What's the weather in Paris?" }
]
});
import java.util.List;
import java.util.Map;
import com.anthropic.client.AnthropicClient;
import com.anthropic.client.okhttp.AnthropicOkHttpClient;
import com.anthropic.core.JsonValue;
import com.anthropic.models.beta.messages.BetaMessage;
import com.anthropic.models.beta.messages.MessageCreateParams;
import com.anthropic.models.beta.messages.BetaThinkingConfigEnabled;
import com.anthropic.models.beta.messages.BetaTool;
import com.anthropic.models.beta.messages.BetaTool.InputSchema;
import com.anthropic.models.messages.Model;
public class ThinkingWithToolsExample {
public static void main(String[] args) {
AnthropicClient client = AnthropicOkHttpClient.fromEnv();
InputSchema schema = InputSchema.builder()
.properties(JsonValue.from(Map.of(
"location", Map.of("type", "string")
)))
.putAdditionalProperty("required", JsonValue.from(List.of("location")))
.build();
BetaTool weatherTool = BetaTool.builder()
.name("get_weather")
.description("Get current weather for a location")
.inputSchema(schema)
.build();
BetaMessage response = client.beta().messages().create(
MessageCreateParams.builder()
.model(Model.CLAUDE_OPUS_4_0)
.maxTokens(16000)
.thinking(BetaThinkingConfigEnabled.builder().budgetTokens(10000).build())
.addTool(weatherTool)
.addUserMessage("What's the weather in Paris?")
.build()
);
System.out.println(response);
}
}
The API response will include thinking, text, and tool_use blocks:
{
"content": [
{
"type": "thinking",
"thinking": "The user wants to know the current weather in Paris. I have access to a function `get_weather`...",
"signature": "BDaL4VrbR2Oj0hO4XpJxT28J5TILnCrrUXoKiiNBZW9P+nr8XSj1zuZzAl4egiCCpQNvfyUuFFJP5CncdYZEQPPmLxYsNrcs...."
},
{
"type": "text",
"text": "I can help you get the current weather information for Paris. Let me check that for you"
},
{
"type": "tool_use",
"id": "toolu_01CswdEQBMshySk6Y9DFKrfq",
"name": "get_weather",
"input": {
"location": "Paris"
}
}
]
}
Now let's continue the conversation and use the tool
Call your actual weather API, here is where your actual API call would go
let's pretend this is what we get back
weather_data = {"temperature": 88}
Second request - Include thinking block and tool result
No new thinking blocks will be generated in the response
continuation = client.messages.create( model="claude-sonnet-4-5", max_tokens=16000, thinking={ "type": "enabled", "budget_tokens": 10000 }, tools=[weather_tool], messages=[ {"role": "user", "content": "What's the weather in Paris?"}, # notice that the thinking_block is passed in as well as the tool_use_block # if this is not passed in, an error is raised {"role": "assistant", "content": [thinking_block, tool_use_block]}, {"role": "user", "content": [{ "type": "tool_result", "tool_use_id": tool_use_block.id, "content": f"Current temperature: {weather_data['temperature']}°F" }]} ] )
```typescript TypeScript
// Extract thinking block and tool use block
const thinkingBlock = response.content.find(block =>
block.type === 'thinking');
const toolUseBlock = response.content.find(block =>
block.type === 'tool_use');
// Call your actual weather API, here is where your actual API call would go
// let's pretend this is what we get back
const weatherData = { temperature: 88 };
// Second request - Include thinking block and tool result
// No new thinking blocks will be generated in the response
const continuation = await client.messages.create({
model: "claude-sonnet-4-5",
max_tokens: 16000,
thinking: {
type: "enabled",
budget_tokens: 10000
},
tools: [weatherTool],
messages: [
{ role: "user", content: "What's the weather in Paris?" },
// notice that the thinkingBlock is passed in as well as the toolUseBlock
// if this is not passed in, an error is raised
{ role: "assistant", content: [thinkingBlock, toolUseBlock] },
{ role: "user", content: [{
type: "tool_result",
tool_use_id: toolUseBlock.id,
content: `Current temperature: ${weatherData.temperature}°F`
}]}
]
});
import java.util.List;
import java.util.Map;
import java.util.Optional;
import com.anthropic.client.AnthropicClient;
import com.anthropic.client.okhttp.AnthropicOkHttpClient;
import com.anthropic.core.JsonValue;
import com.anthropic.models.beta.messages.*;
import com.anthropic.models.beta.messages.BetaTool.InputSchema;
import com.anthropic.models.messages.Model;
public class ThinkingToolsResultExample {
public static void main(String[] args) {
AnthropicClient client = AnthropicOkHttpClient.fromEnv();
InputSchema schema = InputSchema.builder()
.properties(JsonValue.from(Map.of(
"location", Map.of("type", "string")
)))
.putAdditionalProperty("required", JsonValue.from(List.of("location")))
.build();
BetaTool weatherTool = BetaTool.builder()
.name("get_weather")
.description("Get current weather for a location")
.inputSchema(schema)
.build();
BetaMessage response = client.beta().messages().create(
MessageCreateParams.builder()
.model(Model.CLAUDE_OPUS_4_0)
.maxTokens(16000)
.thinking(BetaThinkingConfigEnabled.builder().budgetTokens(10000).build())
.addTool(weatherTool)
.addUserMessage("What's the weather in Paris?")
.build()
);
// Extract thinking block and tool use block
Optional<BetaThinkingBlock> thinkingBlockOpt = response.content().stream()
.filter(BetaContentBlock::isThinking)
.map(BetaContentBlock::asThinking)
.findFirst();
Optional<BetaToolUseBlock> toolUseBlockOpt = response.content().stream()
.filter(BetaContentBlock::isToolUse)
.map(BetaContentBlock::asToolUse)
.findFirst();
if (thinkingBlockOpt.isPresent() && toolUseBlockOpt.isPresent()) {
BetaThinkingBlock thinkingBlock = thinkingBlockOpt.get();
BetaToolUseBlock toolUseBlock = toolUseBlockOpt.get();
// Call your actual weather API, here is where your actual API call would go
// let's pretend this is what we get back
Map<String, Object> weatherData = Map.of("temperature", 88);
// Second request - Include thinking block and tool result
// No new thinking blocks will be generated in the response
BetaMessage continuation = client.beta().messages().create(
MessageCreateParams.builder()
.model(Model.CLAUDE_OPUS_4_0)
.maxTokens(16000)
.thinking(BetaThinkingConfigEnabled.builder().budgetTokens(10000).build())
.addTool(weatherTool)
.addUserMessage("What's the weather in Paris?")
.addAssistantMessageOfBetaContentBlockParams(
// notice that the thinkingBlock is passed in as well as the toolUseBlock
// if this is not passed in, an error is raised
List.of(
BetaContentBlockParam.ofThinking(thinkingBlock.toParam()),
BetaContentBlockParam.ofToolUse(toolUseBlock.toParam())
)
)
.addUserMessageOfBetaContentBlockParams(List.of(
BetaContentBlockParam.ofToolResult(
BetaToolResultBlockParam.builder()
.toolUseId(toolUseBlock.id())
.content(String.format("Current temperature: %d°F", (Integer)weatherData.get("temperature")))
.build()
)
))
.build()
);
System.out.println(continuation);
}
}
}
The API response will now only include text
{
"content": [
{
"type": "text",
"text": "Currently in Paris, the temperature is 88°F (31°C)"
}
]
}
Preserving thinking blocks
During tool use, you must pass thinking blocks back to the API, and you must include the complete unmodified block back to the API. This is critical for maintaining the model's reasoning flow and conversation integrity.
When Claude invokes tools, it is pausing its construction of a response to await external information. When tool results are returned, Claude will continue building that existing response. This necessitates preserving thinking blocks during tool use, for a couple of reasons:
Reasoning continuity: The thinking blocks capture Claude's step-by-step reasoning that led to tool requests. When you post tool results, including the original thinking ensures Claude can continue its reasoning from where it left off.
Context maintenance: While tool results appear as user messages in the API structure, they're part of a continuous reasoning flow. Preserving thinking blocks maintains this conceptual flow across multiple API calls. For more information on context management, see our guide on context windows.
Important: When providing thinking blocks, the entire sequence of consecutive thinking blocks must match the outputs generated by the model during the original request; you cannot rearrange or modify the sequence of these blocks.
Interleaved thinking
Extended thinking with tool use in Claude 4 models supports interleaved thinking, which enables Claude to think between tool calls and make more sophisticated reasoning after receiving tool results.
With interleaved thinking, Claude can:
- Reason about the results of a tool call before deciding what to do next
- Chain multiple tool calls with reasoning steps in between
- Make more nuanced decisions based on intermediate results
To enable interleaved thinking, add the beta header interleaved-thinking-2025-05-14 to your API request.
Here are some important considerations for interleaved thinking:
- With interleaved thinking, the
budget_tokenscan exceed themax_tokensparameter, as it represents the total budget across all thinking blocks within one assistant turn. - Interleaved thinking is only supported for tools used via the Messages API.
- Interleaved thinking is supported for Claude 4 models only, with the beta header
interleaved-thinking-2025-05-14. - Direct calls to the Claude API allow you to pass
interleaved-thinking-2025-05-14in requests to any model, with no effect. - On 3rd-party platforms (e.g., Amazon Bedrock and Vertex AI), if you pass
interleaved-thinking-2025-05-14to any model aside from Claude Opus 4.5, Claude Opus 4.1, Opus 4, or Sonnet 4, your request will fail.
Without interleaved thinking, Claude thinks once at the start of the assistant turn. Subsequent responses after tool results continue without new thinking blocks.
User: "What's the total revenue if we sold 150 units at $50 each,
and how does this compare to our average monthly revenue?"
Turn 1: [thinking] "I need to calculate 150 * $50, then check the database..."
[tool_use: calculator] { "expression": "150 * 50" }
↓ tool result: "7500"
Turn 2: [tool_use: database_query] { "query": "SELECT AVG(revenue)..." }
↑ no thinking block
↓ tool result: "5200"
Turn 3: [text] "The total revenue is $7,500, which is 44% above your
average monthly revenue of $5,200."
↑ no thinking block
With interleaved thinking enabled, Claude can think after receiving each tool result, allowing it to reason about intermediate results before continuing.
User: "What's the total revenue if we sold 150 units at $50 each,
and how does this compare to our average monthly revenue?"
Turn 1: [thinking] "I need to calculate 150 * $50 first..."
[tool_use: calculator] { "expression": "150 * 50" }
↓ tool result: "7500"
Turn 2: [thinking] "Got $7,500. Now I should query the database to compare..."
[tool_use: database_query] { "query": "SELECT AVG(revenue)..." }
↑ thinking after receiving calculator result
↓ tool result: "5200"
Turn 3: [thinking] "$7,500 vs $5,200 average - that's a 44% increase..."
[text] "The total revenue is $7,500, which is 44% above your
average monthly revenue of $5,200."
↑ thinking before final answer
Extended thinking with prompt caching
Prompt caching with thinking has several important considerations:
Thinking block context removal
- Thinking blocks from previous turns are removed from context, which can affect cache breakpoints
- When continuing conversations with tool use, thinking blocks are cached and count as input tokens when read from cache
- This creates a tradeoff: while thinking blocks don't consume context window space visually, they still count toward your input token usage when cached
- If thinking becomes disabled, requests will fail if you pass thinking content in the current tool use turn. In other contexts, thinking content passed to the API is simply ignored
Cache invalidation patterns
- Changes to thinking parameters (enabled/disabled or budget allocation) invalidate message cache breakpoints
- Interleaved thinking amplifies cache invalidation, as thinking blocks can occur between multiple tool calls
- System prompts and tools remain cached despite thinking parameter changes or block removal
Understanding thinking block caching behavior
When using extended thinking with tool use, thinking blocks exhibit specific caching behavior that affects token counting:
How it works:
- Caching only occurs when you make a subsequent request that includes tool results
- When the subsequent request is made, the previous conversation history (including thinking blocks) can be cached
- These cached thinking blocks count as input tokens in your usage metrics when read from the cache
- When a non-tool-result user block is included, all previous thinking blocks are ignored and stripped from context
Detailed example flow:
Request 1:
User: "What's the weather in Paris?"
Response 1:
[thinking_block_1] + [tool_use block 1]
Request 2:
User: ["What's the weather in Paris?"],
Assistant: [thinking_block_1] + [tool_use block 1],
User: [tool_result_1, cache=True]
Response 2:
[thinking_block_2] + [text block 2]
Request 2 writes a cache of the request content (not the response). The cache includes the original user message, the first thinking block, tool use block, and the tool result.
Request 3:
User: ["What's the weather in Paris?"],
Assistant: [thinking_block_1] + [tool_use block 1],
User: [tool_result_1, cache=True],
Assistant: [thinking_block_2] + [text block 2],
User: [Text response, cache=True]
For Claude Opus 4.5 and later, all previous thinking blocks are kept by default. For older models, because a non-tool-result user block was included, all previous thinking blocks are ignored. This request will be processed the same as:
User: ["What's the weather in Paris?"],
Assistant: [tool_use block 1],
User: [tool_result_1, cache=True],
Assistant: [text block 2],
User: [Text response, cache=True]
Key points:
- This caching behavior happens automatically, even without explicit
cache_controlmarkers - This behavior is consistent whether using regular thinking or interleaved thinking
client = Anthropic()
def fetch_article_content(url): response = requests.get(url) soup = BeautifulSoup(response.content, 'html.parser')
# Remove script and style elements
for script in soup(["script", "style"]):
script.decompose()
# Get text
text = soup.get_text()
# Break into lines and remove leading and trailing space on each
lines = (line.strip() for line in text.splitlines())
# Break multi-headlines into a line each
chunks = (phrase.strip() for line in lines for phrase in line.split(" "))
# Drop blank lines
text = '\n'.join(chunk for chunk in chunks if chunk)
return text
Fetch the content of the article
book_url = "https://www.gutenberg.org/cache/epub/1342/pg1342.txt" book_content = fetch_article_content(book_url)
Use just enough text for caching (first few chapters)
LARGE_TEXT = book_content[:5000]
SYSTEM_PROMPT=[ { "type": "text", "text": "You are an AI assistant that is tasked with literary analysis. Analyze the following text carefully.", }, { "type": "text", "text": LARGE_TEXT, "cac
…(truncated)