StandardLoggingPayload Specification

StandardLoggingPayload Specification

Found under kwargs["standard_logging_object"]. This is a standard payload, logged for every successful and failed response.

StandardLoggingPayload

Cost Breakdown

The cost_breakdown field provides detailed cost breakdown for completion requests as a CostBreakdown object containing:

• input_cost: Cost of input/prompt tokens including cache creation tokens
• output_cost: Cost of output/completion tokens (including reasoning tokens if applicable)
• tool_usage_cost: Cost of built-in tools usage (e.g., web search, code interpreter)
• total_cost: Total cost of input + output + tool usage

Note: This field is populated for all call types. For non-completion calls, input_cost and output_cost may be 0.

The total cost relationship is: response_cost = cost_breakdown.total_cost

CostBreakdown Type

class CostBreakdown(TypedDict, total=False):
    input_cost: float        # Cost of input/prompt tokens in USD
    output_cost: float       # Cost of output/completion tokens in USD (includes reasoning)
    tool_usage_cost: float   # Cost of built-in tools usage in USD
    total_cost: float        # Total cost in USD

StandardLoggingUserAPIKeyMetadata

StandardLoggingMetadata

Inherits from StandardLoggingUserAPIKeyMetadata and adds:

StandardLoggingVectorStoreRequest

StandardLoggingAdditionalHeaders

StandardLoggingHiddenParams

StandardLoggingModelInformation

StandardLoggingModelCostFailureDebugInformation

StandardLoggingPayloadErrorInformation

StandardLoggingPayloadStatus

A literal type with two possible values:

• "success"
• "failure"

StandardLoggingGuardrailInformation

StandardLoggingPayloadStatusFields

Typed status fields for easy filtering and analytics.

StandardLoggingPayloadStatus

A literal type with two possible values:

• "success" - The LLM API request completed successfully
• "failure" - The LLM API request failed

GuardrailStatus

A literal type with four possible values:

• "success" - Guardrail ran and allowed content through (no violations detected)
• "guardrail_intervened" - Guardrail blocked or modified content due to policy violations
• "guardrail_failed_to_respond" - Guardrail had a technical failure or API error
• "not_run" - No guardrail was executed for this request

Usage Examples

Filter logs for requests where guardrails intervened:

{
  "status_fields": {
    "guardrail_status": "guardrail_intervened"
  }
}

Find guardrail technical failures:

{
  "status_fields": {
    "guardrail_status": "guardrail_failed_to_respond"
  }
}

Get successful LLM requests:

{
  "status_fields": {
    "llm_api_status": "success"
  }
}

Find requests where guardrails ran successfully without intervention:

{
  "status_fields": {
    "guardrail_status": "success",
    "llm_api_status": "success"
  }
}

Find requests where no guardrail was run:

{
  "status_fields": {
    "guardrail_status": "not_run"
  }
}

StandardLoggingPromptManagementMetadata

Used for tracking prompt versioning and management information.

StandardLoggingMCPToolCall

Used to track Model Context Protocol (MCP) tool calls within LiteLLM requests. This provides detailed logging for external tool integrations.

MCPServerCostInfo

Cost tracking structure for MCP server tool calls:

Usage

# Basic MCP tool call metadata
mcp_tool_call = {
    "name": "search_documents",
    "arguments": {
        "query": "machine learning tutorials",
        "limit": 10,
        "filter": "type:pdf"
    },
    "mcp_server_name": "document-search-service",
    "namespaced_tool_name": "docs-mcp/search_documents",
    "mcp_server_cost_info": {
        "default_cost_per_query": 0.02,
        "tool_name_to_cost_per_query": {
            "search_documents": 0.02,
            "get_document": 0.01
        }
    }
}

# optional result field (via custom logging hooks)
mcp_tool_call_with_result = {
    "name": "search_documents",
    "arguments": {
        "query": "machine learning tutorials",
        "limit": 10,
        "filter": "type:pdf"
    },
    "result": {
        "documents": [...],
        "total_found": 42,
        "search_time_ms": 150
    },
    "mcp_server_name": "document-search-service",
    "namespaced_tool_name": "docs-mcp/search_documents",
    "mcp_server_cost_info": {
        "default_cost_per_query": 0.02,
        "tool_name_to_cost_per_query": {
            "search_documents": 0.02,
            "get_document": 0.01
        }
    }
}