LLM Observability And Cost

Reference-grade guide to production LLM observability and cost attribution — distributed traces and spans for multi-step agents, OpenTelemetry GenAI semantic conventions, the metrics/percentiles that matter, drift detection with online evals, and per-feature/tenant/user cost attribution via span metadata. Real tooling (LangSmith, Langfuse, Phoenix, Helicone, OTel), tables, do/don't, and the failure modes that leave you blind.

jpoindexter Updated 2 repo stars

File contents

jpoindexter/design-and-ai-skills commit 8453a77177

Frequently asked questions

npx get-skill add jpoindexter/llm-observability-and-cost