AI LLM Telemetry

Observe LLM applications and agents from their telemetry. Reads Opik (Comet) traces and spans, LiteLLM proxy spend logs, budgets and key limits, and OpenTelemetry GenAI spans (gen_ai.* attributes) to compute cost per model, team, user and day, token percentiles, cache hit ratio, tool call frequency, failure rate and latency, time to first token, error and retry rates, cost anomalies and runaway tool loops. Bundled scripts aggregate JSON or JSONL exports offline. Use when the user asks to "how much did our LLM calls cost", "which team burns the most tokens", "audit the agent tool calls", "find runaway loops in traces", "set up Opik with LiteLLM", "is the LLM cache working", or when an AI feature bill, latency or error rate needs an explanation. In French "cout des appels LLM", "analyser les traces Opik", "audit des tool calls de l'agent".

Navinspire-ia Updated 37 repo stars
Navin Desktop fixes a percentage discount bug and runs all six tests successfully

File contents

navinspire-ia/navin commit 372a963050

Frequently asked questions

npx get-skill add navinspire-ia/ai-llm-telemetry