Monitor and evaluate LLM agent traffic with Helicone
Route model calls through Helicone, inspect costs, latency, traces, prompts, and evaluations, then review changes before they ship.
Prerequisites
Helicone account or self-hosted Helicone deployment, LLM application or agent using an OpenAI-compatible client, configured HELICONE_API_KEY or self-hosted environment.
Installation
Use the upstream install or setup path that matches your environment:
- git clone https://github.com/Helicone/helicone.git
- Manual deployment is not recommended. Please use Docker or Helm. If you must, follow the instructions here.
Requirements and caveats from upstream:
- Helicone is simple to self-host and update. To get started locally, just use our docker-compose file.
- cd docker
- | AI Gateway | JS/TS, Python, cURL | Unified API for 100+ providers with intelligent routing, automatic fallbacks, and unified observability
Basic usage or getting-started notes:
Get your API key by signing up here and add credits at helicone.ai/credits
Update the baseURL in your code and add your API key.
typescript
Extracted from upstream docs: https://raw.githubusercontent.com/Helicone/helicone/HEAD/README.md