Gate agent regressions from production traces with Tracely

Turn failing AI-agent production traces into hermetic regression cases and CI gates with Tracely.

agentskillexchange Updated 28 repo stars

File contents

Gate agent regressions from production traces with Tracely

Turn failing AI-agent production traces into hermetic regression cases and CI gates with Tracely.

Prerequisites

Tracely service, tracely-ai Python SDK or OTLP exporter, tracely CLI or Tracely GitHub Action

Installation

Install or set up from the source-backed instructions:

Self-host Tracely with Docker Compose or Railway, then install tracely-ai for Python agents or point an existing OTLP/OpenTelemetry exporter at Tracely. Configure an ingest key, tag runs with env=prod and env=ci, promote failures to cases, and run tracely gate, tracely replay, or the Tracely GitHub Action in CI.

Documentation

Source

agentskillexchange/skills/tree/main/skills/gate-agent-regressions-from-production-traces-with-tracely commit 968d07bbac

Frequently asked questions

npx skillmds@latest add agentskillexchange/gate-agent-regressions-from-production-traces-with-tracely