Agent Scale CI Test Selection

Design or rescue a CI test impact analysis (test selection) service for agent-driven development, based on Anthropic's experience after CI jobs grew ~25x in six months. Covers the listener/selector architecture, why listener lag means stale selection, recognizing when quick fixes (bigger machine, per-package sharding, restarts) are buying less time each round, the stateless redesign (listener workers append to a journal in an in-memory store, a small consumer rolls it up into per-test history every few seconds, the selector reads that history), and the planning rules - assume 25x load within two quarters, design v0 for 10-20x perceived scale if budget allows, keep state out of the process, avoid single-instance critical services, and instrument services so Claude can diagnose and tune them (jobs in must equal jobs out). Use when CI is straining under agent-generated PRs, when a test selection service lags or hits memory limits, or when designing CI infrastructure for exponential growth.

uygnoey Updated 4 repo stars

File contents

uygnoey/skills-from-claude-blog commit 45086e3b9b

Frequently asked questions

npx get-skill add uygnoey/agent-scale-ci-test-selection