yanacuti1121 ECC Tools Cost Audit
Evidence-first workflow để investigate cost overruns trong ECC Tools GitHub App.
Khi nào dùng
- ECC Tools đang tạo quá nhiều PRs
- Chi phí API bất ngờ tăng cao
- Nghi ngờ quota bypass hoặc premium model leakage
- Duplicate jobs chạy nhiều lần
- GitHub App billing spikes
Workflow
Bước 1 — Freeze scope
# Switch sang ECC-Tools repo
# Identify entry points: webhook router, queue producer/consumer, PR creation, billing path
Bước 2 — Trace ingress
Map tất cả enqueue paths TRƯỚC khi theorize.
Inspect: webhook handlers → queue producers → downstream consumers
Bước 3 — Trace worker
Xác nhận mỗi queued analysis produce gì:
- PR creation?
- Branch creation?
- Token spending?
Bước 4 — Audit burn paths
| Pattern | Check |
|---|---|
| PR multiplication | 1 webhook → N PRs? |
| Quota bypass | Post-enqueue usage reservation? |
| Premium leakage | Free-tier jobs đang route qua premium models? |
| Retry burn | Retry logic chạy vòng lặp? |
| Duplicate jobs | App-generated branches re-entering webhooks? |
Bước 5 — Fix theo priority
- PR multiplication (fix trước)
- Quota bypass
- Premium model leakage
- Duplicate jobs
- Rerun safety
Bước 6 — Verify hẹp
# Chỉ rerun tests trên changed path
# Không test toàn bộ suite
5 failure modes cao nhất
- Single queue type xử lý tất cả triggers
- Post-enqueue usage reservation → quota bypass
- Free-tier jobs route qua premium providers
- App-generated branches re-enter webhooks (loop)
- Expensive work complete trước khi persistence safety check
Related skills
autonomous-loops— loop detectioncustomer-billing-ops— billing investigationsecurity-review— security auditverification-loop— narrow verification
Source
https://github.com/affaan-m/ECC · ECC Tools: https://github.com/marketplace/ecc-tools