tools-only Evaluation Report: devex_rate_limit_advisor
Session: batch_eval Generated: 2026-02-11 22:18:31
Summary
- Success Rate: 100.0% (3/3)
- Validation Pass Rate: 100.0%
- Auto-Act Rate: 33.3%
- Total Executions: 3
Performance Metrics
| Metric | Value |
|---|---|
| Average Latency | 57.13ms |
| P50 Latency | 0.08ms |
| P95 Latency | 171.25ms |
| P99 Latency | 171.25ms |
| Max Latency | 171.25ms |
| Min Latency | 0.06ms |
Decision Breakdown
| Decision Type | Count | Percentage |
|---|---|---|
| Auto Act | 1 | 33.3% |
| Flag For Review | 2 | 66.7% |
Recommendations
- 📊 Low auto-act rate - consider improving confidence scoring
- ✅ Excellent performance - skill is production-ready