Analyze Tosca Cloud execution history
Compare multiple runs of a playlist to detect flakiness, regressions, and recurring error signatures. Read-only.
Prerequisite: tosca-cloud-basics. Wire names: tosca_{domain}_{action}.
Session checklist
Analyze Cloud execution history:
- [ ] Resolve playlist
- [ ] getRecentRuns (limit 20+)
- [ ] Classify Passed/Failed trend
- [ ] getFailedTestSteps for failed runs only
- [ ] Compare signatures across runs (flaky vs recurring)
- [ ] Report with confidence; hand off if fix needed
Fast path
- Resolve playlist —
tosca_playlist_searchByName. - Fetch run history —
tosca_playlist_getRecentRuns(playlistId, limit: 20)(or more if needed). - Classify runs — count Passed/Failed over window; note state transitions.
- Deep dive failures —
tosca_playlist_getFailedTestStepsfor failed runs only; compare signatures across runs. - Optional comparison —
tosca_execution_getRecentRunLogsfor log-level diff. - Report — trend summary, flaky tests, new vs recurring failures with confidence.
Flakiness signals
- Same test passes on run N, fails on N+1 with same environment
- Failure signature changes but same test case ID
- Failures correlate with run time / load (timing category)
See references/trend-and-anomaly.md.
Hand off
- Single latest run diagnosis →
tosca-analyzing-execution-results - Apply fix →
tosca-remediating-from-results