Test Report Generator
Overview
Generate structured, human-readable test reports from raw test runner output including JUnit XML, Jest JSON, pytest results, and coverage data. Produces Markdown summaries, HTML dashboards, and CI-compatible annotations.
Prerequisites
- Test results in a parseable format (JUnit XML, Jest
--json, pytest --junitxml, or TAP)
- Coverage data files (Istanbul
coverage-summary.json, lcov.info, or coverage.xml)
- Node.js or Python available for report generation scripts
- Git history accessible for trend analysis across commits
Instructions
- Locate all test result files using Glob patterns (
**/junit.xml, **/test-results.json, **/coverage/lcov.info).
- Parse each result file and extract:
- Total test count, passed, failed, skipped, and error counts.
- Execution duration per test suite and per individual test.
- Failure messages, stack traces, and assertion details.
- Parse coverage data and extract:
- Line, branch, function, and statement coverage percentages.
- Per-file coverage breakdown identifying files below threshold.
- Uncovered line ranges for targeted improvement.
- Compute aggregate metrics:
- Overall pass rate as a percentage.
- Total execution time and average test duration.
- Top 10 slowest tests with file paths and durations.
- Coverage delta compared to the previous commit (if git history is available).
- Generate a Markdown report with sections for summary, failures, coverage, and performance.
- Optionally generate an HTML report with sortable tables and coverage heatmaps.
- Write CI-compatible output (GitHub Actions job summary, GitLab report artifacts, or Slack webhook payload).
Output
test-report.md -- Markdown summary with pass/fail table, coverage stats, and failure details
test-report.html -- Self-contained HTML report (optional)
- Coverage summary table with per-file breakdown and delta from baseline
- Slowest tests list ranked by execution time
- CI annotation comments on failed test lines (GitHub Actions
::error format)
Error Handling
| Error |
Cause |
Solution |
| No test result files found |
Tests did not run or output path is incorrect |
Verify test runner --outputFile or --junitxml flag; check the output directory exists |
| Malformed JUnit XML |
Test runner crashed mid-output or encoding issues |
Validate XML with xmllint; re-run failed test suite; check for binary output in XML |
| Coverage data missing |
Tests ran without --coverage flag |
Add --coverage to the test command; verify coverage reporter is configured |
| Metric trend unavailable |
No previous report to compare against |
Generate baseline report first; store reports as CI artifacts for historical comparison |
| Report exceeds GitHub comment limit |
Too many failures produce oversized Markdown |
Truncate failure details to top 20; link to full report artifact |
Examples
Markdown report structure:
## Test Results -- 2026-03-10
| Metric | Value |
|--------|-------|
| Total Tests | 847 | # 847 = configured value
| Passed | 839 (99.1%) | # 839 = configured value
| Failed | 5 |
| Skipped | 3 |
| Duration | 42.3s |
### Coverage
| Category | Current | Threshold | Status |
|----------|---------|-----------|--------|
| Lines | 87.2% | 80% | PASS |
| Branches | 74.1% | 70% | PASS |
| Functions | 91.5% | 85% | PASS |
### Failed Tests
1. `src/utils/parser.test.ts` -- "handles malformed input" -- Expected Error but received null
2. `src/api/auth.test.ts` -- "rejects expired tokens" -- Timeout after 5000ms
GitHub Actions job summary integration:
cat test-report.md >> "$GITHUB_STEP_SUMMARY"
Resources
1---2name: generating-test-reports-23description: 'Generate comprehensive test reports with metrics, coverage, and visualizations.45 Use when performing specialized testing.67 Trigger with phrases like "generate test report", "create test documentation", or8 "show test metrics".910 '11allowed-tools: Read, Write, Edit, Grep, Glob, Bash(test:report-*)12version: 1.23.013author: Jeremy Longshore <jeremy@intentsolutions.io>14license: MIT15tags:16- testing17- test-reports18compatibility: Designed for Claude Code19metadata:20 source: https://skillmd.com/skills/jeremylongshore/generating-test-reports-221---2223# Test Report Generator2425## Overview2627Generate structured, human-readable test reports from raw test runner output including JUnit XML, Jest JSON, pytest results, and coverage data. Produces Markdown summaries, HTML dashboards, and CI-compatible annotations.2829## Prerequisites3031- Test results in a parseable format (JUnit XML, Jest `--json`, pytest `--junitxml`, or TAP)32- Coverage data files (Istanbul `coverage-summary.json`, `lcov.info`, or `coverage.xml`)33- Node.js or Python available for report generation scripts34- Git history accessible for trend analysis across commits3536## Instructions37381. Locate all test result files using Glob patterns (`**/junit.xml`, `**/test-results.json`, `**/coverage/lcov.info`).392. Parse each result file and extract:40 - Total test count, passed, failed, skipped, and error counts.41 - Execution duration per test suite and per individual test.42 - Failure messages, stack traces, and assertion details.433. Parse coverage data and extract:44 - Line, branch, function, and statement coverage percentages.45 - Per-file coverage breakdown identifying files below threshold.46 - Uncovered line ranges for targeted improvement.474. Compute aggregate metrics:48 - Overall pass rate as a percentage.49 - Total execution time and average test duration.50 - Top 10 slowest tests with file paths and durations.51 - Coverage delta compared to the previous commit (if git history is available).525. Generate a Markdown report with sections for summary, failures, coverage, and performance.536. Optionally generate an HTML report with sortable tables and coverage heatmaps.547. Write CI-compatible output (GitHub Actions job summary, GitLab report artifacts, or Slack webhook payload).5556## Output5758- `test-report.md` -- Markdown summary with pass/fail table, coverage stats, and failure details59- `test-report.html` -- Self-contained HTML report (optional)60- Coverage summary table with per-file breakdown and delta from baseline61- Slowest tests list ranked by execution time62- CI annotation comments on failed test lines (GitHub Actions `::error` format)6364## Error Handling6566| Error | Cause | Solution |67|-------|-------|---------|68| No test result files found | Tests did not run or output path is incorrect | Verify test runner `--outputFile` or `--junitxml` flag; check the output directory exists |69| Malformed JUnit XML | Test runner crashed mid-output or encoding issues | Validate XML with `xmllint`; re-run failed test suite; check for binary output in XML |70| Coverage data missing | Tests ran without `--coverage` flag | Add `--coverage` to the test command; verify coverage reporter is configured |71| Metric trend unavailable | No previous report to compare against | Generate baseline report first; store reports as CI artifacts for historical comparison |72| Report exceeds GitHub comment limit | Too many failures produce oversized Markdown | Truncate failure details to top 20; link to full report artifact |7374## Examples7576**Markdown report structure:**7778```markdown79## Test Results -- 2026-03-108081| Metric | Value |82|--------|-------|83| Total Tests | 847 | # 847 = configured value84| Passed | 839 (99.1%) | # 839 = configured value85| Failed | 5 |86| Skipped | 3 |87| Duration | 42.3s |8889### Coverage90| Category | Current | Threshold | Status |91|----------|---------|-----------|--------|92| Lines | 87.2% | 80% | PASS |93| Branches | 74.1% | 70% | PASS |94| Functions | 91.5% | 85% | PASS |9596### Failed Tests971. `src/utils/parser.test.ts` -- "handles malformed input" -- Expected Error but received null982. `src/api/auth.test.ts` -- "rejects expired tokens" -- Timeout after 5000ms99```100101**GitHub Actions job summary integration:**102103```bash104cat test-report.md >> "$GITHUB_STEP_SUMMARY"105```106107## Resources108109- Jest `--json` reporter: https://jestjs.io/docs/cli#--json110- JUnit XML format specification: https://github.com/testmoapp/junitxml111- Istanbul coverage reporters: https://istanbul.js.org/docs/advanced/alternative-reporters/112- Allure Test Report framework: https://allurereport.org/113- GitHub Actions job summaries: https://docs.github.com/en/actions/using-workflows/workflow-commands-for-github-actions#adding-a-job-summary