API Test Suite Builder
Scan API route definitions across frameworks (Next.js App Router, Express, FastAPI, Django REST, Go net/http), analyze request/response schemas, and generate comprehensive test suites covering authentication, authorization, input validation, error handling, pagination, file uploads, rate limiting, contract testing, and load testing. Outputs ready-to-run test files for Vitest+Supertest (Node), Pytest+httpx (Python), or k6 (load testing).
Core Capabilities
- Route detection & analysis — scan source files to extract endpoints, parse request/response schemas, detect auth middleware and authorization rules across Node, Python, and Go frameworks.
- Test matrix generation — auth (valid/invalid/expired tokens, wrong roles), input validation (missing/wrong-type/boundary/injection), error paths (400/401/403/404/409/422/429/500), pagination, file uploads, and rate limiting.
- Contract testing — OpenAPI-to-test generation, Pact consumer-driven contracts, schema snapshot testing for breaking-change detection.
- Load testing — k6 scripts with ramp-up patterns and SLA thresholds, latency percentile tracking (P50/P95/P99), concurrent user simulation.
When to Use
- New API added — generate a test scaffold before implementation (TDD).
- Legacy API with no tests — scan and generate baseline coverage.
- Pre-release — ensure all routes have at least smoke tests.
- API contract change — detect and test breaking changes.
- Security audit — generate adversarial input tests.
- Performance validation — create load-test baselines.
Clarify First
Before generating the suite, confirm these inputs. If any is unknown or vague, ASK — do not assume:
Stop rule: ask only the 2-3 that most change the output. If the user says "just draft it," proceed and list your assumptions at the top of the artifact.
Tools
| Tool |
Purpose |
Command |
test_generator.py |
Generate API test skeletons from an OpenAPI/Swagger spec |
python scripts/test_generator.py spec.json --framework vitest --output tests/ |
coverage_analyzer.py |
Compare spec endpoints vs existing test files to find gaps |
python scripts/coverage_analyzer.py spec.json tests/ --threshold 95 |
contract_validator.py |
Validate response samples against OpenAPI schema contracts |
python scripts/contract_validator.py spec.json samples/ --strict |
References
Load the reference that matches the task — keep this file lean and pull detail on demand:
- references/route-detection-and-matrices.md — per-framework route-detection shell commands and the full auth / input-validation / pagination test matrices with worked TypeScript examples. Read when scanning a codebase or writing the core test cases.
- references/contract-and-load-testing.md — complete Pact consumer-driven contract test and k6 load-test scripts, plus the commands to run load tests locally, against staging, and in the cloud. Read when adding contract or performance tests.
- references/workflow-and-quality.md — the 9-step generation workflow, reusable test-helper patterns (auth, authed request, factories), common pitfalls, best practices, a troubleshooting table, and the success-criteria bar. Read before generating a suite and before shipping it.
Scope & Limitations
This skill covers:
- Generating test suites from route definitions for REST APIs across Node.js, Python, and Go frameworks
- Authentication, authorization, input validation, pagination, and error-path test generation
- Consumer-driven contract testing with Pact and schema snapshot validation
- Load and performance testing script generation with k6 and Artillery
This skill does NOT cover:
- GraphQL API testing (see
engineering/api-design-reviewer for schema review patterns)
- End-to-end browser testing or UI interaction testing (see
engineering/playwright-pro)
- Database migration testing or schema validation (see
engineering/database-schema-designer)
- Security penetration testing beyond input sanitization checks (see
engineering/skill-security-auditor)
Integration Points
| Skill |
Integration |
Data Flow |
engineering/api-design-reviewer |
Validate API design before generating tests |
Design review output defines the endpoint contracts that this skill generates tests for |
engineering/ci-cd-pipeline-builder |
Embed generated tests into CI/CD pipelines |
Generated test files and k6 scripts are added as pipeline stages with pass/fail gates |
engineering/playwright-pro |
Complement API tests with E2E browser tests |
API test suite validates backend behavior; Playwright tests validate the frontend consuming those APIs |
engineering/database-schema-designer |
Align test fixtures with database schema |
Schema definitions inform factory functions and seed data used in generated test helpers |
engineering/observability-designer |
Monitor test-covered endpoints in production |
Load test thresholds (P95, P99) feed into alerting rules for the same endpoints in production dashboards |
engineering/performance-profiler |
Investigate endpoints that fail load test thresholds |
k6 results identify slow endpoints; the profiler skill traces root causes at the code level |
1---
2name: api-test-suite-builder
3description: >
4 Generate API test suites from route definitions across frameworks: auth, input validation,
5 contract, k6 load testing, mocking, and OpenAPI-driven generation. Use when adding new APIs,
6 auditing test coverage, or building regression suites.
7license: MIT + Commons Clause
8metadata:
9 version: 1.1.0
10 author: borghei
11 category: engineering
12 domain: api-testing
13 tier: POWERFUL
14 updated: 2026-06-17
15 frameworks: vitest, pytest, supertest, httpx, k6, pact
16---
17
18# API Test Suite Builder
19
20Scan API route definitions across frameworks (Next.js App Router, Express, FastAPI, Django REST, Go net/http), analyze request/response schemas, and generate comprehensive test suites covering authentication, authorization, input validation, error handling, pagination, file uploads, rate limiting, contract testing, and load testing. Outputs ready-to-run test files for Vitest+Supertest (Node), Pytest+httpx (Python), or k6 (load testing).
21
22## Core Capabilities
23
24- **Route detection & analysis** — scan source files to extract endpoints, parse request/response schemas, detect auth middleware and authorization rules across Node, Python, and Go frameworks.
25- **Test matrix generation** — auth (valid/invalid/expired tokens, wrong roles), input validation (missing/wrong-type/boundary/injection), error paths (400/401/403/404/409/422/429/500), pagination, file uploads, and rate limiting.
26- **Contract testing** — OpenAPI-to-test generation, Pact consumer-driven contracts, schema snapshot testing for breaking-change detection.
27- **Load testing** — k6 scripts with ramp-up patterns and SLA thresholds, latency percentile tracking (P50/P95/P99), concurrent user simulation.
28
29## When to Use
30
31- New API added — generate a test scaffold before implementation (TDD).
32- Legacy API with no tests — scan and generate baseline coverage.
33- Pre-release — ensure all routes have at least smoke tests.
34- API contract change — detect and test breaking changes.
35- Security audit — generate adversarial input tests.
36- Performance validation — create load-test baselines.
37
38## Clarify First
39
40Before generating the suite, confirm these inputs. If any is unknown or vague, ASK — do not assume:
41
42- [ ] **Target framework** — Vitest+Supertest, Pytest+httpx, or k6 (determines the emitted test-file format via `--framework`)
43- [ ] **Spec or routes source** — an OpenAPI spec or the source files to scan (the input the generator parses)
44- [ ] **Test scope** — auth, input validation, contract, load, or the full matrix (which test categories get generated)
45
46Stop rule: ask only the 2-3 that most change the output. If the user says "just draft it," proceed and list your assumptions at the top of the artifact.
47
48## Tools
49
50| Tool | Purpose | Command |
51|------|---------|---------|
52| `test_generator.py` | Generate API test skeletons from an OpenAPI/Swagger spec | `python scripts/test_generator.py spec.json --framework vitest --output tests/` |
53| `coverage_analyzer.py` | Compare spec endpoints vs existing test files to find gaps | `python scripts/coverage_analyzer.py spec.json tests/ --threshold 95` |
54| `contract_validator.py` | Validate response samples against OpenAPI schema contracts | `python scripts/contract_validator.py spec.json samples/ --strict` |
55
56## References
57
58Load the reference that matches the task — keep this file lean and pull detail on demand:
59
60- **[references/route-detection-and-matrices.md](references/route-detection-and-matrices.md)** — per-framework route-detection shell commands and the full auth / input-validation / pagination test matrices with worked TypeScript examples. Read when scanning a codebase or writing the core test cases.
61- **[references/contract-and-load-testing.md](references/contract-and-load-testing.md)** — complete Pact consumer-driven contract test and k6 load-test scripts, plus the commands to run load tests locally, against staging, and in the cloud. Read when adding contract or performance tests.
62- **[references/workflow-and-quality.md](references/workflow-and-quality.md)** — the 9-step generation workflow, reusable test-helper patterns (auth, authed request, factories), common pitfalls, best practices, a troubleshooting table, and the success-criteria bar. Read before generating a suite and before shipping it.
63
64## Scope & Limitations
65
66**This skill covers:**
67- Generating test suites from route definitions for REST APIs across Node.js, Python, and Go frameworks
68- Authentication, authorization, input validation, pagination, and error-path test generation
69- Consumer-driven contract testing with Pact and schema snapshot validation
70- Load and performance testing script generation with k6 and Artillery
71
72**This skill does NOT cover:**
73- GraphQL API testing (see `engineering/api-design-reviewer` for schema review patterns)
74- End-to-end browser testing or UI interaction testing (see `engineering/playwright-pro`)
75- Database migration testing or schema validation (see `engineering/database-schema-designer`)
76- Security penetration testing beyond input sanitization checks (see `engineering/skill-security-auditor`)
77
78## Integration Points
79
80| Skill | Integration | Data Flow |
81|-------|------------|-----------|
82| `engineering/api-design-reviewer` | Validate API design before generating tests | Design review output defines the endpoint contracts that this skill generates tests for |
83| `engineering/ci-cd-pipeline-builder` | Embed generated tests into CI/CD pipelines | Generated test files and k6 scripts are added as pipeline stages with pass/fail gates |
84| `engineering/playwright-pro` | Complement API tests with E2E browser tests | API test suite validates backend behavior; Playwright tests validate the frontend consuming those APIs |
85| `engineering/database-schema-designer` | Align test fixtures with database schema | Schema definitions inform factory functions and seed data used in generated test helpers |
86| `engineering/observability-designer` | Monitor test-covered endpoints in production | Load test thresholds (P95, P99) feed into alerting rules for the same endpoints in production dashboards |
87| `engineering/performance-profiler` | Investigate endpoints that fail load test thresholds | k6 results identify slow endpoints; the profiler skill traces root causes at the code level |