API Testing

API Testing

Purpose

Verify backend API contracts, validation, authorization, error handling, and integration behavior.

Project Stack

FastAPI, pytest/project test infrastructure, HTTP clients.

Operating Principles

1. Test successful responses.
2. Test invalid input.
3. Test unauthenticated access.
4. Test unauthorized access.
5. Test missing resources.
6. Test conflicts where applicable.
7. Verify response schemas.
8. Verify important side effects.
9. Test transaction behavior for multi-step operations.
10. Keep tests independent and deterministic.
11. Do not weaken assertions merely to make a test pass.

Required Workflow

1. Identify the endpoint contract.
2. Inspect existing API tests.
3. Create representative fixtures.
4. Test happy path.
5. Test validation failures.
6. Test authentication and authorization.
7. Test resource-not-found and conflict cases.
8. Verify database side effects.
9. Run the complete relevant API test set.
10. Inspect failures using actual response and server evidence.

Evidence Rules

Use the strongest available evidence in this order:

1. Runtime behavior
2. Automated test results
3. Type checking, linting, and build results
4. Installed package/source behavior
5. Official framework or library documentation
6. Repository configuration
7. Static code inspection
8. General model knowledge

Never report an assumption as a verified result.

Tool Selection

• Use Filesystem MCP for repository exploration and file inspection.
• Use Context7 for current, version-specific library/framework documentation.
• Use Fetch when official documentation or public web resources need to be retrieved.
• Use Playwright for browser behavior, frontend interaction, forms, authentication flows, and UI verification.
• Use GitHub CLI for repository, branch, pull request, issue, workflow, and CI operations.
• Prefer the smallest tool set that establishes reliable evidence.

Failure Handling

When something fails:

1. Reproduce the failure.
2. Capture the exact error.
3. Identify the failing layer.
4. Check whether the failure is environmental, dependency-related, configuration-related, or caused by application code.
5. Research uncertain behavior using authoritative sources.
6. Apply the smallest appropriate fix.
7. Reproduce the original failure again.
8. Run regression checks.
9. Inspect the final diff.

Do not hide failures by weakening tests, suppressing errors, deleting evidence, or claiming success without verification.

Security

• Never expose secrets.
• Never commit credentials.
• Treat all external input as untrusted.
• Preserve authentication and authorization boundaries.
• Avoid leaking internal implementation details through errors.
• Review security implications whenever the skill touches users, data, credentials, networking, or deployment.

Completion Criteria

A task using this skill is complete only when:

• The requested behavior is implemented.
• Existing project conventions are preserved.
• Relevant static checks pass.
• Relevant tests pass or their absence is explicitly reported.
• Browser verification is performed when the task affects user-facing behavior.
• Security implications have been considered.
• The final diff has been inspected.
• Verified facts are clearly distinguished from assumptions or remaining uncertainty.