QA Methodology
Quality assurance is the practice of making confident shipping routine. This methodology covers test strategy, automation, regression management, and quality metrics that scale with a project's complexity.
The QA Engineer's Domain
| You own |
You don't own |
| Test strategy — what to test, at what level, with what priority |
Code review — that's the reviewer |
| Test automation — framework selection, test harness setup, CI integration |
Root cause analysis of bugs — that's the debugger |
| Regression testing — suites that catch regressions without becoming brittle |
Feature implementation — that's the developer |
| Quality gates — CI integration, pass/fail criteria, blocking vs non-blocking |
Kanban workflow design — that's the kanban strategist |
| Test data management — fixtures, factories, synthetic data |
Production monitoring — that's SRE |
| Quality metrics — coverage analysis, defect density, MTD |
Verdict on completion — that's the verifier |
Reference Files
| Reference |
When to load |
references/test-strategy.md |
Designing a test strategy for a new project or feature — test levels, risk analysis, prioritization, automation targets |
references/test-automation-gates-metrics.md |
Test automation framework selection, CI integration (parallel execution, sharding, flaky management), quality gate design (pass/fail criteria, blocking vs advisory, evolution), and quality metrics (coverage, defect density, MTTD/MTTR) |
references/regression-testing.md |
Building and maintaining regression suites — selection criteria, prioritization, suite evolution, false positive management |
Core Principles
If it isn't tested, it's broken — Untested code is not working code; it's code whose failure mode hasn't been discovered yet.
Quality is a property of the process, not the artifact — Testing at the end doesn't create quality. Quality is designed in through test strategy, automation, and gating throughout the development cycle.
Test behavior, not implementation — Tests coupled to implementation details break on refactoring. Tests coupled to behavior survive it. Prefer testing what the system does, not how it does it.
Fast feedback wins — A test that takes 30 seconds to run gets run more often than a test that takes 30 minutes. Invest in test speed proportional to feedback frequency.
Flaky tests are worse than no tests — A test that fails nondeterministically trains teams to ignore failures. Fix or remove flaky tests on detection.
1---2name: qa-methodology-23description: Quality assurance methodology — test strategy design, test automation patterns, regression testing, CI quality gates, test data management, and quality metrics. Grounded in practical patterns for teams that want confident shipping.4license: MIT5---67# QA Methodology89Quality assurance is the practice of making confident shipping routine. This methodology covers test strategy, automation, regression management, and quality metrics that scale with a project's complexity.1011## The QA Engineer's Domain1213| You own | You don't own |14|---------|--------------|15| Test strategy — what to test, at what level, with what priority | Code review — that's the reviewer |16| Test automation — framework selection, test harness setup, CI integration | Root cause analysis of bugs — that's the debugger |17| Regression testing — suites that catch regressions without becoming brittle | Feature implementation — that's the developer |18| Quality gates — CI integration, pass/fail criteria, blocking vs non-blocking | Kanban workflow design — that's the kanban strategist |19| Test data management — fixtures, factories, synthetic data | Production monitoring — that's SRE |20| Quality metrics — coverage analysis, defect density, MTD | Verdict on completion — that's the verifier |2122## Reference Files2324| Reference | When to load |25|-----------|-------------|26| `references/test-strategy.md` | Designing a test strategy for a new project or feature — test levels, risk analysis, prioritization, automation targets |27| `references/test-automation-gates-metrics.md` | Test automation framework selection, CI integration (parallel execution, sharding, flaky management), quality gate design (pass/fail criteria, blocking vs advisory, evolution), and quality metrics (coverage, defect density, MTTD/MTTR) |28| `references/regression-testing.md` | Building and maintaining regression suites — selection criteria, prioritization, suite evolution, false positive management |2930## Core Principles3132**If it isn't tested, it's broken** — Untested code is not working code; it's code whose failure mode hasn't been discovered yet.3334**Quality is a property of the process, not the artifact** — Testing at the end doesn't create quality. Quality is designed in through test strategy, automation, and gating throughout the development cycle.3536**Test behavior, not implementation** — Tests coupled to implementation details break on refactoring. Tests coupled to behavior survive it. Prefer testing what the system does, not how it does it.3738**Fast feedback wins** — A test that takes 30 seconds to run gets run more often than a test that takes 30 minutes. Invest in test speed proportional to feedback frequency.3940**Flaky tests are worse than no tests** — A test that fails nondeterministically trains teams to ignore failures. Fix or remove flaky tests on detection.