Context-Driven Testing
Quick Context Analysis:
- Mission: "Find important problems fast enough to matter" (not "execute test cases")
- Risk: Safety-critical = high rigor; internal tool = lighter touch
- Constraints: Startup with tight timeline ≠ enterprise with compliance
- Skills: Novice needs structure; expert adapts intuitively
Critical Success Factors:
- No "best practices" work everywhere - only good practices in context
- Testing is investigation, not script execution
- Context changes; your approach should too
Quick Reference Card
When to Use
- Making testing decisions for new project
- Questioning "that's how it's done" dogma
- Adapting approach to specific constraints
- Exploratory testing sessions
Seven Context-Driven Principles
- Value of any practice depends on its context
- Good practices in context, no universal best practices
- People working together are most important
- Projects unfold in unpredictable ways
- Product is a solution - if problem not solved, product fails
- Good testing is challenging intellectual work
- Judgment and skill determine right things at right times
Context Factors
| Factor |
Questions |
| Project |
Business goal? User needs? Failure impact? |
| Constraints |
Timeline? Budget? Team skills? Legacy? |
| Risk |
Safety-critical? Regulated? High volume? |
| Technical |
Stack quirks? Integrations? Observability? |
RST Heuristics
| Heuristic |
Application |
| SFDIPOT |
Structure, Function, Data, Interfaces, Platform, Operations, Time |
| Oracles |
Consistency with history, similar products, expectations, docs |
| Tours |
Business District, Historical, Bad Neighborhood, Tourist, Museum |
Context-Driven Decisions
Example: Test Automation Level
Startup Context:
- Small team, rapid changes, unclear product-market fit
- Decision: Light automation on critical paths, heavy exploratory
- Rationale: Requirements change too fast for extensive automation
Enterprise Context:
- Stable features, regulatory requirements, large team
- Decision: Comprehensive automated regression suite
- Rationale: Stability allows automation investment to pay off
Example: Documentation
Regulated (FDA/medical):
- Decision: Detailed test protocols, traceability matrices
- Rationale: Regulatory compliance isn't optional
Fast-paced startup:
- Decision: Lightweight session notes, risk logs
- Rationale: Bureaucracy slows more than it helps
Investigation vs. Checking
| Checking |
Testing (Investigation) |
| Did API return 200? |
Does API meet user needs? |
| Does button work? |
What happens under load? |
| Match the spec? |
Does it solve the problem? |
Red Flags: Not Context-Driven
- Follow process "because that's how it's done"
- Can't explain why you're doing something
- Measure test cases executed, not problems found
- Test plan could apply to any project
- Stop thinking once you have a script
Agent-Assisted Context-Driven Testing
// Agent analyzes context and recommends approach
const context = await Task("Analyze Context", {
project: 'e-commerce-platform',
stage: 'startup',
constraints: ['timeline: tight', 'budget: limited'],
risks: ['payment-security', 'high-volume']
}, "qe-fleet-commander");
// Context-aware agent selection
// - qe-security-scanner (critical risk)
// - qe-performance-tester (high volume)
// - Skip: qe-visual-tester (low priority in startup context)
// Adaptive testing strategy
await Task("Generate Tests", {
context: 'startup',
focus: 'critical-paths-only',
depth: 'smoke-tests',
automation: 'minimal'
}, "qe-test-generator");
Agent Coordination Hints
Memory Namespace
aqe/context-driven/
├── context-analysis/* - Project context snapshots
├── decisions/* - Testing decisions with rationale
├── discoveries/* - What was learned during testing
└── adaptations/* - How approach changed over time
Fleet Coordination
const contextFleet = await FleetManager.coordinate({
strategy: 'context-driven',
context: {
type: 'greenfield-saas',
stage: 'growth',
compliance: 'gdpr-only'
},
agents: ['qe-test-generator', 'qe-security-scanner', 'qe-performance-tester'],
exclude: ['qe-visual-tester', 'qe-requirements-validator'] // Not priority
});
Practical Tips
- Start with risk assessment - List features, ask: How likely to fail? How bad? How hard to test?
- Time-box exploration - 2 hours checkout, 30 min error handling, 15 min per browser
- Document discoveries - Not "Enter invalid email, verify error" but "Payment API returns 500 instead of 400, no user-visible error. Bug filed."
- Talk to humans - Developers, users, support, product
- Pair with others - Different perspectives = different bugs
Related Skills
Remember
Context drives decisions. No universal best practices. Skilled testers make informed decisions based on specific goals, constraints, and risks.
You're not a test script executor. You're a skilled investigator helping teams build better products.
With Agents: Agents analyze context, adapt strategies, and learn what works in your situation. Use agents to scale context-driven thinking while maintaining human judgment for critical decisions.
1---2name: qe-context-driven-testing3description: Apply context-driven testing principles where practices are chosen based on project context, not universal 'best practices'. Use when making testing decisions, questioning dogma, or adapting approaches to specific project needs.4---5
6# Context-Driven Testing
7
8<default_to_action>
9When making testing decisions or adapting approaches:
101. ANALYZE context: project goals, constraints, risks, team skills
112. QUESTION practices: "Why this? What risk does it address? What's the cost?"
123. INVESTIGATE not just check: Does software solve the problem, or create new ones?
134. ADAPT approach based on context, not "best practices"
145. DOCUMENT discoveries, not pre-written plans
15
16**Quick Context Analysis:**
17- Mission: "Find important problems fast enough to matter" (not "execute test cases")
18- Risk: Safety-critical = high rigor; internal tool = lighter touch
19- Constraints: Startup with tight timeline ≠ enterprise with compliance
20- Skills: Novice needs structure; expert adapts intuitively
21
22**Critical Success Factors:**
23- No "best practices" work everywhere - only good practices in context
24- Testing is investigation, not script execution
25- Context changes; your approach should too
26</default_to_action>
27
28## Quick Reference Card
29
30### When to Use
31- Making testing decisions for new project
32- Questioning "that's how it's done" dogma
33- Adapting approach to specific constraints
34- Exploratory testing sessions
35
36### Seven Context-Driven Principles
371. Value of any practice depends on its context
382. Good practices in context, no universal best practices
393. People working together are most important
404. Projects unfold in unpredictable ways
415. Product is a solution - if problem not solved, product fails
426. Good testing is challenging intellectual work
437. Judgment and skill determine right things at right times
44
45### Context Factors
46| Factor | Questions |
47|--------|-----------|
48| **Project** | Business goal? User needs? Failure impact? |
49| **Constraints** | Timeline? Budget? Team skills? Legacy? |
50| **Risk** | Safety-critical? Regulated? High volume? |
51| **Technical** | Stack quirks? Integrations? Observability? |
52
53### RST Heuristics
54| Heuristic | Application |
55|-----------|-------------|
56| **SFDIPOT** | Structure, Function, Data, Interfaces, Platform, Operations, Time |
57| **Oracles** | Consistency with history, similar products, expectations, docs |
58| **Tours** | Business District, Historical, Bad Neighborhood, Tourist, Museum |
59
60---
61
62## Context-Driven Decisions
63
64### Example: Test Automation Level
65
66**Startup Context:**
67- Small team, rapid changes, unclear product-market fit
68- **Decision:** Light automation on critical paths, heavy exploratory
69- **Rationale:** Requirements change too fast for extensive automation
70
71**Enterprise Context:**
72- Stable features, regulatory requirements, large team
73- **Decision:** Comprehensive automated regression suite
74- **Rationale:** Stability allows automation investment to pay off
75
76### Example: Documentation
77
78**Regulated (FDA/medical):**
79- **Decision:** Detailed test protocols, traceability matrices
80- **Rationale:** Regulatory compliance isn't optional
81
82**Fast-paced startup:**
83- **Decision:** Lightweight session notes, risk logs
84- **Rationale:** Bureaucracy slows more than it helps
85
86---
87
88## Investigation vs. Checking
89
90| Checking | Testing (Investigation) |
91|----------|------------------------|
92| Did API return 200? | Does API meet user needs? |
93| Does button work? | What happens under load? |
94| Match the spec? | Does it solve the problem? |
95
96---
97
98## Red Flags: Not Context-Driven
99
100- Follow process "because that's how it's done"
101- Can't explain *why* you're doing something
102- Measure test cases executed, not problems found
103- Test plan could apply to any project
104- Stop thinking once you have a script
105
106---
107
108## Agent-Assisted Context-Driven Testing
109
110```typescript
111// Agent analyzes context and recommends approach
112const context = await Task("Analyze Context", {
113 project: 'e-commerce-platform',
114 stage: 'startup',
115 constraints: ['timeline: tight', 'budget: limited'],
116 risks: ['payment-security', 'high-volume']
117}, "qe-fleet-commander");
118
119// Context-aware agent selection
120// - qe-security-scanner (critical risk)
121// - qe-performance-tester (high volume)
122// - Skip: qe-visual-tester (low priority in startup context)
123
124// Adaptive testing strategy
125await Task("Generate Tests", {
126 context: 'startup',
127 focus: 'critical-paths-only',
128 depth: 'smoke-tests',
129 automation: 'minimal'
130}, "qe-test-generator");
131```
132
133---
134
135## Agent Coordination Hints
136
137### Memory Namespace
138```
139aqe/context-driven/
140├── context-analysis/* - Project context snapshots
141├── decisions/* - Testing decisions with rationale
142├── discoveries/* - What was learned during testing
143└── adaptations/* - How approach changed over time
144```
145
146### Fleet Coordination
147```typescript
148const contextFleet = await FleetManager.coordinate({
149 strategy: 'context-driven',
150 context: {
151 type: 'greenfield-saas',
152 stage: 'growth',
153 compliance: 'gdpr-only'
154 },
155 agents: ['qe-test-generator', 'qe-security-scanner', 'qe-performance-tester'],
156 exclude: ['qe-visual-tester', 'qe-requirements-validator'] // Not priority
157});
158```
159
160---
161
162## Practical Tips
163
1641. **Start with risk assessment** - List features, ask: How likely to fail? How bad? How hard to test?
1652. **Time-box exploration** - 2 hours checkout, 30 min error handling, 15 min per browser
1663. **Document discoveries** - Not "Enter invalid email, verify error" but "Payment API returns 500 instead of 400, no user-visible error. Bug filed."
1674. **Talk to humans** - Developers, users, support, product
1685. **Pair with others** - Different perspectives = different bugs
169
170---
171
172## Related Skills
173- [agentic-quality-engineering](../agentic-quality-engineering/) - Context-aware agent selection
174- [holistic-testing-pact](../holistic-testing-pact/) - Adapt holistic model to context
175- [risk-based-testing](../risk-based-testing/) - Context affects risk assessment
176- [exploratory-testing-advanced](../exploratory-testing-advanced/) - RST techniques
177
178---
179
180## Remember
181
182**Context drives decisions.** No universal best practices. Skilled testers make informed decisions based on specific goals, constraints, and risks.
183
184You're not a test script executor. You're a skilled investigator helping teams build better products.
185
186**With Agents:** Agents analyze context, adapt strategies, and learn what works in your situation. Use agents to scale context-driven thinking while maintaining human judgment for critical decisions.