Context-Driven Testing
Quick Context Analysis:
- Mission: "Find important problems fast enough to matter" (not "execute test cases")
- Risk: Safety-critical = high rigor; internal tool = lighter touch
- Constraints: Startup with tight timeline ≠ enterprise with compliance
- Skills: Novice needs structure; expert adapts intuitively
Critical Success Factors:
- No "best practices" work everywhere - only good practices in context
- Testing is investigation, not script execution
- Context changes; your approach should too
Quick Reference Card
When to Use
- Making testing decisions for new project
- Questioning "that's how it's done" dogma
- Adapting approach to specific constraints
- Exploratory testing sessions
Seven Context-Driven Principles
- Value of any practice depends on its context
- Good practices in context, no universal best practices
- People working together are most important
- Projects unfold in unpredictable ways
- Product is a solution - if problem not solved, product fails
- Good testing is challenging intellectual work
- Judgment and skill determine right things at right times
Context Factors
| Factor |
Questions |
| Project |
Business goal? User needs? Failure impact? |
| Constraints |
Timeline? Budget? Team skills? Legacy? |
| Risk |
Safety-critical? Regulated? High volume? |
| Technical |
Stack quirks? Integrations? Observability? |
RST Heuristics
| Heuristic |
Application |
| SFDIPOT |
Structure, Function, Data, Interfaces, Platform, Operations, Time |
| Oracles |
Consistency with history, similar products, expectations, docs |
| Tours |
Business District, Historical, Bad Neighborhood, Tourist, Museum |
Context-Driven Decisions
Example: Test Automation Level
Startup Context:
- Small team, rapid changes, unclear product-market fit
- Decision: Light automation on critical paths, heavy exploratory
- Rationale: Requirements change too fast for extensive automation
Enterprise Context:
- Stable features, regulatory requirements, large team
- Decision: Comprehensive automated regression suite
- Rationale: Stability allows automation investment to pay off
Example: Documentation
Regulated (FDA/medical):
- Decision: Detailed test protocols, traceability matrices
- Rationale: Regulatory compliance isn't optional
Fast-paced startup:
- Decision: Lightweight session notes, risk logs
- Rationale: Bureaucracy slows more than it helps
Investigation vs. Checking
| Checking |
Testing (Investigation) |
| Did API return 200? |
Does API meet user needs? |
| Does button work? |
What happens under load? |
| Match the spec? |
Does it solve the problem? |
Red Flags: Not Context-Driven
- Follow process "because that's how it's done"
- Can't explain why you're doing something
- Measure test cases executed, not problems found
- Test plan could apply to any project
- Stop thinking once you have a script
Agent-Assisted Context-Driven Testing
// Agent analyzes context and recommends approach
const context = await Task("Analyze Context", {
project: 'e-commerce-platform',
stage: 'startup',
constraints: ['timeline: tight', 'budget: limited'],
risks: ['payment-security', 'high-volume']
}, "qe-fleet-commander");
// Context-aware agent selection
// - qe-security-scanner (critical risk)
// - qe-performance-tester (high volume)
// - Skip: qe-visual-tester (low priority in startup context)
// Adaptive testing strategy
await Task("Generate Tests", {
context: 'startup',
focus: 'critical-paths-only',
depth: 'smoke-tests',
automation: 'minimal'
}, "qe-test-generator");
Agent Coordination Hints
Memory Namespace
aqe/context-driven/
├── context-analysis/* - Project context snapshots
├── decisions/* - Testing decisions with rationale
├── discoveries/* - What was learned during testing
└── adaptations/* - How approach changed over time
Fleet Coordination
const contextFleet = await FleetManager.coordinate({
strategy: 'context-driven',
context: {
type: 'greenfield-saas',
stage: 'growth',
compliance: 'gdpr-only'
},
agents: ['qe-test-generator', 'qe-security-scanner', 'qe-performance-tester'],
exclude: ['qe-visual-tester', 'qe-requirements-validator'] // Not priority
});
Practical Tips
- Start with risk assessment - List features, ask: How likely to fail? How bad? How hard to test?
- Time-box exploration - 2 hours checkout, 30 min error handling, 15 min per browser
- Document discoveries - Not "Enter invalid email, verify error" but "Payment API returns 500 instead of 400, no user-visible error. Bug filed."
- Talk to humans - Developers, users, support, product
- Pair with others - Different perspectives = different bugs
Related Skills
Remember
Context drives decisions. No universal best practices. Skilled testers make informed decisions based on specific goals, constraints, and risks.
You're not a test script executor. You're a skilled investigator helping teams build better products.
With Agents: Agents analyze context, adapt strategies, and learn what works in your situation. Use agents to scale context-driven thinking while maintaining human judgment for critical decisions.
1---
2inclusion: auto
3name: qe-context-driven-testing
4description: "Apply context-driven testing principles where practices are chosen based on project context, not universal 'best practices'. Use when making testing decisions, questioning dogma, or adapting approaches to specific project needs."
5tags: [context-driven, rst, exploratory, heuristics, oracles, skilled-testing]
6---
7
8# Context-Driven Testing
9
10<default_to_action>
11When making testing decisions or adapting approaches:
121. ANALYZE context: project goals, constraints, risks, team skills
132. QUESTION practices: "Why this? What risk does it address? What's the cost?"
143. INVESTIGATE not just check: Does software solve the problem, or create new ones?
154. ADAPT approach based on context, not "best practices"
165. DOCUMENT discoveries, not pre-written plans
17
18**Quick Context Analysis:**
19- Mission: "Find important problems fast enough to matter" (not "execute test cases")
20- Risk: Safety-critical = high rigor; internal tool = lighter touch
21- Constraints: Startup with tight timeline ≠ enterprise with compliance
22- Skills: Novice needs structure; expert adapts intuitively
23
24**Critical Success Factors:**
25- No "best practices" work everywhere - only good practices in context
26- Testing is investigation, not script execution
27- Context changes; your approach should too
28</default_to_action>
29
30## Quick Reference Card
31
32### When to Use
33- Making testing decisions for new project
34- Questioning "that's how it's done" dogma
35- Adapting approach to specific constraints
36- Exploratory testing sessions
37
38### Seven Context-Driven Principles
391. Value of any practice depends on its context
402. Good practices in context, no universal best practices
413. People working together are most important
424. Projects unfold in unpredictable ways
435. Product is a solution - if problem not solved, product fails
446. Good testing is challenging intellectual work
457. Judgment and skill determine right things at right times
46
47### Context Factors
48| Factor | Questions |
49|--------|-----------|
50| **Project** | Business goal? User needs? Failure impact? |
51| **Constraints** | Timeline? Budget? Team skills? Legacy? |
52| **Risk** | Safety-critical? Regulated? High volume? |
53| **Technical** | Stack quirks? Integrations? Observability? |
54
55### RST Heuristics
56| Heuristic | Application |
57|-----------|-------------|
58| **SFDIPOT** | Structure, Function, Data, Interfaces, Platform, Operations, Time |
59| **Oracles** | Consistency with history, similar products, expectations, docs |
60| **Tours** | Business District, Historical, Bad Neighborhood, Tourist, Museum |
61
62---
63
64## Context-Driven Decisions
65
66### Example: Test Automation Level
67
68**Startup Context:**
69- Small team, rapid changes, unclear product-market fit
70- **Decision:** Light automation on critical paths, heavy exploratory
71- **Rationale:** Requirements change too fast for extensive automation
72
73**Enterprise Context:**
74- Stable features, regulatory requirements, large team
75- **Decision:** Comprehensive automated regression suite
76- **Rationale:** Stability allows automation investment to pay off
77
78### Example: Documentation
79
80**Regulated (FDA/medical):**
81- **Decision:** Detailed test protocols, traceability matrices
82- **Rationale:** Regulatory compliance isn't optional
83
84**Fast-paced startup:**
85- **Decision:** Lightweight session notes, risk logs
86- **Rationale:** Bureaucracy slows more than it helps
87
88---
89
90## Investigation vs. Checking
91
92| Checking | Testing (Investigation) |
93|----------|------------------------|
94| Did API return 200? | Does API meet user needs? |
95| Does button work? | What happens under load? |
96| Match the spec? | Does it solve the problem? |
97
98---
99
100## Red Flags: Not Context-Driven
101
102- Follow process "because that's how it's done"
103- Can't explain *why* you're doing something
104- Measure test cases executed, not problems found
105- Test plan could apply to any project
106- Stop thinking once you have a script
107
108---
109
110## Agent-Assisted Context-Driven Testing
111
112```typescript
113// Agent analyzes context and recommends approach
114const context = await Task("Analyze Context", {
115 project: 'e-commerce-platform',
116 stage: 'startup',
117 constraints: ['timeline: tight', 'budget: limited'],
118 risks: ['payment-security', 'high-volume']
119}, "qe-fleet-commander");
120
121// Context-aware agent selection
122// - qe-security-scanner (critical risk)
123// - qe-performance-tester (high volume)
124// - Skip: qe-visual-tester (low priority in startup context)
125
126// Adaptive testing strategy
127await Task("Generate Tests", {
128 context: 'startup',
129 focus: 'critical-paths-only',
130 depth: 'smoke-tests',
131 automation: 'minimal'
132}, "qe-test-generator");
133```
134
135---
136
137## Agent Coordination Hints
138
139### Memory Namespace
140```
141aqe/context-driven/
142├── context-analysis/* - Project context snapshots
143├── decisions/* - Testing decisions with rationale
144├── discoveries/* - What was learned during testing
145└── adaptations/* - How approach changed over time
146```
147
148### Fleet Coordination
149```typescript
150const contextFleet = await FleetManager.coordinate({
151 strategy: 'context-driven',
152 context: {
153 type: 'greenfield-saas',
154 stage: 'growth',
155 compliance: 'gdpr-only'
156 },
157 agents: ['qe-test-generator', 'qe-security-scanner', 'qe-performance-tester'],
158 exclude: ['qe-visual-tester', 'qe-requirements-validator'] // Not priority
159});
160```
161
162---
163
164## Practical Tips
165
1661. **Start with risk assessment** - List features, ask: How likely to fail? How bad? How hard to test?
1672. **Time-box exploration** - 2 hours checkout, 30 min error handling, 15 min per browser
1683. **Document discoveries** - Not "Enter invalid email, verify error" but "Payment API returns 500 instead of 400, no user-visible error. Bug filed."
1694. **Talk to humans** - Developers, users, support, product
1705. **Pair with others** - Different perspectives = different bugs
171
172---
173
174## Related Skills
175- [agentic-quality-engineering](../agentic-quality-engineering/) - Context-aware agent selection
176- [holistic-testing-pact](../holistic-testing-pact/) - Adapt holistic model to context
177- [risk-based-testing](../risk-based-testing/) - Context affects risk assessment
178- [exploratory-testing-advanced](../exploratory-testing-advanced/) - RST techniques
179
180---
181
182## Remember
183
184**Context drives decisions.** No universal best practices. Skilled testers make informed decisions based on specific goals, constraints, and risks.
185
186You're not a test script executor. You're a skilled investigator helping teams build better products.
187
188**With Agents:** Agents analyze context, adapt strategies, and learn what works in your situation. Use agents to scale context-driven thinking while maintaining human judgment for critical decisions.