1---2name: software-ux-research-33description: UX research and analysis for discovering, validating, and evaluating software experiences, including research ops, governance, and measurement.4---5
6# Software UX Research Skill — Quick Reference
7
8Use this skill to identify problems/opportunities and de-risk decisions. Use `software-ui-ux-design` to implement UI patterns, component changes, and design system updates.
9
10---
11
12## Dec 2025 Baselines (Core)
13
14- **Human-centred design**: Iterative design + evaluation grounded in evidence (ISO 9241-210:2019) https://www.iso.org/standard/77520.html
15- **Usability definition**: Effectiveness, efficiency, satisfaction in context (ISO 9241-11:2018) https://www.iso.org/standard/63500.html
16- **Accessibility baseline**: WCAG 2.2 is a W3C Recommendation (12 Dec 2024) https://www.w3.org/TR/WCAG22/
17- **EU shipping note**: European Accessibility Act applies to covered products/services after 28 Jun 2025 (Directive (EU) 2019/882) https://eur-lex.europa.eu/legal-content/EN/TXT/?uri=CELEX:32019L0882
18
19## When to Use This Skill
20
21- Discovery: user needs, JTBD, opportunity sizing, mental models.
22- Validation: concepts, prototypes, onboarding/first-run success.
23- Evaluative: usability tests, heuristic evaluation, cognitive walkthroughs.
24- Quant/behavioral: funnels, cohorts, instrumentation gaps, guardrails.
25- Research Ops: intake, prioritization, repository/taxonomy, consent/PII handling.
26
27---
28
29## Operating Mode (Core)
30
31If inputs are missing, ask for:
32
33- Decision to unblock (what will change based on this research).
34- Target roles/segments and top tasks.
35- Platforms and contexts (web/mobile/desktop; remote/on-site; assisted tech).
36- Existing evidence (analytics, tickets, reviews, recordings, prior studies).
37- Constraints (timeline, recruitment access, compliance, budget).
38
39Default outputs (pick what the user asked for):
40
41- Research plan + output contract (prefer [../software-clean-code-standard/templates/checklists/ux-research-plan-template.md](../software-clean-code-standard/templates/checklists/ux-research-plan-template.md); use [templates/research-plan-template.md](templates/research-plan-template.md) for skill-specific detail)
42- Study protocol (tasks/script + success metrics + recruitment plan)
43- Findings report (issues + severity + evidence + recommendations + confidence)
44- Decision brief (options + tradeoffs + recommendation + measurement plan)
45
46---
47
48## Method Chooser (Core)
49
50### Research Types (Keep Explicit)
51
52| Type | Goal | Primary Outputs |
53|------|------|-----------------|
54| Discovery | Understand needs and context | JTBD, opportunity areas, constraints |
55| Validation | Reduce solution risk | Go/no-go, prioritization signals |
56| Evaluative | Improve usability/accessibility | Severity-rated issues + fixes |
57
58### Decision Tree (Fast)
59
60```text
61What do you need?
62 ├─ WHY / needs / context → interviews, contextual inquiry, diary
63 ├─ HOW / usability → moderated usability test, cognitive walkthrough, heuristic eval
64 ├─ WHAT / scale → analytics/logs + targeted qual follow-ups
65 └─ WHICH / causal → experiments (if feasible) or preference tests
66```
67
68### Method Selection Table (Practical)
69
70| Question | Best methods | Avoid when | Output |
71|----------|--------------|------------|--------|
72| What problems matter most? | Interviews, contextual inquiry, diary | Only surveys/analytics | Problem framing + evidence |
73| Can users complete key tasks? | Moderated usability tests, task analysis | Stakeholder review | Task success + issue list |
74| Is navigation findable? | Tree test, first-click, card sort | Extremely small audience [Inference] | IA changes + labels |
75| What is happening at scale? | Funnels, cohorts, logs, support taxonomy | Instrumentation missing | Baselines + segments + drop-offs |
76| Which variant performs better? | A/B, switchback, holdout | Insufficient power or high risk | Decision with confidence + guardrails |
77
78---
79
80## Research by Product Stage
81
82### Stage Framework (What to Do When)
83
84| Stage | Decisions | Primary Methods | Secondary Methods | Output |
85|-------|-----------|-----------------|-------------------|--------|
86| Discovery | What to build and for whom | Interviews, field/diary, journey mapping | Competitive analysis, feedback mining | Opportunity brief + JTBD |
87| Concept/MVP | Does the concept work? | Concept test, prototype usability | First-click/tree test | MVP scope + onboarding plan |
88| Launch | Is it usable + accessible? | Usability testing, accessibility review | Heuristic eval, session replay | Launch blockers + fixes |
89| Growth | What drives adoption/value? | Segmented analytics + qual follow-ups | Churn interviews, surveys | Retention drivers + friction |
90| Maturity | What to optimize/deprecate? | Experiments, longitudinal tracking | Unmoderated tests | Incremental roadmap |
91
92### Post-Launch Measurement (What to Track)
93
94| Metric category | What it answers | Pair with |
95|----------------|------------------|----------|
96| Adoption | Are people using it? | Outcome/value metric |
97| Value | Does it help users succeed? | Adoption + qualitative reasons |
98| Reliability | Does it fail in ways users notice? | Error rate + recovery success |
99| Accessibility | Can diverse users complete flows? | Assistive-tech coverage + defect trends |
100
101---
102
103## Research for Complex Systems (Workflows, Admin, Regulated)
104
105### Complexity Indicators
106
107| Indicator | Example | Research Implication |
108|-----------|---------|----------------------|
109| Multi-step workflows | Draft → approve → publish | Task analysis + state mapping |
110| Multi-role permissions | Admin vs editor vs viewer | Test each role + transitions |
111| Data dependencies | Requires integrations/sync | Error-path + recovery testing |
112| High stakes | Finance, healthcare | Safety checks + confirmations |
113| Expert users | Dev tools, analytics | Recruit real experts (not proxies) |
114
115### Evaluation Methods (Core)
116
117- Contextual inquiry: observe real work and constraints.
118- Task analysis: map goals → steps → failure points.
119- Cognitive walkthrough: evaluate learnability and signifiers.
120- Error-path testing: timeouts, offline, partial data, permission loss, retries.
121- Multi-role walkthrough: simulate handoffs (creator → reviewer → admin).
122
123### Multi-Role Coverage Checklist
124
125- [ ] Role-permission matrix documented.
126- [ ] “No access” UX defined (request path, least-privilege defaults).
127- [ ] Cross-role handoffs tested (notifications, state changes, audit history).
128- [ ] Error recovery tested for each role (retry, undo, escalation).
129
130---
131
132## Research Ops & Governance (Core)
133
134### Intake (Make Requests Comparable)
135
136Minimum required fields:
137
138- Decision to unblock and deadline.
139- Research questions (primary + secondary).
140- Target users/segments and recruitment constraints.
141- Existing evidence and links.
142- Deliverable format + audience.
143
144### Prioritization (Simple Scoring)
145
146Use a lightweight score to avoid backlog paralysis:
147
148- Decision impact
149- Knowledge gap
150- Timing urgency
151- Feasibility (recruitment + time)
152
153### Repository & Taxonomy
154
155- Store each study with: method, date, product area, roles, tasks, key findings, raw evidence links.
156- Tag for reuse: problem type (navigation/forms/performance), component/pattern, funnel step.
157- Prefer “atomic” findings (one insight per card) to enable recombination [Inference].
158
159### Consent, PII, and Access Control
160
161Follow applicable privacy laws; GDPR is a primary reference for EU processing https://eur-lex.europa.eu/eli/reg/2016/679/oj
162
163PII handling checklist:
164
165- [ ] Collect minimum PII needed for scheduling and incentives.
166- [ ] Store identity/contact separately from study data.
167- [ ] Redact names/emails from transcripts before broad sharing.
168- [ ] Restrict raw recordings to need-to-know access.
169- [ ] Document consent, purpose, retention, and opt-out path.
170
171---
172
173## Measurement & Decision Quality (Core)
174
175### Triangulation Rubric
176
177| Confidence | Evidence requirement | Use for |
178|------------|----------------------|---------|
179| High | Multiple methods or sources agree | High-impact decisions |
180| Medium | Strong signal from one method + supporting indicators | Prioritization |
181| Low | Single source / small sample | Exploratory hypotheses |
182
183### Adoption vs Value (Avoid Vanity Metrics)
184
185| Metric type | Example | Common pitfall |
186|-------------|---------|----------------|
187| Adoption | Feature usage rate | “Used” ≠ “helpful” |
188| Value/outcome | Task success, goal completion | Harder to instrument |
189
190### When NOT to Run A/B Tests
191
192| Situation | Why it fails | Better method |
193|----------|--------------|---------------|
194| Low power/traffic | Inconclusive results | Usability tests + trends |
195| Many variables change | Attribution impossible | Prototype tests → staged rollout |
196| Need “why” | Experiments don’t explain | Interviews + observation |
197| Ethical constraints | Harmful denial | Phased rollout + holdouts |
198| Long-term effects | Short tests miss delayed impact | Longitudinal + retention analysis |
199
200### Common Confounds (Call Out Early)
201
202- Selection bias (only power users respond).
203- Survivorship bias (you miss churned users).
204- Novelty effect (short-term lift).
205- Instrumentation changes mid-test (metrics drift).
206
207---
208
209## Optional: AI/Automation Research Considerations
210
211> Use only when researching automation/AI-powered features. Skip for traditional software UX.
212
213### Key Questions
214
215| Dimension | Question | Methods |
216|----------|----------|---------|
217| Mental model | What do users think the system can/can’t do? | Interviews, concept tests |
218| Trust calibration | When do users over/under-rely? | Scenario tests, log review |
219| Explanation usefulness | Does “why” help decisions? | A/B explanation variants, interviews |
220| Failure recovery | Do users recover and finish tasks? | Failure-path usability tests |
221
222### Error Taxonomy (User-Visible)
223
224| Failure type | Typical impact | What to measure |
225|-------------|----------------|----------------|
226| Wrong output | Rework, lost trust | Verification + override rate |
227| Missing output | Manual fallback | Fallback completion rate |
228| Unclear output | Confusion | Clarification requests |
229| Non-recoverable failure | Blocked flow | Time-to-recovery, support contact |
230
231### Optional: AI-Assisted Research Ops (Guardrailed)
232
233- Use automation for transcription/tagging only after PII redaction.
234- Maintain an audit trail: every theme links back to raw quotes/clips.
235- Prohibit fabricated quotes and “synthetic users” as evidence for real decisions.
236
237---
238
239## Navigation
240
241### Resources
242
243- [resources/research-frameworks.md](resources/research-frameworks.md) — JTBD, Kano, Double Diamond, Service Blueprint, opportunity mapping
244- [resources/ux-audit-framework.md](resources/ux-audit-framework.md) — Heuristic evaluation, cognitive walkthrough, severity rating
245- [resources/usability-testing-guide.md](resources/usability-testing-guide.md) — Task design, facilitation, analysis
246- [resources/ux-metrics-framework.md](resources/ux-metrics-framework.md) — Task metrics, SUS/HEART, measurement guidance
247- [resources/customer-journey-mapping.md](resources/customer-journey-mapping.md) — Journey mapping and service blueprints
248- [resources/pain-point-extraction.md](resources/pain-point-extraction.md) — Feedback-to-themes method
249- [resources/review-mining-playbook.md](resources/review-mining-playbook.md) — B2B/B2C review mining
250- [data/sources.json](data/sources.json) — Curated external references
251
252### Templates
253
254- Shared plan template: [../software-clean-code-standard/templates/checklists/ux-research-plan-template.md](../software-clean-code-standard/templates/checklists/ux-research-plan-template.md) — Product-agnostic research plan template (core + optional AI)
255- [templates/research-plan-template.md](templates/research-plan-template.md) — UX research plan template
256- [templates/testing/usability-test-plan.md](templates/testing/usability-test-plan.md) — Usability test plan
257- [templates/testing/usability-testing-checklist.md](templates/testing/usability-testing-checklist.md) — Usability testing checklist
258- [templates/audits/heuristic-evaluation-template.md](templates/audits/heuristic-evaluation-template.md) — Heuristic evaluation
259- [templates/audits/ux-audit-report-template.md](templates/audits/ux-audit-report-template.md) — Audit report