QA Project Context

Downstream skills consume specific sections: Risk Areas feeds risk-based-testing and test-strategy; Conventions → Selectors feeds playwright-automation and test-reliability; Quality Goals feeds qa-metrics; Tech Stack feeds every automation skill. Fill those sections well and the rest of the library gets sharper for free.

Discovery Questions

First, check whether .agents/qa-project-context.md already exists — if it does, read it and skip every section already filled (no [brackets]). Then scan the repo for config files (see Codebase Detection) and present detected values for confirmation rather than asking blind. Walk the remaining questions section by section, never all at once.

Product

• What is the product called, and what does it do in one sentence?
• What type is it? (SaaS, e-commerce, media, mobile app, API service, internal tool) — changes which flows matter.
• What are the production, staging, and development URLs?
• What are the 5–10 most critical user journeys? ("If this breaks, we get paged at 2am.") This list drives every other skill's coverage priorities.

Tech Stack

• Frontend framework and language? Backend framework, language, and API style (REST, GraphQL, tRPC, gRPC)?
• Database, cache layer, ORM? Hosting, CDN, monitoring?
• Monorepo? If yes, list each app separately (see Monorepo note) — sharding and detection differ.

Test Stack

• E2E tests today? Framework, config location, test directory. Same for unit, API, visual, performance.
• If a framework is detected from config files, populate Test Stack with its name + version + path — don't re-ask.
• Zero test infrastructure? That's a valid answer; record "None selected yet" and note a default (see Core Principle 3).

CI/CD

• Platform? When do tests run (every push, PR only, nightly, manual)? Sharding/parallelism?
• What blocks a deploy, and what artifacts are saved (screenshots, reports, coverage)?

Environments

• How many environments, with URLs? How close is staging to production (infra, data shape, third-party integrations)?
• Mock services or real APIs in development? — environment parity drives test reliability.

Quality Goals

• Coverage targets today? Flake tolerance? Suite-duration budgets? Metrics tracked or wanted?
• No targets yet? Suggest realistic ones by maturity (see Quality Goals section).

Risk Areas

• Which parts cause the most production incidents? Which integrations are flakiest (payment, email, third-party APIs)?
• Where is churn high and coverage low? Score everything with Impact × Likelihood (see Risk Areas section).

Team

• How many QA engineers, and their specializations? Developer-to-QA ratio? Methodology (Scrum, Kanban, Shape Up)?
• When does QA engage (shift-left during spec, or after dev)? — sets the automation ownership model.

Conventions

• Test file naming pattern? Co-located or separate? Branching strategy and PR requirements?
• Selector strategy for E2E? Test-data strategy (factories, fixtures, seeded DB, API-per-test)?

Core Principles

1. One file is the source of truth for the whole library. Every skill reads .agents/qa-project-context.md first. Duplicating its facts into other docs guarantees drift — keep stack, goals, and risks here and let other skills reference them.

2. Capture the real state, not the aspiration. If there are no E2E tests, write "None selected yet," not a wish. Downstream skills route on what's true: a missing framework triggers a setup suggestion; a fake one sends them building on sand.

3. Detect before you ask; recommend a default only when there's nothing to detect. Read package.json and config files first and confirm what you find. Tool recommendations belong to the specialized skills — the one exception is a project with zero test infrastructure, where you note Playwright (E2E) and Vitest (unit) as defaults in the Test Stack and hand off to playwright-automation / unit-testing. This is the single carve-out to the "no recommendations" rule; everywhere else, just record.

4. Risk Areas is the highest-leverage section — never skip it. It is the direct input to risk-based-testing and test-strategy. Push for at least 3–4 entries scored by impact and likelihood even when the user says "everything's fine."

Codebase Detection

Scan for these before asking about the stack. Present detected values for confirmation; when a test config is found, write the framework name into Test Stack rather than re-asking.

Workflow: Creating the Context File

1. Check for existing context. Look for .agents/qa-project-context.md in the project root.
2. If absent: create .agents/ if needed, scaffold the section structure, run the Discovery Questions starting with Product, and write the file once filled.
3. If present with placeholders: read it, list which sections are complete vs. unfilled, ask only about the unfilled sections, then update — preserve completed sections untouched.
4. If present and complete: summarize the current context, ask what changed (new tools, team changes, shifted goals), and update only the deltas.
5. After completion: confirm the file path, run Verification (below), and suggest the next skill from the context (no E2E → playwright-automation; no strategy → test-strategy; no unit tests → unit-testing).

For two full filled-in files (SaaS and a multi-site publisher) plus the monorepo layout, see references/examples.md. One short illustrative snippet:

## Test Stack
### E2E / Integration
- **Framework:** Playwright 1.60
- **Config Location:** playwright.config.ts
- **Test Directory:** tests/e2e/
### Unit / Component
- **Framework:** None selected yet — Vitest recommended (see unit-testing)

Section Guidance

What makes a good entry in each section. The blank template ships at .agents/qa-project-context.md in the qaskills repo.

Product. Key user flows must be specific and testable: "Buyer searches products, adds to cart, checks out with Stripe, receives confirmation email" — not "user uses the app." This list is what every test skill uses to prioritize. Aim for 5–10.

Tech Stack. Record frontend, backend, database, hosting separately. Pin versions only when they change the testing approach (App Router vs. Pages Router differ materially). Don't copy a version just because an example shows one — read it from package.json.

Test Stack. For each tool: framework name + version, config location, test directory. No infrastructure yet is valid — write "None selected yet" and the recommended default (Principle 3).

Monorepo. List each frontend app as its own Tech Stack and Test Stack entry; keep the shared API/backend as one entry. Shard E2E per app (a change in apps/admin shouldn't run apps/storefront E2E), and note in CI/CD which path filters gate which app's suite. Detection hint: turbo.json / pnpm-workspace.yaml / nx.json. See references/examples.md.

CI/CD. Answer what other skills need: what blocks a deploy, how fast feedback is, what evidence is preserved.

Environments. Note how staging diverges from production — a different DB engine in staging means staging-green tests can still fail in prod.

Quality Goals. Concrete and measurable only. Pick starting targets by maturity:

Write them as numbers: "80% line coverage measured by Istanbul," "flake rate <2% over a rolling 30-day window," "full E2E under 15 min with 4 shards." Never "we want great quality."

Risk Areas. Use the table — columns Area, Risk Level, Business Impact, Notes — and score with Impact × Likelihood:

• Critical (test first): high impact + high likelihood (payment flow with known edge cases).
• Important: high impact + low likelihood (auth — catastrophic if broken, rarely changes).
• Monitor: low impact + high likelihood (notification formatting — breaks often, low severity).
• Backlog: low impact + low likelihood (admin settings — stable, rarely used).

At least 3 entries, never vague ("everything breaks").

Team. Record actual headcount and the dev:QA ratio — it sets the automation ownership model:

Conventions. Selector strategy especially — playwright-automation and test-reliability read it to generate matching selectors. Default to data-testid for stability (data-testid="invoice-create-button", kebab-case). If the team prefers semantic/ARIA selectors for accessibility-aware testing, record concrete tokens — role="button", role="heading", getByRole('link', { name: ... }) — and the tradeoff: ARIA roles double as a11y assertions and survive markup churn, but are less stable than data-testid when copy or roles change, so pin a name/level to keep them unambiguous.

Anti-Patterns

1. Asking all questions at once

Dumping 30 questions is overwhelming and gets shallow answers. Walk section by section, Product first.

2. Leaving [brackets] in the final file

If the user has no answer, record the actual state ("None — no E2E framework selected yet"), not a placeholder. Placeholders left in the file silently break every downstream skill that parses it.

3. Inventing information

Detect the stack from package.json, requirements.txt, or config files — then confirm with the user before writing. Don't guess a database or hosting provider.

4. Skipping Risk Areas

The single most valuable section for downstream skills. Push for at least 3–4 scored entries even when the user insists everything is fine.

5. Recommending tools beyond the zero-infra default

This skill records current state; tool selection belongs to playwright-automation, unit-testing, and the other specialized skills. The only recommendation you make here is the Playwright + Vitest default when there is no test infrastructure at all (Principle 3).

Verification

Prove the produced file is complete, smallest check first. From the project root:

test -f .agents/qa-project-context.md \
  && ! grep -q '\[.*\]' .agents/qa-project-context.md \
  && echo "context complete: file exists, no placeholders"

Exit 0 with the message means the file exists and every [bracketed placeholder] is gone. A non-zero exit means either the file is missing or placeholders remain — fix those before handing off to any other skill. Then eyeball that all nine section headers are present:

grep -c '^## ' .agents/qa-project-context.md   # expect >= 9

Done When

• .agents/qa-project-context.md exists in the project root and grep -q '\[.*\]' returns non-zero (no bracketed placeholders remain).
• All nine sections are present: Product, Tech Stack, Test Stack, CI/CD, Environments, Quality Goals, Risk Areas, Team, Conventions.
• Product lists at least 5 specific, testable key user flows (no "user uses the app").
• Test Stack names the actual frameworks + versions + paths in use, or states "None selected yet" with the recommended default noted.
• Risk Areas table has at least 3 entries scored by impact and business impact.
• Quality Goals are concrete numbers (coverage %, flake %, durations) — not aspirational prose.
• Team section shows actual headcount and the dev:QA ratio (or "solo").

Related Skills

• qa-start — bootstraps QA on a brand-new project end-to-end and calls this skill as its first step. Use qa-start when no QA exists yet; use this skill directly to (re)fill context.
• risk-based-testing — turns the Risk Areas section into a prioritized risk matrix. Run it after this skill when the question is "where do we focus testing?"
• test-strategy — consumes Risk Areas, Quality Goals, and Team to set multi-quarter direction.
• qa-metrics — tracks the Quality Goals defined here; both reference the same targets.
• playwright-automation / unit-testing — set up E2E / unit frameworks after the Test Stack section is filled; they read Conventions for selector and naming strategy.
• ci-cd-integration — wires the pipeline described in the CI/CD section.

Reference Files (in references/)

• examples.md — two complete filled-in context files (SaaS and a multi-site publisher) plus the monorepo Tech/Test Stack layout.