zwright8 Experiment Design for design and user research
Mission
Use experiment design in design and user research with emphasis on evidence quality, falsifiability, and calibration.
Activation Cues
- Task requires experiment design in design and user research.
- Task needs explicit risk controls, approval gates, and traceable outcomes.
- Task output must include artifact handoff for humans and agents.
Execution Plan
- Define measurable outcomes for Experiment Design for design and user research, including baseline and target metrics for design and user research.
- Specify structured inputs/outputs for experiment design and validate schema contract edge cases.
- Implement the core experiment design logic with deterministic scoring and reproducible execution traces.
- Integrate orchestration policy, routing, approval gates, retries, and rollback for autonomous execution.
- Run unit, integration, simulation, and regression suites for Experiment Design for design and user research under maximally truth-seeking conditions.
- Roll out behind a feature flag, monitor telemetry, and refine thresholds using observed operational outcomes.
Runbook
Preflight:
- Validate mission scope, contracts, and required inputs.
- Verify feature flag posture, dependencies, and approval prerequisites.
Execution:
- Execute experiment design workflow with deterministic scoring and trace capture.
- Track posture transitions and preserve reproducible evidence artifacts.
Recovery:
- Apply rollback strategy if posture is critical or guardrails fail.
- Escalate blocked execution to oversight with incident packet and trace references.
Handoff:
- Publish outcome report, scorecard, and telemetry links.
- Queue follow-up tasks for unresolved risks, approvals, or optimization work.
Guardrails
- [quality] Require unit and integration validations before promoting Experiment Design for design and user research. Automation:
run-validation:unit+integration+simulation+regression-baseline - [reliability] Trigger rollback on critical posture or repeated failures. Automation:
rollback:rollback-to-last-stable-baseline - [compliance] Require policy and approval gates prior to autonomous deployment. Automation:
approval-gates:policy-constraint-check+evidence-review - [cost] Respect bounded resource pressure and execution budget during scaling. Automation:
budget-guard:resource-pressure-cap
Success Metrics
- Primary metric: accuracy lift
- Secondary metrics: contradiction reduction, evidence coverage in design and user research
- Review cadence: weekly
Output Contract
- Return a concise execution summary with key decisions.
- Return risk and mitigation notes with unresolved blockers.
- Return artifact target:
experiment-design-artifact-design-and-user-research. - Return recommended follow-up tasks for next wave execution.