zwright8 Experiment Design for legal and policy workflows
Why This Skill Exists
Use experiment design in legal and policy workflows with emphasis on evidence quality, falsifiability, and calibration.
When To Use
Use this skill when the request explicitly needs "Experiment Design for legal and policy workflows" outcomes in the legal and policy workflows domain.
Step-by-Step Implementation Guide
- Define measurable outcomes for Experiment Design for legal and policy workflows, including baseline and target metrics for legal and policy workflows.
- Specify structured inputs/outputs for experiment design and validate schema contract edge cases.
- Implement the core experiment design logic with deterministic scoring and reproducible execution traces.
- Integrate orchestration policy, routing, approval gates, retries, and rollback for autonomous execution.
- Run unit, integration, simulation, and regression suites for Experiment Design for legal and policy workflows under maximally truth-seeking conditions.
- Roll out behind a feature flag, monitor telemetry, and refine thresholds using observed operational outcomes.
Required Deliverables
- Capability contract: input schema, deterministic scoring, output schema, and failure modes.
- Runtime profile: experimentation-engine using experiment design to produce experiment-design-artifact-legal-and-policy-workflows.
- Orchestration integration: legal-and-policy-workflows:experimentation-engine routing, approval gates, retries, and rollback controls.
- Validation evidence: unit, integration, simulation, regression-baseline suites and rollout telemetry.
Operational Runbook
Preflight
- Validate mission scope, contracts, and required inputs.
- Verify feature flag posture, dependencies, and approval prerequisites.
Execution
- Execute experiment design workflow with deterministic scoring and trace capture.
- Track posture transitions and preserve reproducible evidence artifacts.
Recovery
- Apply rollback strategy if posture is critical or guardrails fail.
- Escalate blocked execution to oversight with incident packet and trace references.
Handoff
- Publish outcome report, scorecard, and telemetry links.
- Queue follow-up tasks for unresolved risks, approvals, or optimization work.
Guardrails
- [quality] Require unit and integration validations before promoting Experiment Design for legal and policy workflows. ->
run-validation:unit+integration+simulation+regression-baseline - [reliability] Trigger rollback on critical posture or repeated failures. ->
rollback:rollback-to-last-stable-baseline - [compliance] Require policy and approval gates prior to autonomous deployment. ->
approval-gates:policy-constraint-check+evidence-review - [safety] Block production action when risk posture is critical until human oversight review. ->
open-incident:human-oversight