Read PStack runtime guidance before this workflow.
Verify This
Verification is not a recap. It proves or disproves a specific claim with repeatable evidence.
When To Use
- The user asks "verify this", "prove it works", "did this fix it", or "show me the evidence".
- A bug fix needs a before/after repro.
- A UI, CLI, API, performance, or memory claim needs measurement.
- A test passes but the user-visible behavior still needs confirmation.
Do not use this for vague claims like "the code is cleaner". Ask for a measurable claim first.
Workflow
- Restate the claim in falsifiable form: condition, metric, and threshold.
- Pick the smallest local surface that can disprove it.
- Capture a baseline from the old state: merge base, parent commit, failing branch, or current broken repro.
- Capture treatment from the changed state with the same command, data, warmup, and environment.
- Compare raw artifacts: numbers, screenshots, terminal transcripts, HTTP responses, profiles, heap snapshots, or test output.
- Return exactly one verdict:
VERIFIED, NOT VERIFIED, or INCONCLUSIVE.
Local Surfaces
- Code behavior: focused unit/integration tests or a minimal repro script.
- CLI/TUI behavior:
control-cli, terminal transcript, or demo recording.
- UI behavior:
browser-use, screenshots, accessibility snapshots, or browser traces.
- API behavior: local HTTP/RPC request and response diff.
- Performance: same-machine baseline/treatment timings or CPU profiles.
- Memory: heap snapshots before and after the suspected operation.
Artifact Layout
When safe to write artifacts:
.ai/verify-this/<claim-slug>/
├── claim.md
├── timeline.md
├── baseline/
├── treatment/
├── diff/
└── verdict.md
If artifacts may contain sensitive code, prompts, screenshots, HTTP bodies, or heap data, keep only the minimal inline evidence unless the user agrees to disk storage.
Verdict Rules
VERIFIED: baseline and treatment differ in the predicted direction, by the claimed threshold, with no obvious confound.NOT VERIFIED: the behavior is unchanged, moves the wrong way, or misses the threshold.INCONCLUSIVE: no valid baseline, noisy signal, failed measurement, or an environment difference invalidates the comparison.
Output
Use this shape:
VERIFIED | NOT VERIFIED | INCONCLUSIVE
Claim: <falsifiable claim>
Evidence:
<metric/artifact>: baseline=<...>, treatment=<...>, delta=<...>, threshold=<...>
Reasoning:
<one tight paragraph naming the evidence and any confounds>
Do not soften a negative result. A clear NOT VERIFIED is useful.
1---2name: verify-this3description: Verify a claim with fresh local evidence: restate it falsifiably, capture baseline and treatment, compare artifacts, and return VERIFIED, NOT VERIFIED, or INCONCLUSIVE.4---56Read [PStack runtime guidance](../../RUNTIME.md) before this workflow.789# Verify This1011Verification is not a recap. It proves or disproves a specific claim with repeatable evidence.1213## When To Use1415- The user asks "verify this", "prove it works", "did this fix it", or "show me the evidence".16- A bug fix needs a before/after repro.17- A UI, CLI, API, performance, or memory claim needs measurement.18- A test passes but the user-visible behavior still needs confirmation.1920Do not use this for vague claims like "the code is cleaner". Ask for a measurable claim first.2122## Workflow23241. Restate the claim in falsifiable form: condition, metric, and threshold.252. Pick the smallest local surface that can disprove it.263. Capture a baseline from the old state: merge base, parent commit, failing branch, or current broken repro.274. Capture treatment from the changed state with the same command, data, warmup, and environment.285. Compare raw artifacts: numbers, screenshots, terminal transcripts, HTTP responses, profiles, heap snapshots, or test output.296. Return exactly one verdict: `VERIFIED`, `NOT VERIFIED`, or `INCONCLUSIVE`.3031## Local Surfaces3233- Code behavior: focused unit/integration tests or a minimal repro script.34- CLI/TUI behavior: `control-cli`, terminal transcript, or demo recording.35- UI behavior: `browser-use`, screenshots, accessibility snapshots, or browser traces.36- API behavior: local HTTP/RPC request and response diff.37- Performance: same-machine baseline/treatment timings or CPU profiles.38- Memory: heap snapshots before and after the suspected operation.3940## Artifact Layout4142When safe to write artifacts:4344```text45.ai/verify-this/<claim-slug>/46├── claim.md47├── timeline.md48├── baseline/49├── treatment/50├── diff/51└── verdict.md52```5354If artifacts may contain sensitive code, prompts, screenshots, HTTP bodies, or heap data, keep only the minimal inline evidence unless the user agrees to disk storage.5556## Verdict Rules5758- `VERIFIED`: baseline and treatment differ in the predicted direction, by the claimed threshold, with no obvious confound.59- `NOT VERIFIED`: the behavior is unchanged, moves the wrong way, or misses the threshold.60- `INCONCLUSIVE`: no valid baseline, noisy signal, failed measurement, or an environment difference invalidates the comparison.6162## Output6364Use this shape:6566```text67VERIFIED | NOT VERIFIED | INCONCLUSIVE68Claim: <falsifiable claim>6970Evidence:71<metric/artifact>: baseline=<...>, treatment=<...>, delta=<...>, threshold=<...>7273Reasoning:74<one tight paragraph naming the evidence and any confounds>75```7677Do not soften a negative result. A clear `NOT VERIFIED` is useful.
SiTaggart