Smoke Test Launcher
A smoke test asks one question: does anyone want this enough to act? It measures
demand for an offer that does not exist yet — cheaply, honestly, and with the verdict
written before launch so nobody can move the goalposts after.
The Rule
The threshold and the sample size are signed before the page goes live. A test
"designed" after results arrive is a press release for a decision already made.
Modes
Draft mode (default — user has an idea to test)
- Read
references/smoke-test-types.md before choosing a format.
- Extract the hypothesis: who wants what, badly enough to do what. If the user cannot
state the action that counts as demand (signup, preorder, waitlist join, booking),
ask once — the action IS the test.
- Choose the format: fake-door page, preorder, waitlist, or paid-ad probe — matched
to whether the risk is interest, willingness to pay, or message.
- Write the page: headline (the promise in their words), one paragraph of mechanism
(why it can deliver), the CTA (the demand action), and nothing else. Every extra
element dilutes the signal.
- Copy
templates/smoke-test-plan.md and fill every bracket, including the source of
traffic and its expected quality.
Threshold mode (user has a page but no signed verdict criteria)
- Set the pass threshold from the traffic source's baseline, not from optimism: [X]%
conversion from [N] qualified visitors, with N sufficient for the number to mean
anything.
- Set the kill threshold and the gray zone. The gray zone triggers one pre-planned
follow-up (a different headline or a different traffic source) — named now.
- Set the honesty rules: what the page tells visitors about what exists today (see
the reference's disclosure standards). Payment for undelivered products has the
strictest rules.
Debrief mode (user pastes results)
- Check sample size and traffic quality first: a 20% conversion on 12 visitors is a
rounding error, not a signal. State the confidence plainly.
- Report against the signed threshold: PASS, FAIL, or GRAY. No new thresholds are
accepted in Debrief mode.
- Classify what was actually learned: demand for the problem, the message, or the
audience — a smoke test result is about the offer as worded, not the product as
imagined.
- A PASS routes to mvp-type-selector for the value test. A FAIL routes to a different
smoke test or kills the direction. A GRAY runs the pre-planned follow-up once.
Hard Rules
- Thresholds and sample size are signed before launch and never renegotiated.
- The demand action must cost the visitor something — an email, money, or a booking.
A click is not demand.
- Paid traffic needs quality control: bots and incentivized clicks convert differently
and must be filtered or the threshold is fiction.
- Payment-based smoke tests disclose delivery terms before charging, full stop.
- One variable per test: offer, audience, or message — never all three at once.
Output Shape (Debrief mode)
Result: [PASS / FAIL / GRAY] against signed threshold [value]
Sample: [N] qualified visitors from [source], [quality caveat]
Learned: [demand / message / audience — which one moved]
Next: [mvp-type-selector value test / follow-up test / kill]
Keep output in the user's language. Never call a gray result a win.
1---2name: smoke-test-launcher3description: Design and launch demand smoke tests — fake-door pages, preorders, waitlists, and paid-ad probes — with the pass/fail threshold and minimum sample size signed before launch, then debrief results honestly. Use before building anything to test demand, when a landing page or waitlist experiment is planned, or when the user says smoke test, fake door, test demand before building, should we build it, or validate interest. Not for testing product value or usability (a smoke test measures demand, not the product) or for running full A/B experiments.4---56# Smoke Test Launcher78A smoke test asks one question: does anyone want this enough to act? It measures9demand for an offer that does not exist yet — cheaply, honestly, and with the verdict10written before launch so nobody can move the goalposts after.1112## The Rule1314The threshold and the sample size are signed before the page goes live. A test15"designed" after results arrive is a press release for a decision already made.1617## Modes1819### Draft mode (default — user has an idea to test)20211. Read `references/smoke-test-types.md` before choosing a format.222. Extract the hypothesis: who wants what, badly enough to do what. If the user cannot23 state the action that counts as demand (signup, preorder, waitlist join, booking),24 ask once — the action IS the test.253. Choose the format: fake-door page, preorder, waitlist, or paid-ad probe — matched26 to whether the risk is interest, willingness to pay, or message.274. Write the page: headline (the promise in their words), one paragraph of mechanism28 (why it can deliver), the CTA (the demand action), and nothing else. Every extra29 element dilutes the signal.305. Copy `templates/smoke-test-plan.md` and fill every bracket, including the source of31 traffic and its expected quality.3233### Threshold mode (user has a page but no signed verdict criteria)34351. Set the pass threshold from the traffic source's baseline, not from optimism: [X]%36 conversion from [N] qualified visitors, with N sufficient for the number to mean37 anything.382. Set the kill threshold and the gray zone. The gray zone triggers one pre-planned39 follow-up (a different headline or a different traffic source) — named now.403. Set the honesty rules: what the page tells visitors about what exists today (see41 the reference's disclosure standards). Payment for undelivered products has the42 strictest rules.4344### Debrief mode (user pastes results)45461. Check sample size and traffic quality first: a 20% conversion on 12 visitors is a47 rounding error, not a signal. State the confidence plainly.482. Report against the signed threshold: PASS, FAIL, or GRAY. No new thresholds are49 accepted in Debrief mode.503. Classify what was actually learned: demand for the problem, the message, or the51 audience — a smoke test result is about the offer as worded, not the product as52 imagined.534. A PASS routes to mvp-type-selector for the value test. A FAIL routes to a different54 smoke test or kills the direction. A GRAY runs the pre-planned follow-up once.5556## Hard Rules5758- Thresholds and sample size are signed before launch and never renegotiated.59- The demand action must cost the visitor something — an email, money, or a booking.60 A click is not demand.61- Paid traffic needs quality control: bots and incentivized clicks convert differently62 and must be filtered or the threshold is fiction.63- Payment-based smoke tests disclose delivery terms before charging, full stop.64- One variable per test: offer, audience, or message — never all three at once.6566## Output Shape (Debrief mode)6768```69Result: [PASS / FAIL / GRAY] against signed threshold [value]70Sample: [N] qualified visitors from [source], [quality caveat]71Learned: [demand / message / audience — which one moved]72Next: [mvp-type-selector value test / follow-up test / kill]73```7475Keep output in the user's language. Never call a gray result a win.