HackerAI Retention Analysis
Determine whether comparable subscribers leave more often after a change, what
the data can establish now, and what evidence or follow-up is still missing.
Workflow
- Establish the question, intended environment, population, comparison, and
time window. Verify the analytics project's timezone and instrumentation
coverage. Inspect repository instrumentation first; use the connected
analytics and billing tools for current evidence within the authorized scope.
- For cohort design, outcome definitions, billing reconciliation, and readout
wording, consult the relevant sections of the
measurement guide. Prefer valid historical
randomized assignment. Otherwise use pre-exposure comparability and label
the result observational. Preserve original assignment and report actual
exposure, crossover, and missing outcomes separately.
- Produce an immediate experience readout where available, then distinguish
mature cancellation decisions, renewal retention, and invoice-linked payment
recovery. Use equal follow-up, appropriate user/subscription/invoice units,
and uncertainty that accounts for repeated runs per user. Keep subscribers
who cancel before their baseline renewal date in the renewal comparison.
- Lead with early warning, mature increase/decrease, inconclusive, or not
measurable. Include both groups' numerators and denominators, absolute
differences, uncertainty, limitations, next valid readout, and a concrete
recommendation. Payment-failed endings do not rule out dissatisfaction.
- Save reproducible bounded queries and aggregate results in a dated task
artifact. Keep volatile results out of this skill. Update external tracking
or schedule follow-ups only when authorized by the user's task.
Boundaries
This is an analysis workflow, not authorization to change routing, prices,
allowances, feature flags, customer billing, or source configuration. Missing
tables or credentials are evidence gaps, not permission to repair a deployment.
Follow the repository's environment and credential boundaries.
Keep customer content out of analytics queries and reports. If the user requests
content-based qualitative research, use the separate
HackerAI user research workflow and its
authorized gateway. Do not silently expand aggregate retention analysis into
conversation inspection.
1---2name: hackerai-retention-analysis3description: Analyze HackerAI subscriber churn, renewal, and payment recovery, or design a comparison of how a product or model change affects paid retention. Distinguish early experience warnings from mature billing outcomes using aggregate evidence. Not for changing billing or routing, or reading customer conversations.4---56# HackerAI Retention Analysis78Determine whether comparable subscribers leave more often after a change, what9the data can establish now, and what evidence or follow-up is still missing.1011## Workflow12131. Establish the question, intended environment, population, comparison, and14 time window. Verify the analytics project's timezone and instrumentation15 coverage. Inspect repository instrumentation first; use the connected16 analytics and billing tools for current evidence within the authorized scope.172. For cohort design, outcome definitions, billing reconciliation, and readout18 wording, consult the relevant sections of the19 [measurement guide](references/measurement-guide.md). Prefer valid historical20 randomized assignment. Otherwise use pre-exposure comparability and label21 the result observational. Preserve original assignment and report actual22 exposure, crossover, and missing outcomes separately.233. Produce an immediate experience readout where available, then distinguish24 mature cancellation decisions, renewal retention, and invoice-linked payment25 recovery. Use equal follow-up, appropriate user/subscription/invoice units,26 and uncertainty that accounts for repeated runs per user. Keep subscribers27 who cancel before their baseline renewal date in the renewal comparison.284. Lead with early warning, mature increase/decrease, inconclusive, or not29 measurable. Include both groups' numerators and denominators, absolute30 differences, uncertainty, limitations, next valid readout, and a concrete31 recommendation. Payment-failed endings do not rule out dissatisfaction.325. Save reproducible bounded queries and aggregate results in a dated task33 artifact. Keep volatile results out of this skill. Update external tracking34 or schedule follow-ups only when authorized by the user's task.3536## Boundaries3738This is an analysis workflow, not authorization to change routing, prices,39allowances, feature flags, customer billing, or source configuration. Missing40tables or credentials are evidence gaps, not permission to repair a deployment.41Follow the repository's environment and credential boundaries.4243Keep customer content out of analytics queries and reports. If the user requests44content-based qualitative research, use the separate45[HackerAI user research workflow](../hackerai-user-research/SKILL.md) and its46authorized gateway. Do not silently expand aggregate retention analysis into47conversation inspection.