Production Audit
Use this skill when the user asks whether an application is ready to ship, what
could break in production, or what must be fixed before a launch. This is a
maintainer-safe rewrite of the stale community production-audit idea: it keeps
the useful production-readiness lens and removes unpinned external execution and
third-party data sharing.
When to Use
- The user asks "is this production-ready", "what would break in prod", "what
did we miss", "audit this repo", or "ready to ship?"
- A feature was merged and needs a pre-deploy or post-merge risk pass.
- A public launch, demo, customer rollout, or investor walkthrough is close.
- CI is green but the user wants production risk, not only test status.
- A deployed URL, release branch, PR, or current checkout is available for
evidence gathering.
When Not to Use
- During active implementation when the right lens is line-level secure coding;
use
security-review first.
- For pure libraries, templates, docs-only repos, or scaffolds unless the user
wants packaging/release readiness rather than application readiness.
- When the user asks for a formal compliance audit. This skill is engineering
triage, not legal, financial, medical, or regulatory certification.
- When the only available evidence is a product idea with no repo, deployment,
CI, or runtime surface.
How It Works
Build the audit from local and user-authorized evidence. Do not run unpinned
remote code, upload repository contents to third-party services, or call
external scanners unless the user explicitly approves that specific tool and
data flow.
Use this order:
- Establish the release surface.
- Read recent changes and current branch state.
- Inspect runtime, auth, data, payment, background-job, AI, and deployment
boundaries that actually exist in the repo.
- Check CI, tests, migrations, environment documentation, and rollback path.
- Produce a short ship/block recommendation with specific fixes.
Evidence Checklist
Start with cheap, local signals:
git status --short --branch
git log --oneline --decorate -20
git diff --stat origin/main...HEAD
Then inspect the project-specific surface:
- Package scripts, CI workflows, release scripts, Docker files, and deployment
manifests.
- API routes, webhooks, auth middleware, background workers, cron jobs, and
database migrations.
- Environment variable documentation and startup checks.
- Observability hooks, error reporting, logs, health checks, and dashboards.
- Rollback, seed, migration, and backfill instructions.
- E2E coverage for the user paths that matter most.
If a deployed URL is in scope, use browser or HTTP checks only against that URL
and avoid credentialed actions unless the user supplies a safe test account.
Risk Lenses
Security And Auth
- Are public routes, API routes, and admin routes clearly separated?
- Are auth and authorization enforced server-side?
- Are secrets kept out of client bundles, logs, example output, and checked-in
files?
- Are rate limits, CSRF protections, CORS policy, and upload validation present
where the app needs them?
- Does the AI or agent surface defend against prompt injection, tool abuse, and
untrusted content crossing into privileged actions?
Data Integrity
- Do migrations run forward cleanly and have a rollback or recovery plan?
- Are destructive migrations, backfills, and data imports staged safely?
- Do database policies, grants, and service-role boundaries match the app's
tenancy model?
- Are retries idempotent for writes, jobs, and webhook handlers?
Payments And Webhooks
- Are webhook signatures verified before parsing trusted payload fields?
- Is each payment, subscription, or fulfillment webhook idempotent?
- Are replay, duplicate delivery, and out-of-order delivery handled?
- Are test-mode and live-mode credentials separated?
Operations
- Can the app start from a clean checkout using documented commands?
- Are required environment variables named, validated, and fail-fast?
- Is there a health check that proves dependencies are reachable?
- Are deploy, rollback, and incident-owner paths documented?
- Are logs useful without leaking secrets or personal data?
User Experience
- Are the launch-critical paths covered on desktop and mobile?
- Are forms usable on mobile without input zoom, layout overlap, or blocked
submission states?
- Do loading, empty, error, and permission-denied states tell the user what
happened?
- Is there a support or recovery path when a critical operation fails?
Scoring
Use scores to force prioritization, not to imply mathematical certainty.
| Band |
Score |
Meaning |
| Blocked |
0-49 |
Do not ship until the top risks are fixed |
| Risky |
50-69 |
Ship only behind a small rollout or internal beta |
| Launchable With Caveats |
70-84 |
Ship if owners accept the listed risks |
| Strong |
85-100 |
No obvious launch blockers from available evidence |
Cap the score at 69 if any of these are true:
- Authentication or authorization is missing on sensitive data.
- Payment or fulfillment webhooks are not idempotent.
- Required migrations cannot be run safely.
- Secrets are exposed in client bundles, logs, or committed files.
- There is no rollback path for a high-impact release.
Cap the score at 84 if CI is not green or the launch-critical path was not
tested end to end.
Output Format
Lead with one sentence:
Production audit: 76/100, launchable with caveats, with webhook idempotency and rollback docs as the two risks to fix before public launch.
Then list:
Blockers: must-fix items before deploy.
High-value fixes: next fixes if the user wants to improve the score.
Evidence checked: files, commands, CI, deployed URL, or PRs inspected.
Evidence missing: what would change confidence if provided.
Next action: one concrete fix or verification step.
Keep strengths short. The user asked for readiness, so the useful answer is the
remaining risk and the next action.
Example
User:
is this ready to ship?
Response:
Production audit: 68/100, risky, because Stripe webhooks are verified but not idempotent and there is no rollback note for the pending migration.
Blockers:
- Add idempotency for `checkout.session.completed` before fulfilling orders.
- Write and test the rollback path for `20260511_add_billing_state.sql`.
High-value fixes:
- Add a health check that verifies database and payment-provider reachability.
- Add one E2E path for upgrade, webhook fulfillment, and billing-page refresh.
Evidence checked:
- `api/stripe/webhook.ts`
- `db/migrations/20260511_add_billing_state.sql`
- GitHub Actions run for the release branch
Next action: Want me to patch webhook idempotency first?
Anti-Patterns
- Running
npx <package>@latest or a remote scanner as the default audit path.
- Uploading source, secrets, customer data, or private topology to an external
audit service without explicit approval.
- Producing a score without naming the evidence checked.
- Treating green CI as production readiness.
- Ending with a generic "let me know what you want to do."
See Also
- Skill:
security-review
- Skill:
deployment-patterns
- Skill:
e2e-testing
- Skill:
tdd-workflow
- Skill:
verification-loop
1---2name: production-audit-23description: "Audit a shipped repo for production-readiness gaps across RLS, webhooks, secrets, grants, Stripe idempotency, mobile UX, and deployment health."4category: security5risk: critical6source: community7source_repo: commitshow/production-audit8source_type: community9date_added: "2026-05-04"10author: commitshow11tags: [security, audit, production, vibe-coding, rls, webhook, stripe, supabase, mobile]12tools: [claude, cursor, gemini, codex, antigravity]13license: "MIT"14license_source: "https://github.com/commitshow/production-audit/blob/main/LICENSE"15metadata:16 source: https://skillmd.com/skills/mhassan0000/production-audit-217---1819# Production Audit2021Use this skill when the user asks whether an application is ready to ship, what22could break in production, or what must be fixed before a launch. This is a23maintainer-safe rewrite of the stale community production-audit idea: it keeps24the useful production-readiness lens and removes unpinned external execution and25third-party data sharing.2627## When to Use2829- The user asks "is this production-ready", "what would break in prod", "what30 did we miss", "audit this repo", or "ready to ship?"31- A feature was merged and needs a pre-deploy or post-merge risk pass.32- A public launch, demo, customer rollout, or investor walkthrough is close.33- CI is green but the user wants production risk, not only test status.34- A deployed URL, release branch, PR, or current checkout is available for35 evidence gathering.3637## When Not to Use3839- During active implementation when the right lens is line-level secure coding;40 use `security-review` first.41- For pure libraries, templates, docs-only repos, or scaffolds unless the user42 wants packaging/release readiness rather than application readiness.43- When the user asks for a formal compliance audit. This skill is engineering44 triage, not legal, financial, medical, or regulatory certification.45- When the only available evidence is a product idea with no repo, deployment,46 CI, or runtime surface.4748## How It Works4950Build the audit from local and user-authorized evidence. Do not run unpinned51remote code, upload repository contents to third-party services, or call52external scanners unless the user explicitly approves that specific tool and53data flow.5455Use this order:56571. Establish the release surface.582. Read recent changes and current branch state.593. Inspect runtime, auth, data, payment, background-job, AI, and deployment60 boundaries that actually exist in the repo.614. Check CI, tests, migrations, environment documentation, and rollback path.625. Produce a short ship/block recommendation with specific fixes.6364## Evidence Checklist6566Start with cheap, local signals:6768```text69git status --short --branch70git log --oneline --decorate -2071git diff --stat origin/main...HEAD72```7374Then inspect the project-specific surface:7576- Package scripts, CI workflows, release scripts, Docker files, and deployment77 manifests.78- API routes, webhooks, auth middleware, background workers, cron jobs, and79 database migrations.80- Environment variable documentation and startup checks.81- Observability hooks, error reporting, logs, health checks, and dashboards.82- Rollback, seed, migration, and backfill instructions.83- E2E coverage for the user paths that matter most.8485If a deployed URL is in scope, use browser or HTTP checks only against that URL86and avoid credentialed actions unless the user supplies a safe test account.8788## Risk Lenses8990### Security And Auth9192- Are public routes, API routes, and admin routes clearly separated?93- Are auth and authorization enforced server-side?94- Are secrets kept out of client bundles, logs, example output, and checked-in95 files?96- Are rate limits, CSRF protections, CORS policy, and upload validation present97 where the app needs them?98- Does the AI or agent surface defend against prompt injection, tool abuse, and99 untrusted content crossing into privileged actions?100101### Data Integrity102103- Do migrations run forward cleanly and have a rollback or recovery plan?104- Are destructive migrations, backfills, and data imports staged safely?105- Do database policies, grants, and service-role boundaries match the app's106 tenancy model?107- Are retries idempotent for writes, jobs, and webhook handlers?108109### Payments And Webhooks110111- Are webhook signatures verified before parsing trusted payload fields?112- Is each payment, subscription, or fulfillment webhook idempotent?113- Are replay, duplicate delivery, and out-of-order delivery handled?114- Are test-mode and live-mode credentials separated?115116### Operations117118- Can the app start from a clean checkout using documented commands?119- Are required environment variables named, validated, and fail-fast?120- Is there a health check that proves dependencies are reachable?121- Are deploy, rollback, and incident-owner paths documented?122- Are logs useful without leaking secrets or personal data?123124### User Experience125126- Are the launch-critical paths covered on desktop and mobile?127- Are forms usable on mobile without input zoom, layout overlap, or blocked128 submission states?129- Do loading, empty, error, and permission-denied states tell the user what130 happened?131- Is there a support or recovery path when a critical operation fails?132133## Scoring134135Use scores to force prioritization, not to imply mathematical certainty.136137| Band | Score | Meaning |138| --- | --- | --- |139| Blocked | 0-49 | Do not ship until the top risks are fixed |140| Risky | 50-69 | Ship only behind a small rollout or internal beta |141| Launchable With Caveats | 70-84 | Ship if owners accept the listed risks |142| Strong | 85-100 | No obvious launch blockers from available evidence |143144Cap the score at `69` if any of these are true:145146- Authentication or authorization is missing on sensitive data.147- Payment or fulfillment webhooks are not idempotent.148- Required migrations cannot be run safely.149- Secrets are exposed in client bundles, logs, or committed files.150- There is no rollback path for a high-impact release.151152Cap the score at `84` if CI is not green or the launch-critical path was not153tested end to end.154155## Output Format156157Lead with one sentence:158159```text160Production audit: 76/100, launchable with caveats, with webhook idempotency and rollback docs as the two risks to fix before public launch.161```162163Then list:164165- `Blockers`: must-fix items before deploy.166- `High-value fixes`: next fixes if the user wants to improve the score.167- `Evidence checked`: files, commands, CI, deployed URL, or PRs inspected.168- `Evidence missing`: what would change confidence if provided.169- `Next action`: one concrete fix or verification step.170171Keep strengths short. The user asked for readiness, so the useful answer is the172remaining risk and the next action.173174## Example175176User:177178```text179is this ready to ship?180```181182Response:183184```text185Production audit: 68/100, risky, because Stripe webhooks are verified but not idempotent and there is no rollback note for the pending migration.186187Blockers:188- Add idempotency for `checkout.session.completed` before fulfilling orders.189- Write and test the rollback path for `20260511_add_billing_state.sql`.190191High-value fixes:192- Add a health check that verifies database and payment-provider reachability.193- Add one E2E path for upgrade, webhook fulfillment, and billing-page refresh.194195Evidence checked:196- `api/stripe/webhook.ts`197- `db/migrations/20260511_add_billing_state.sql`198- GitHub Actions run for the release branch199200Next action: Want me to patch webhook idempotency first?201```202203## Anti-Patterns204205- Running `npx <package>@latest` or a remote scanner as the default audit path.206- Uploading source, secrets, customer data, or private topology to an external207 audit service without explicit approval.208- Producing a score without naming the evidence checked.209- Treating green CI as production readiness.210- Ending with a generic "let me know what you want to do."211212## See Also213214- Skill: `security-review`215- Skill: `deployment-patterns`216- Skill: `e2e-testing`217- Skill: `tdd-workflow`218- Skill: `verification-loop`