Production Readiness Assessment System
Enterprise-grade production readiness evaluation framework that exceeds the standards of top-tier technology companies (Google, Meta, Amazon, Microsoft). This skill conducts exhaustive multi-dimensional analysis of any GitHub repository to determine production deployment readiness.
Overview
Production readiness is not just about working code—it encompasses security posture, operational excellence, scalability architecture, observability infrastructure, compliance requirements, cost efficiency, and team preparedness. This skill evaluates all dimensions systematically.
Quick Start
# Clone and analyze a GitHub repository
python scripts/production_readiness.py https://github.com/owner/repo
# Generate comprehensive report
python scripts/production_readiness.py https://github.com/owner/repo --output report.md
# Specific dimension analysis
python scripts/production_readiness.py https://github.com/owner/repo --focus security,performance
Assessment Dimensions
This framework evaluates 15 critical dimensions:
| Dimension |
Weight |
Description |
| Security |
Critical |
Vulnerabilities, auth, encryption, secrets management |
| Architecture |
Critical |
Design patterns, scalability, modularity |
| Reliability |
Critical |
Error handling, fault tolerance, recovery |
| Performance |
High |
Latency, throughput, resource efficiency |
| Observability |
High |
Logging, metrics, tracing, alerting |
| Testing |
High |
Coverage, quality, automation |
| DevOps |
High |
CI/CD, IaC, deployment strategies |
| Data Management |
High |
Migrations, backups, consistency |
| API Contracts |
Medium |
Versioning, documentation, stability |
| Documentation |
Medium |
Code docs, runbooks, architecture diagrams |
| Compliance |
Variable |
Regulatory requirements (GDPR, SOC2, etc.) |
| Cost Optimization |
Medium |
Resource efficiency, scaling costs |
| Dependencies |
Medium |
Currency, vulnerabilities, licensing |
| Configuration |
Medium |
Secrets, environment management |
| Team Readiness |
Medium |
Knowledge transfer, on-call procedures |
Phase 1: Repository Acquisition & Discovery
Clone Repository
python scripts/clone_repo.py <github_url> --depth full
Initial Discovery
Execute comprehensive project discovery:
python scripts/discovery_analyzer.py <project_path>
Outputs:
- Technology stack identification (languages, frameworks, databases)
- Dependency graph with version analysis
- Architecture pattern detection
- Configuration file inventory
- Environment detection (dev, staging, prod)
- Codebase statistics (LOC, complexity metrics)
Phase 2: Security Assessment
Vulnerability Scanning
python scripts/security_scanner.py <project_path> --level exhaustive
Comprehensive security checks:
Critical Security Controls:
- Secrets detection (API keys, credentials, tokens, certificates)
- Authentication implementation (OAuth, JWT, session management)
- Authorization patterns (RBAC, ABAC, policy enforcement)
- Cryptography usage (algorithms, key management, TLS)
- Input validation and sanitization
- Output encoding and XSS prevention
- SQL injection and command injection patterns
- SSRF and path traversal vulnerabilities
Dependency Security:
- CVE scanning against NVD database
- License compliance verification
- Supply chain attack vectors
- Transitive dependency analysis
Infrastructure Security:
- Container security (base images, privileges)
- Network policies and segmentation
- Secret management infrastructure
- IAM configurations
See references/security-deep-dive.md for OWASP Top 10 detailed analysis.
Phase 3: Architecture Review
Pattern Analysis
python scripts/architecture_analyzer.py <project_path>
Evaluates:
- Separation of Concerns: Layer boundaries, domain isolation
- Coupling Analysis: Dependency injection, interface segregation
- Cohesion Metrics: Module responsibility, feature clustering
- Scalability Patterns: Horizontal scaling readiness, statelessness
- Resilience Patterns: Circuit breakers, bulkheads, retry logic
- Data Flow: Consistency boundaries, transaction management
- API Design: RESTful compliance, GraphQL schema quality
- Event Architecture: Pub/sub patterns, event sourcing
Technical Debt Assessment
python scripts/debt_analyzer.py <project_path>
Identifies:
- Code duplication and dead code
- Complexity hotspots (cyclomatic, cognitive)
- Anti-patterns and code smells
- Outdated patterns and deprecated APIs
- Missing abstractions
- Hardcoded values and magic numbers
Phase 4: Reliability & Fault Tolerance
Error Handling Analysis
python scripts/reliability_analyzer.py <project_path>
Checks:
- Exception handling completeness
- Error propagation patterns
- Graceful degradation implementation
- Timeout configurations
- Retry policies with backoff
- Dead letter queues and error recovery
- Health check endpoints
- Liveness and readiness probes
Chaos Engineering Readiness
Evaluates preparedness for:
- Network partition handling
- Dependency failure scenarios
- Resource exhaustion conditions
- Cascading failure prevention
Phase 5: Performance Analysis
Performance Profile
python scripts/performance_analyzer.py <project_path>
Analyzes:
- Algorithm Complexity: Big-O analysis of critical paths
- Database Queries: N+1 detection, index usage, query optimization
- Caching Strategy: Cache invalidation, TTL policies, hit ratios
- Connection Pooling: Database, HTTP, Redis connections
- Memory Management: Leak detection, garbage collection pressure
- Concurrency Patterns: Thread safety, async/await usage
- Resource Loading: Lazy loading, code splitting, bundling
Scalability Assessment
- Horizontal scaling readiness
- Stateless design verification
- Database sharding strategies
- Queue processing capacity
- Rate limiting implementation
Phase 6: Observability Infrastructure
Logging Analysis
python scripts/observability_analyzer.py <project_path>
Evaluates:
- Structured logging implementation
- Log level appropriateness
- Correlation ID propagation
- PII/sensitive data masking
- Log retention and rotation
- Centralized logging setup
Metrics & Monitoring
- Custom metrics implementation
- RED/USE method coverage
- SLI/SLO definitions
- Alerting thresholds
- Dashboard coverage
Distributed Tracing
- Trace propagation headers
- Span instrumentation
- Service mesh integration
- Trace sampling strategies
Phase 7: Testing Assessment
Coverage Analysis
python scripts/testing_analyzer.py <project_path>
Evaluates:
- Unit Tests: Coverage %, quality, isolation
- Integration Tests: API contracts, database interactions
- E2E Tests: Critical user journeys
- Performance Tests: Load testing, stress testing
- Security Tests: Penetration testing, fuzzing
- Chaos Tests: Failure injection scenarios
Test Quality Metrics
- Test isolation and independence
- Mock/stub appropriateness
- Assertion quality
- Flaky test detection
- Test execution time
Phase 8: DevOps & Deployment
CI/CD Pipeline Review
python scripts/devops_analyzer.py <project_path>
Checks:
- Pipeline configuration and stages
- Build reproducibility
- Artifact management
- Environment parity
- Deployment strategies (blue-green, canary, rolling)
- Rollback procedures
- Feature flags implementation
- Database migration safety
Infrastructure as Code
- Terraform/Pulumi/CloudFormation quality
- State management
- Secret injection
- Environment templating
- Drift detection
Phase 9: Data Management
Database Assessment
python scripts/data_analyzer.py <project_path>
Evaluates:
- Schema design and normalization
- Migration safety and reversibility
- Backup and recovery procedures
- Replication configuration
- Connection pool sizing
- Query performance
- Data retention policies
Data Consistency
- Transaction boundaries
- Eventual consistency handling
- Distributed transaction patterns
- Idempotency implementation
Phase 10: API & Integration Stability
API Contract Analysis
python scripts/api_analyzer.py <project_path>
Checks:
- OpenAPI/Swagger specification
- Versioning strategy
- Backward compatibility
- Rate limiting
- Request/response validation
- Error response standardization
- SDK/client library generation
External Dependencies
- Third-party service reliability
- Fallback implementations
- SLA requirements
- Integration testing coverage
Phase 11: Documentation Assessment
Documentation Completeness
python scripts/docs_analyzer.py <project_path>
Evaluates:
- README quality and completeness
- API documentation (generated/manual)
- Architecture decision records (ADRs)
- Runbooks and playbooks
- Incident response procedures
- On-call documentation
- Code comments and docstrings
- Deployment guides
Phase 12: Compliance Verification
Regulatory Assessment
python scripts/compliance_analyzer.py <project_path> --frameworks soc2,gdpr,hipaa,pci
Checks per framework. See references/compliance-frameworks.md for detailed requirements.
Phase 13: Cost Optimization
Resource Efficiency
python scripts/cost_analyzer.py <project_path>
Evaluates:
- Right-sizing recommendations
- Reserved capacity opportunities
- Spot/preemptible usage potential
- Storage tiering optimization
- Network egress patterns
- Cold start optimization (serverless)
- Auto-scaling configurations
Phase 14: Dependency Health
Dependency Analysis
python scripts/dependency_analyzer.py <project_path>
Checks:
- Version currency (latest vs. installed)
- Security vulnerabilities (CVE database)
- License compatibility
- Maintenance status (abandoned packages)
- Transitive dependency risks
- Bundle size impact
- SBOM generation
Phase 15: Team Readiness
Operational Readiness
python scripts/team_readiness_analyzer.py <project_path>
Evaluates:
- On-call rotation setup
- Incident management procedures
- Knowledge transfer documentation
- Bus factor analysis (code ownership)
- Development workflow documentation
- Onboarding documentation
Report Generation
Comprehensive Report
python scripts/generate_report.py <project_path> --format markdown
Report includes:
- Executive Summary: Overall readiness score, critical blockers
- Dimension Scores: 0-100 rating per dimension with justification
- Critical Issues: Immediate blockers requiring resolution
- High Priority Items: Must-fix before production
- Medium Priority Items: Should address within first month
- Low Priority Items: Technical debt backlog
- Recommendations: Specific, actionable remediation steps
- Effort Estimates: Engineering hours per issue category
- Risk Assessment: Impact/likelihood matrix
- Roadmap: Suggested sequence for addressing issues
Issue Templates
Each finding includes:
Issue: [Specific problem description]
Severity: [Critical/High/Medium/Low]
Dimension: [Security/Architecture/etc.]
Location: [File paths and line numbers]
Impact: [Business and technical impact]
Root Cause: [Why this issue exists]
Remediation: [Step-by-step fix instructions]
Validation: [How to verify the fix]
Effort: [Estimated engineering hours]
References: [Relevant standards and best practices]
Scoring Methodology
Overall Production Readiness Score
Score = Σ(Dimension Score × Weight) / Σ(Weights)
Readiness Levels:
- 90-100: Production Ready - Deploy with confidence
- 75-89: Nearly Ready - Minor issues to address
- 50-74: Significant Work Needed - Major gaps identified
- 25-49: Not Ready - Critical issues blocking deployment
- 0-24: Substantial Rebuild Required - Fundamental problems
Additional Resources
Consult these reference guides for detailed requirements:
references/security-deep-dive.md - OWASP Top 10 and security patterns
references/scalability-patterns.md - Horizontal scaling and resilience
references/observability-standards.md - Logging, metrics, tracing requirements
references/compliance-frameworks.md - SOC2, GDPR, HIPAA, PCI-DSS details
references/api-standards.md - RESTful API best practices
references/testing-standards.md - Coverage requirements and test quality
references/devops-maturity.md - CI/CD and deployment best practices
1---2name: production-readiness3description: Enterprise-grade production readiness assessment system for comprehensive codebase evaluation. Use when (1) Evaluating a GitHub repository for production deployment, (2) Conducting pre-launch security and architecture reviews, (3) Assessing technical debt and system reliability, (4) Identifying gaps, vulnerabilities, and incomplete features, (5) Generating actionable remediation plans for engineering teams, (6) Validating scalability, observability, and operational readiness, (7) Reviewing cost optimization and resource efficiency, (8) Auditing compliance with industry standards (SOC2, GDPR, HIPAA, PCI-DSS), (9) Evaluating API contracts and integration stability, (10) Assessing team knowledge transfer and documentation completeness. Performs CTO-level multi-dimensional analysis exceeding top-tier tech company standards.4---56# Production Readiness Assessment System78Enterprise-grade production readiness evaluation framework that exceeds the standards of top-tier technology companies (Google, Meta, Amazon, Microsoft). This skill conducts exhaustive multi-dimensional analysis of any GitHub repository to determine production deployment readiness.910## Overview1112Production readiness is not just about working code—it encompasses security posture, operational excellence, scalability architecture, observability infrastructure, compliance requirements, cost efficiency, and team preparedness. This skill evaluates all dimensions systematically.1314## Quick Start1516```bash17# Clone and analyze a GitHub repository18python scripts/production_readiness.py https://github.com/owner/repo1920# Generate comprehensive report21python scripts/production_readiness.py https://github.com/owner/repo --output report.md2223# Specific dimension analysis24python scripts/production_readiness.py https://github.com/owner/repo --focus security,performance25```2627## Assessment Dimensions2829This framework evaluates **15 critical dimensions**:3031| Dimension | Weight | Description |32|-----------|--------|-------------|33| Security | Critical | Vulnerabilities, auth, encryption, secrets management |34| Architecture | Critical | Design patterns, scalability, modularity |35| Reliability | Critical | Error handling, fault tolerance, recovery |36| Performance | High | Latency, throughput, resource efficiency |37| Observability | High | Logging, metrics, tracing, alerting |38| Testing | High | Coverage, quality, automation |39| DevOps | High | CI/CD, IaC, deployment strategies |40| Data Management | High | Migrations, backups, consistency |41| API Contracts | Medium | Versioning, documentation, stability |42| Documentation | Medium | Code docs, runbooks, architecture diagrams |43| Compliance | Variable | Regulatory requirements (GDPR, SOC2, etc.) |44| Cost Optimization | Medium | Resource efficiency, scaling costs |45| Dependencies | Medium | Currency, vulnerabilities, licensing |46| Configuration | Medium | Secrets, environment management |47| Team Readiness | Medium | Knowledge transfer, on-call procedures |4849## Phase 1: Repository Acquisition & Discovery5051### Clone Repository52```bash53python scripts/clone_repo.py <github_url> --depth full54```5556### Initial Discovery57Execute comprehensive project discovery:58```bash59python scripts/discovery_analyzer.py <project_path>60```6162Outputs:63- Technology stack identification (languages, frameworks, databases)64- Dependency graph with version analysis65- Architecture pattern detection66- Configuration file inventory67- Environment detection (dev, staging, prod)68- Codebase statistics (LOC, complexity metrics)6970## Phase 2: Security Assessment7172### Vulnerability Scanning73```bash74python scripts/security_scanner.py <project_path> --level exhaustive75```7677Comprehensive security checks:7879**Critical Security Controls:**80- Secrets detection (API keys, credentials, tokens, certificates)81- Authentication implementation (OAuth, JWT, session management)82- Authorization patterns (RBAC, ABAC, policy enforcement)83- Cryptography usage (algorithms, key management, TLS)84- Input validation and sanitization85- Output encoding and XSS prevention86- SQL injection and command injection patterns87- SSRF and path traversal vulnerabilities8889**Dependency Security:**90- CVE scanning against NVD database91- License compliance verification92- Supply chain attack vectors93- Transitive dependency analysis9495**Infrastructure Security:**96- Container security (base images, privileges)97- Network policies and segmentation98- Secret management infrastructure99- IAM configurations100101See `references/security-deep-dive.md` for OWASP Top 10 detailed analysis.102103## Phase 3: Architecture Review104105### Pattern Analysis106```bash107python scripts/architecture_analyzer.py <project_path>108```109110Evaluates:111- **Separation of Concerns**: Layer boundaries, domain isolation112- **Coupling Analysis**: Dependency injection, interface segregation113- **Cohesion Metrics**: Module responsibility, feature clustering114- **Scalability Patterns**: Horizontal scaling readiness, statelessness115- **Resilience Patterns**: Circuit breakers, bulkheads, retry logic116- **Data Flow**: Consistency boundaries, transaction management117- **API Design**: RESTful compliance, GraphQL schema quality118- **Event Architecture**: Pub/sub patterns, event sourcing119120### Technical Debt Assessment121```bash122python scripts/debt_analyzer.py <project_path>123```124125Identifies:126- Code duplication and dead code127- Complexity hotspots (cyclomatic, cognitive)128- Anti-patterns and code smells129- Outdated patterns and deprecated APIs130- Missing abstractions131- Hardcoded values and magic numbers132133## Phase 4: Reliability & Fault Tolerance134135### Error Handling Analysis136```bash137python scripts/reliability_analyzer.py <project_path>138```139140Checks:141- Exception handling completeness142- Error propagation patterns143- Graceful degradation implementation144- Timeout configurations145- Retry policies with backoff146- Dead letter queues and error recovery147- Health check endpoints148- Liveness and readiness probes149150### Chaos Engineering Readiness151Evaluates preparedness for:152- Network partition handling153- Dependency failure scenarios154- Resource exhaustion conditions155- Cascading failure prevention156157## Phase 5: Performance Analysis158159### Performance Profile160```bash161python scripts/performance_analyzer.py <project_path>162```163164Analyzes:165- **Algorithm Complexity**: Big-O analysis of critical paths166- **Database Queries**: N+1 detection, index usage, query optimization167- **Caching Strategy**: Cache invalidation, TTL policies, hit ratios168- **Connection Pooling**: Database, HTTP, Redis connections169- **Memory Management**: Leak detection, garbage collection pressure170- **Concurrency Patterns**: Thread safety, async/await usage171- **Resource Loading**: Lazy loading, code splitting, bundling172173### Scalability Assessment174- Horizontal scaling readiness175- Stateless design verification176- Database sharding strategies177- Queue processing capacity178- Rate limiting implementation179180## Phase 6: Observability Infrastructure181182### Logging Analysis183```bash184python scripts/observability_analyzer.py <project_path>185```186187Evaluates:188- Structured logging implementation189- Log level appropriateness190- Correlation ID propagation191- PII/sensitive data masking192- Log retention and rotation193- Centralized logging setup194195### Metrics & Monitoring196- Custom metrics implementation197- RED/USE method coverage198- SLI/SLO definitions199- Alerting thresholds200- Dashboard coverage201202### Distributed Tracing203- Trace propagation headers204- Span instrumentation205- Service mesh integration206- Trace sampling strategies207208## Phase 7: Testing Assessment209210### Coverage Analysis211```bash212python scripts/testing_analyzer.py <project_path>213```214215Evaluates:216- **Unit Tests**: Coverage %, quality, isolation217- **Integration Tests**: API contracts, database interactions218- **E2E Tests**: Critical user journeys219- **Performance Tests**: Load testing, stress testing220- **Security Tests**: Penetration testing, fuzzing221- **Chaos Tests**: Failure injection scenarios222223### Test Quality Metrics224- Test isolation and independence225- Mock/stub appropriateness226- Assertion quality227- Flaky test detection228- Test execution time229230## Phase 8: DevOps & Deployment231232### CI/CD Pipeline Review233```bash234python scripts/devops_analyzer.py <project_path>235```236237Checks:238- Pipeline configuration and stages239- Build reproducibility240- Artifact management241- Environment parity242- Deployment strategies (blue-green, canary, rolling)243- Rollback procedures244- Feature flags implementation245- Database migration safety246247### Infrastructure as Code248- Terraform/Pulumi/CloudFormation quality249- State management250- Secret injection251- Environment templating252- Drift detection253254## Phase 9: Data Management255256### Database Assessment257```bash258python scripts/data_analyzer.py <project_path>259```260261Evaluates:262- Schema design and normalization263- Migration safety and reversibility264- Backup and recovery procedures265- Replication configuration266- Connection pool sizing267- Query performance268- Data retention policies269270### Data Consistency271- Transaction boundaries272- Eventual consistency handling273- Distributed transaction patterns274- Idempotency implementation275276## Phase 10: API & Integration Stability277278### API Contract Analysis279```bash280python scripts/api_analyzer.py <project_path>281```282283Checks:284- OpenAPI/Swagger specification285- Versioning strategy286- Backward compatibility287- Rate limiting288- Request/response validation289- Error response standardization290- SDK/client library generation291292### External Dependencies293- Third-party service reliability294- Fallback implementations295- SLA requirements296- Integration testing coverage297298## Phase 11: Documentation Assessment299300### Documentation Completeness301```bash302python scripts/docs_analyzer.py <project_path>303```304305Evaluates:306- README quality and completeness307- API documentation (generated/manual)308- Architecture decision records (ADRs)309- Runbooks and playbooks310- Incident response procedures311- On-call documentation312- Code comments and docstrings313- Deployment guides314315## Phase 12: Compliance Verification316317### Regulatory Assessment318```bash319python scripts/compliance_analyzer.py <project_path> --frameworks soc2,gdpr,hipaa,pci320```321322Checks per framework. See `references/compliance-frameworks.md` for detailed requirements.323324## Phase 13: Cost Optimization325326### Resource Efficiency327```bash328python scripts/cost_analyzer.py <project_path>329```330331Evaluates:332- Right-sizing recommendations333- Reserved capacity opportunities334- Spot/preemptible usage potential335- Storage tiering optimization336- Network egress patterns337- Cold start optimization (serverless)338- Auto-scaling configurations339340## Phase 14: Dependency Health341342### Dependency Analysis343```bash344python scripts/dependency_analyzer.py <project_path>345```346347Checks:348- Version currency (latest vs. installed)349- Security vulnerabilities (CVE database)350- License compatibility351- Maintenance status (abandoned packages)352- Transitive dependency risks353- Bundle size impact354- SBOM generation355356## Phase 15: Team Readiness357358### Operational Readiness359```bash360python scripts/team_readiness_analyzer.py <project_path>361```362363Evaluates:364- On-call rotation setup365- Incident management procedures366- Knowledge transfer documentation367- Bus factor analysis (code ownership)368- Development workflow documentation369- Onboarding documentation370371## Report Generation372373### Comprehensive Report374```bash375python scripts/generate_report.py <project_path> --format markdown376```377378Report includes:3791. **Executive Summary**: Overall readiness score, critical blockers3802. **Dimension Scores**: 0-100 rating per dimension with justification3813. **Critical Issues**: Immediate blockers requiring resolution3824. **High Priority Items**: Must-fix before production3835. **Medium Priority Items**: Should address within first month3846. **Low Priority Items**: Technical debt backlog3857. **Recommendations**: Specific, actionable remediation steps3868. **Effort Estimates**: Engineering hours per issue category3879. **Risk Assessment**: Impact/likelihood matrix38810. **Roadmap**: Suggested sequence for addressing issues389390### Issue Templates391Each finding includes:392```393Issue: [Specific problem description]394Severity: [Critical/High/Medium/Low]395Dimension: [Security/Architecture/etc.]396Location: [File paths and line numbers]397Impact: [Business and technical impact]398Root Cause: [Why this issue exists]399Remediation: [Step-by-step fix instructions]400Validation: [How to verify the fix]401Effort: [Estimated engineering hours]402References: [Relevant standards and best practices]403```404405## Scoring Methodology406407### Overall Production Readiness Score408409```410Score = Σ(Dimension Score × Weight) / Σ(Weights)411```412413**Readiness Levels:**414- **90-100**: Production Ready - Deploy with confidence415- **75-89**: Nearly Ready - Minor issues to address416- **50-74**: Significant Work Needed - Major gaps identified417- **25-49**: Not Ready - Critical issues blocking deployment418- **0-24**: Substantial Rebuild Required - Fundamental problems419420## Additional Resources421422Consult these reference guides for detailed requirements:423- `references/security-deep-dive.md` - OWASP Top 10 and security patterns424- `references/scalability-patterns.md` - Horizontal scaling and resilience425- `references/observability-standards.md` - Logging, metrics, tracing requirements426- `references/compliance-frameworks.md` - SOC2, GDPR, HIPAA, PCI-DSS details427- `references/api-standards.md` - RESTful API best practices428- `references/testing-standards.md` - Coverage requirements and test quality429- `references/devops-maturity.md` - CI/CD and deployment best practices