# Quality Management System Design & Assessment

> USE THIS SKILL when the user asks about quality management, QMS, ISO 9001, quality metrics, defect rates, first-pass yield, cost of quality, cost of poor quality (COPQ), statistical process control (SPC), root cause analysis, 5 Why, fishbone diagram, Ishikawa, quality improvement, quality audit, quality maturity, quality culture, prevention vs. appraisal costs, or any assessment of a company's quality systems and performance. Also trigger for "scrap rate," "rework," "warranty costs," "customer complaints," "nonconformance," "CAPA," or "quality roadmap."

- Skill: `kaakati/quality-management-system-design-assessment` (Agent Skill)
- Install (CLI): `npx skillmds@latest add kaakati/quality-management-system-design-assessment`
- Raw SKILL.md: https://api.skillmd.com/api/skills/kaakati/quality-management-system-design-assessment/raw
- Safety review: pending
- Works with: Claude Code, Claude.ai, OpenAI Codex
- Category: Product & Planning
- Author: Kaakati (https://skillmd.com/u/kaakati)
- Updated: 2026-09-17
- Page: https://skillmd.com/skills/kaakati/quality-management-system-design-assessment

---


# Quality Management System Design & Assessment

## Required Inputs

| Input | Description | Required? |
|-------|-------------|-----------|
| Quality performance data | Defect rates, scrap/rework, warranty claims, customer complaints | Yes |
| Product / service scope | What is being produced or delivered | Yes |
| Current QMS documentation | Quality policy, procedures, certifications (ISO, AS9100, IATF) | Yes |
| Financial data | Revenue, COGS, warranty expense, scrap/rework costs | Yes |
| Customer requirements | Specifications, SLAs, regulatory requirements | Recommended |
| Process data | Control charts, capability studies, inspection records | Recommended |
| Organizational context | Industry, company size, customer base, competitive position | Recommended |
| Audit history | Internal audit results, certification audit findings, customer audits | Recommended |

## Execution Steps

### Step 1: Quality Maturity Assessment

Score across 8 dimensions on a 1-5 scale:

| Dimension | 1 - Inspection | 2 - Detection | 3 - Prevention | 4 - Integration | 5 - Excellence |
|-----------|---------------|---------------|----------------|-----------------|---------------|
| **Quality Strategy** | No quality policy; compliance-driven | Quality policy exists; not linked to strategy | Quality objectives aligned to business goals | Quality integrated into strategic planning | Quality is competitive differentiator |
| **Process Control** | End-of-line inspection only | In-process checks; basic SOPs | SPC deployed; process capability measured | Mistake-proofing (poka-yoke); process optimization | Predictive quality; real-time adaptive control |
| **Measurement & Data** | No systematic data collection | Basic defect tracking; manual records | Quality dashboards; trend analysis | Advanced analytics; correlation analysis | Predictive modeling; AI-driven insights |
| **Root Cause Analysis** | Blame culture; no formal RCA | Reactive RCA on major issues | Structured RCA (5 Why, fishbone) for all NCRs | Systemic RCA; pattern identification | Proactive risk elimination before failures occur |
| **Supplier Quality** | No incoming inspection | Incoming inspection; accept/reject | Supplier audits; quality agreements | Supplier development programs | Integrated quality across supply chain |
| **Customer Focus** | Reactive complaint handling | Complaint tracking; response SLAs | VOC programs; satisfaction measurement | Customer co-creation; quality partnerships | Anticipate customer needs; exceed consistently |
| **People & Culture** | Quality is "the QA department's job" | Awareness training; basic skills | Quality training for all; competency matrices | Quality ownership at every level; empowerment | Zero-defect mindset; quality as core value |
| **Documentation & Systems** | Tribal knowledge; no QMS | Basic QMS; partially documented | ISO 9001 certified; controlled documents | Integrated QMS-ERP; digital quality records | Paperless; automated compliance; knowledge management |

**Maturity Score Interpretation:**
- 1.0-2.0: **Reactive** — Focused on detection; high cost of quality; significant risk
- 2.1-3.0: **Developing** — Building foundation; ready for systematic improvement
- 3.1-4.0: **Proactive** — Prevention-oriented; ROI-positive quality investment
- 4.1-5.0: **World-class** — Quality drives competitive advantage and customer loyalty

### Step 2: Cost of Quality (COQ) Analysis

Calculate the four categories of quality costs:

**COQ Framework:**

| Category | Description | Typical Cost Elements | Amount ($) | % of Revenue |
|----------|-----------|----------------------|-----------|-------------|
| **Prevention Costs** | Spending to prevent defects from occurring | | | |
| | Quality planning & engineering | | | |
| | Process design & validation | | | |
| | Training (quality-related) | | | |
| | Supplier qualification & development | | | |
| | Preventive maintenance (quality-related) | | | |
| | Design reviews & FMEA | | | |
| **Subtotal Prevention** | | | **$[X]** | **[X]%** |
| **Appraisal Costs** | Spending to detect defects before they reach customers | | | |
| | Incoming inspection & testing | | | |
| | In-process inspection & testing | | | |
| | Final inspection & testing | | | |
| | Test equipment calibration & maintenance | | | |
| | Quality audits (internal & external) | | | |
| | Lab testing & certification | | | |
| **Subtotal Appraisal** | | | **$[X]** | **[X]%** |
| **Internal Failure Costs** | Cost of defects caught before shipment | | | |
| | Scrap (materials + labor) | | | |
| | Rework & repair | | | |
| | Re-inspection / re-test | | | |
| | Downgrading (selling as lower grade) | | | |
| | Yield loss / excess material usage | | | |
| | Root cause investigation time | | | |
| **Subtotal Internal Failure** | | | **$[X]** | **[X]%** |
| **External Failure Costs** | Cost of defects reaching customers | | | |
| | Warranty claims & repairs | | | |
| | Product returns & replacements | | | |
| | Customer complaints handling | | | |
| | Product recalls | | | |
| | Penalty / liquidated damages | | | |
| | Lost customers (estimated) | | | |
| | Liability / litigation | | | |
| **Subtotal External Failure** | | | **$[X]** | **[X]%** |
| **TOTAL COST OF QUALITY** | | | **$[X]** | **[X]%** |

**COQ Benchmarks:**

| Maturity Level | Prevention | Appraisal | Internal Failure | External Failure | Total COQ (% Revenue) |
|---------------|-----------|-----------|-----------------|-----------------|----------------------|
| Reactive (Level 1-2) | 2-5% | 5-10% | 5-10% | 5-10% | 20-35% |
| Developing (Level 2-3) | 5-8% | 3-5% | 3-5% | 2-5% | 15-20% |
| Proactive (Level 3-4) | 8-12% | 2-3% | 1-3% | 0.5-2% | 10-15% |
| World-class (Level 4-5) | 10-15% | 1-2% | 0.5-1% | < 0.5% | 5-10% |

**Key insight:** As prevention spending increases, failure costs decrease disproportionately. The optimal COQ shifts spend from failure (reactive) to prevention (proactive), reducing total COQ while improving quality outcomes.

**When COQ is unmeasured, it typically runs 15-25% of revenue.** Most companies underestimate COQ by 3-5x because they miss hidden costs (management time on quality issues, expediting, customer relationship damage, lost sales).

### Step 3: Quality KPI Framework

Define and measure key quality metrics:

**Outcome Metrics (Lagging):**

| KPI | Definition | Formula | Current | Target | Benchmark |
|-----|-----------|---------|---------|--------|-----------|
| **Defect Rate (PPM)** | Defects per million opportunities | (Defects / Units Produced) x 1,000,000 | | | Industry-specific |
| **First-Pass Yield (FPY)** | % of units passing all inspections without rework | Good Units / Total Units Started | | > 95% | |
| **Rolled Throughput Yield (RTY)** | Probability of zero defects through entire process | Product of FPY at each step | | > 85% | |
| **Cost of Quality (% Revenue)** | Total COQ as percentage of revenue | Total COQ / Revenue | | < 10% | |
| **Customer Complaint Rate** | Complaints per unit or per $M revenue | Complaints / Units Shipped | | | |
| **Warranty Cost (% Revenue)** | Warranty expense as % of revenue | Warranty Expense / Revenue | | < 1% | |
| **On-Time Delivery (Quality-related)** | % of shipments delayed due to quality issues | Quality Delays / Total Shipments | | < 1% | |
| **Supplier PPM** | Defects received from suppliers | Defective Incoming / Total Incoming x 1M | | < 500 PPM | |

**Process Metrics (Leading):**

| KPI | Definition | Target |
|-----|-----------|--------|
| **Cpk (Process Capability)** | Process capability index | > 1.33 (4-sigma); > 1.67 (5-sigma) |
| **SPC compliance** | % of critical processes under statistical control | 100% of critical CTQs |
| **CAPA closure rate** | % of corrective actions closed on time | > 90% within target timeline |
| **Audit finding closure** | % of audit findings resolved within timeline | > 95% within 90 days |
| **Training compliance** | % of personnel current on required quality training | 100% |
| **Preventive action ratio** | Preventive actions / Total CAPAs | > 30% |

### Step 4: ISO 9001 Framework Alignment

Assess compliance / alignment to ISO 9001:2015 clauses:

| Clause | Requirement | Current Status | Gap | Priority |
|--------|-----------|---------------|-----|----------|
| **4. Context of the Organization** | | | | |
| 4.1 | Understanding the organization and its context | [Compliant / Partial / Non-compliant] | | |
| 4.2 | Understanding needs and expectations of interested parties | | | |
| 4.3 | Determining the scope of the QMS | | | |
| 4.4 | QMS and its processes | | | |
| **5. Leadership** | | | | |
| 5.1 | Leadership and commitment | | | |
| 5.2 | Policy | | | |
| 5.3 | Organizational roles, responsibilities | | | |
| **6. Planning** | | | | |
| 6.1 | Actions to address risks and opportunities | | | |
| 6.2 | Quality objectives and planning | | | |
| 6.3 | Planning of changes | | | |
| **7. Support** | | | | |
| 7.1 | Resources (monitoring, measuring, knowledge) | | | |
| 7.2 | Competence | | | |
| 7.3 | Awareness | | | |
| 7.4 | Communication | | | |
| 7.5 | Documented information | | | |
| **8. Operation** | | | | |
| 8.1 | Operational planning and control | | | |
| 8.2 | Requirements for products and services | | | |
| 8.3 | Design and development | | | |
| 8.4 | Control of externally provided processes, products, services | | | |
| 8.5 | Production and service provision | | | |
| 8.6 | Release of products and services | | | |
| 8.7 | Control of nonconforming outputs | | | |
| **9. Performance Evaluation** | | | | |
| 9.1 | Monitoring, measurement, analysis, evaluation | | | |
| 9.2 | Internal audit | | | |
| 9.3 | Management review | | | |
| **10. Improvement** | | | | |
| 10.1 | General | | | |
| 10.2 | Nonconformity and corrective action | | | |
| 10.3 | Continual improvement | | | |

### Step 5: Root Cause Analysis Framework

Apply structured RCA to the top quality problems:

**5 Why Analysis Template:**

| Level | Question | Answer | Evidence |
|-------|----------|--------|----------|
| Problem Statement | What happened? | [Specific, measurable problem description] | |
| Why 1 | Why did this happen? | | |
| Why 2 | Why did [Why 1 answer] occur? | | |
| Why 3 | Why did [Why 2 answer] occur? | | |
| Why 4 | Why did [Why 3 answer] occur? | | |
| Why 5 | Why did [Why 4 answer] occur? | [Root cause identified] | |
| Corrective Action | What will prevent recurrence? | | |
| Verification | How will we confirm effectiveness? | | |

**Fishbone / Ishikawa Categories (6M):**

For each quality problem, analyze potential causes across:

| Category | Potential Causes | Validated? | Contribution |
|----------|-----------------|-----------|-------------|
| **Man** (People) | Training gaps, fatigue, skill mismatch, communication | | |
| **Machine** (Equipment) | Calibration drift, wear, maintenance, capability | | |
| **Material** (Inputs) | Supplier quality, specification, storage, handling | | |
| **Method** (Process) | SOP gaps, process design, sequence, parameters | | |
| **Measurement** (Inspection) | Gauge capability, frequency, criteria, calibration | | |
| **Mother Nature** (Environment) | Temperature, humidity, contamination, vibration | | |

### Step 6: Statistical Process Control Basics

For critical quality characteristics, establish SPC:

**Control Chart Selection Guide:**

| Data Type | Individual Values | Subgroups (n=2-10) | Subgroups (n>10) | Attribute (defective) | Attribute (defects) |
|-----------|------------------|--------------------|-----------------|-----------------------|---------------------|
| Chart type | I-MR | X-bar R | X-bar S | p or np | c or u |
| When to use | Low-volume or destructive testing | Standard production sampling | Large subgroups | Pass/fail classification | Count of defects per unit |

**Control Limits:**
```
UCL = X-bar + A2 x R-bar  (for X-bar chart)
LCL = X-bar - A2 x R-bar
Center line = X-bar (process mean)

Process Capability:
  Cp = (USL - LSL) / (6 x sigma)      — Potential capability (centered process)
  Cpk = min[(USL - X-bar), (X-bar - LSL)] / (3 x sigma)  — Actual capability
```

**Capability Interpretation:**

| Cpk Value | Sigma Level | PPM (one-sided) | Interpretation |
|-----------|------------|----------------|---------------|
| 0.33 | 1 sigma | 317,311 | Not capable — immediate action required |
| 0.67 | 2 sigma | 45,500 | Poor — significant improvement needed |
| 1.00 | 3 sigma | 2,700 | Minimum acceptable for non-critical |
| 1.33 | 4 sigma | 63 | Good — standard for most industries |
| 1.67 | 5 sigma | 0.57 | Excellent — automotive/aerospace standard |
| 2.00 | 6 sigma | 0.002 | World-class |

### Step 7: Financial Impact Linkage

Connect quality performance to financial outcomes:

**Defect-to-Dollar Translation:**

| Quality Issue | Volume / Frequency | Unit Cost of Failure ($) | Annual Financial Impact ($) | Customer Impact |
|--------------|-------------------|------------------------|---------------------------|----------------|
| [Defect type 1] | [X] per [period] | | | [Complaint / Return / Lost customer] |
| [Defect type 2] | | | | |
| **Total** | | | **$[X]** | |

**Quality Improvement ROI Model:**

```
Investment in Prevention:
  + Additional inspection / testing equipment     $[X]
  + SPC implementation and training               $[X]
  + Supplier quality development                  $[X]
  + Process improvement / poka-yoke               $[X]
  + Quality management system upgrade             $[X]
  = Total Prevention Investment                   $[X]

Expected Failure Cost Reduction:
  - Scrap reduction                               $[X]
  - Rework reduction                              $[X]
  - Warranty cost reduction                       $[X]
  - Customer complaint reduction                  $[X]
  - Recall risk reduction (expected value)        $[X]
  = Total Failure Cost Savings                    $[X]

Net Annual Benefit = Savings - Incremental Prevention Cost
ROI = Net Annual Benefit / Prevention Investment x 100%
```

**Typical ROI:** Every $1 invested in prevention saves $5-15 in failure costs.

### Step 8: Quality Improvement Roadmap

**Phase 1: Foundation (0-6 Months)**
- Establish quality metrics and baseline measurement
- Implement structured nonconformance reporting (NCR) system
- Deploy 5 Why / fishbone for all significant quality issues
- Conduct cost of quality assessment
- Train frontline teams on quality basics

**Phase 2: Systematic Improvement (6-18 Months)**
- Implement SPC on critical processes
- Achieve / maintain ISO 9001 certification
- Deploy supplier quality management program
- Implement CAPA system with effectiveness verification
- Establish management review rhythm

**Phase 3: Culture and Excellence (18-36 Months)**
- Embed quality ownership at every level
- Implement advanced analytics for quality prediction
- Achieve Cpk > 1.33 on all critical CTQs
- Deploy mistake-proofing across high-risk processes
- Benchmark and exceed industry quality standards

## Output Template

```markdown
# Quality Management Assessment: [Company / Business Unit]

**Client:** [Name]
**Date:** [Date]
**Scope:** [Products / processes / sites assessed]

---

## 1. Executive Summary

[2-3 paragraphs: current quality state, key findings, financial impact, improvement opportunity]

**Overall Quality Maturity:** [X.X] / 5.0 ([Reactive / Developing / Proactive / World-class])
**Current Cost of Quality:** $[X]M ([X]% of revenue)
**Estimated Achievable COQ:** $[X]M ([X]% of revenue)
**Quality Improvement Opportunity:** $[X]M annually
**Investment Required:** $[X]M
**Expected ROI:** [X]x return on prevention investment

---

## 2. Quality Maturity Assessment

| Dimension | Score (1-5) | Key Observations | Priority |
|-----------|------------|-----------------|----------|
| Quality Strategy | | | |
| Process Control | | | |
| Measurement & Data | | | |
| Root Cause Analysis | | | |
| Supplier Quality | | | |
| Customer Focus | | | |
| People & Culture | | | |
| Documentation & Systems | | | |
| **Overall** | **[Avg]** | | |

### Strengths
- [Strength 1]
- [Strength 2]

### Critical Gaps
- [Gap 1 — with business impact]
- [Gap 2 — with business impact]

---

## 3. Cost of Quality Analysis

| Category | Amount ($M) | % of Revenue | Benchmark | Gap |
|----------|-----------|-------------|-----------|-----|
| Prevention | | | | |
| Appraisal | | | | |
| Internal Failure | | | | |
| External Failure | | | | |
| **Total COQ** | **$[X]** | **[X]%** | **[X]%** | **$[X]M** |

### COQ Distribution
- Prevention / Appraisal ratio: [X]% (target: > 50% of total COQ)
- Failure costs as % of total COQ: [X]% (target: < 30%)
- Hidden quality costs estimate: $[X]M (management time, expediting, lost customers)

### Improvement Potential
[Analysis of how shifting $1 from failure to prevention can save $X in total COQ]

---

## 4. Quality Performance Metrics

| KPI | Current | Target | Benchmark | Gap |
|-----|---------|--------|-----------|-----|
| Defect Rate (PPM) | | | | |
| First-Pass Yield | | | | |
| Rolled Throughput Yield | | | | |
| Customer Complaint Rate | | | | |
| Warranty Cost (% Revenue) | | | | |
| Supplier PPM | | | | |
| CAPA Closure Rate | | | | |
| Process Capability (Cpk) | | > 1.33 | | |

---

## 5. ISO 9001 Alignment Assessment

### Compliance Summary

| Clause | Status | Critical Gaps |
|--------|--------|--------------|
| 4. Context | [Compliant / Partial / Gap] | |
| 5. Leadership | | |
| 6. Planning | | |
| 7. Support | | |
| 8. Operation | | |
| 9. Performance Evaluation | | |
| 10. Improvement | | |

### Key Non-Conformances / Observations
1. [Finding with clause reference and severity]
2. [Finding]

---

## 6. Root Cause Analysis — Top Quality Issues

### Issue 1: [Description]

**Impact:** $[X] annually; [X] customer complaints per [period]

**5 Why Analysis:**
| Level | Finding |
|-------|---------|
| Why 1 | |
| Why 2 | |
| Why 3 | |
| Why 4 | |
| Why 5 (Root Cause) | |

**Corrective Action:** [Action, owner, deadline]
**Estimated Benefit:** $[X] annually

[Repeat for top 3-5 quality issues]

---

## 7. Defect-to-Dollar Impact Table

| Quality Issue | Annual Volume | Cost per Incident ($) | Annual Impact ($M) | Customer Impact |
|--------------|--------------|----------------------|-------------------|----------------|
| | | | | |
| **Total** | | | **$[X]** | |

---

## 8. Quality Improvement Roadmap

### Phase 1: Foundation (0-6 Months)

| # | Initiative | Investment ($) | Expected Benefit ($) | Owner | Milestone |
|---|-----------|---------------|---------------------|-------|-----------|
| 1 | | | | | |
| 2 | | | | | |

### Phase 2: Systematic Improvement (6-18 Months)

| # | Initiative | Investment ($) | Expected Benefit ($) | Owner | Milestone |
|---|-----------|---------------|---------------------|-------|-----------|
| 1 | | | | | |
| 2 | | | | | |

### Phase 3: Culture & Excellence (18-36 Months)

| # | Initiative | Investment ($) | Expected Benefit ($) | Owner | Milestone |
|---|-----------|---------------|---------------------|-------|-----------|
| 1 | | | | | |
| 2 | | | | | |

### Investment Summary

| Phase | Investment ($M) | Annual Benefit ($M) | ROI | COQ After |
|-------|----------------|--------------------|----- |-----------|
| Phase 1 | | | | [X]% of revenue |
| Phase 2 | | | | [X]% of revenue |
| Phase 3 | | | | [X]% of revenue |
| **Total** | **$[X]** | **$[X]** | **[X]x** | **[X]%** |

---

## 9. Recommended Next Steps

1. [Immediate action with owner and deadline]
2. [Second action]
3. [Third action]
```

## Quality Checks

- [ ] Cost of Quality includes all four categories (prevention, appraisal, internal failure, external failure) — no category is omitted
- [ ] Hidden quality costs are estimated and disclosed — total COQ is not understated
- [ ] COQ is expressed both in dollars and as a percentage of revenue for comparability
- [ ] The "15-25% of revenue when unmeasured" benchmark is cited with context, not as a blanket assumption
- [ ] Defect rates are linked to specific financial impacts — no quality metric exists without a dollar translation
- [ ] Root cause analysis goes to true root cause (5th why or equivalent depth), not just symptoms
- [ ] ISO 9001 assessment covers all major clauses (4-10) — not just the easy ones
- [ ] SPC / process capability is assessed for critical characteristics, with Cpk values where data exists
- [ ] Quality improvement roadmap has phased investments with expected returns at each phase
- [ ] Prevention vs. failure cost ratio is analyzed — the assessment recommends shifting investment upstream
- [ ] Supplier quality is assessed — not only internal operations
- [ ] Customer impact is quantified (complaints, returns, lost customers) — not just internal defect rates
- [ ] Every initiative in the roadmap has an owner and a measurable milestone