lev-os Occam's Razor
Overview
Occam's Razor (Principle of Parsimony) states: when choosing between competing explanations that make equally accurate predictions, prefer the one requiring fewer assumptions. Named after 14th-century philosopher William of Ockham, it's a foundational heuristic in science and problem-solving. The key: this applies ONLY when explanations have equal explanatory power - it's not about oversimplifying, but avoiding unnecessary complexity.
When to Use
- Debugging systems when multiple theories could explain a failure
- Evaluating competing scientific theories or hypotheses
- Medical diagnosis with multiple possible conditions
- Choosing between architectural designs with similar capabilities
- Deciding between simple vs. complex solutions to a problem
- Avoiding conspiracy theories or over-complicated explanations
The Process
Step 1: Identify Competing Explanations
List all plausible explanations for the phenomenon you're investigating. For a production outage: network failure, database corruption, memory leak, DDoS attack, configuration error, hardware failure.
Example: Your website is down. Possible causes: DNS misconfiguration, server crash, code deployment bug, cyber attack, hosting provider outage.
Step 2: Evaluate Explanatory Power
Assess whether each explanation actually accounts for the observed evidence. Eliminate theories that don't match the facts. If your logs show successful requests until exactly 2 PM deployment, theories involving hardware failure (gradual) don't fit.
Step 3: Count Assumptions Required
For explanations that fit the evidence equally well, list the assumptions each requires. Simple explanation: "deployment introduced a bug" (assumes: code changed, bug wasn't caught in testing). Complex: "coordinated attack timed with deployment" (assumes: attackers knew deployment time, bypassed security, timed perfectly, left no attack signatures).
Step 4: Choose Fewer Assumptions
Select the explanation requiring the fewest additional assumptions. This doesn't guarantee correctness - it identifies the most likely explanation to investigate first. Save complex theories for when simpler ones fail.
Example: Website went down at deployment time → investigate the deployment first (1-2 assumptions) before investigating coordinated cyber attacks (5+ assumptions).
Step 5: Test and Iterate
Verify your chosen explanation through testing. If the simple explanation is wrong, move to the next-simplest theory. Occam's Razor is a heuristic for prioritizing investigation, not a guarantee of truth.
Example Application
Situation: In medicine, a patient presents with fatigue, weight loss, and fever. Multiple diseases could explain this: common viral infection, rare tropical disease, cancer, autoimmune disorder, chronic fatigue syndrome.
Application: Doctors apply "when you hear hoofbeats, think horses, not zebras" (medical version of Occam's Razor). Test for common conditions first (viral infection - requires few assumptions: patient exposed to virus). Only pursue rare diseases (tropical parasites - requires assumptions: recent travel, exposure to specific vectors) if common explanations fail.
Outcome: 95%+ of cases resolve with simple explanations. Testing for rare diseases first wastes time/money and delays treatment. But when simple tests fail, doctors DO pursue complex diagnoses - Occam's Razor prioritizes, doesn't eliminate.
Anti-Patterns
- Using Occam's Razor to dismiss complexity when evidence actually requires it (oversimplifying)
- Applying it when explanations don't have equal predictive power (choosing "simple but wrong" over "complex but accurate")
- Confusing "fewer assumptions" with "easier to understand" (quantum mechanics is simpler than hidden variables, but harder to grasp)
- Using it to avoid investigating when simple explanation already failed tests
- Treating it as proof rather than a heuristic for prioritizing investigation
Real-World Business Examples
Startup Failure Analysis Company loses 50% of users in one month. Possible causes:
- Simple: Major competitor launched, pricing change upset users, critical bug
- Complex: Coordinated sabotage, algorithm conspiracy, market manipulation Start with data on competitor launches and product changes before complex theories.
Software Performance Application slows down after update:
- Simple: New code has inefficient query, memory leak, cache not warming
- Complex: Hardware degradation + cosmic rays + database index corruption + network interference Investigate code changes first - they have highest prior probability.
Bayesian Foundation
Occam's Razor emerges naturally from Bayesian probability theory:
- Simpler hypotheses have fewer free parameters
- Fewer parameters = higher prior probability (less specific claim)
- Same fit to data + higher prior = higher posterior probability
- Mathematical formalization: Minimum Description Length (MDL) principle
This explains WHY simpler is better: not philosophical preference, but mathematical consequence of probability theory.
Common Pitfalls
- Oversimplification: Ignoring evidence that demands complexity
- Premature conclusion: Accepting simple explanation without testing
- Confusing simple with familiar: Choosing comfortable over genuinely parsimonious
- Avoiding necessary complexity: World is sometimes complex - embrace when warranted
- Using as proof: Razor prioritizes investigation, doesn't prove correctness
Historical Evolution
14th Century: William of Ockham formulates "Entities should not be multiplied beyond necessity" 17th-18th Century: Becomes central to scientific method 20th Century: Formalized in information theory (Solomonoff, Kolmogorov complexity) 21st Century: Applied to machine learning (regularization, model selection)
Success Metrics
- Faster time to correct diagnosis (start with high-probability causes)
- Fewer wasted resources on unlikely scenarios
- More testable hypotheses (simpler = easier to falsify)
- Better decision quality under uncertainty
- Reduced analysis paralysis
Relationship to Other Frameworks
- Hanlon's Razor: Specific application (prefer incompetence over malice)
- Hitchens's Razor: Applied to claims (dismiss unfounded assertions)
- KISS Principle: Design philosophy (Keep It Simple, Stupid)
- Minimum Viable Product: Start simple, add complexity only as needed
- First Principles Thinking: Strip to essentials, rebuild from simplicity
Key Insight
Occam's Razor is not a statement about reality (claiming the world is simple), but a rational strategy for investigation: simpler hypotheses have higher prior probability, are easier to test, and should be checked first. Complexity should be adopted only when evidence demands it.
Primary Sources: William of Ockham (14th century), Bayesian statistics, Solomonoff induction Practitioner: Science, medicine, engineering, debugging, business analysis Complexity: Low - concept simple, application requires judgment Estimated Learning: 20 minutes to understand, career to master judicious application