Wellbeing Psychometrics & Measurement

Wellbeing Psychometrics & Measurement

Rigorous measurement of wellbeing requires validated instruments with strong psychometric properties. This skill guides selection, implementation, and interpretation of evidence-based measurement tools.

Core Psychometric Principles

Validity Types

• Construct Validity: Does the instrument measure what it claims to measure?
• Criterion Validity: Does it predict relevant outcomes?
• Content Validity: Does it comprehensively cover the domain?
• Discriminant Validity: Does it distinguish from related but different constructs?

Reliability Indicators

• Cronbach's Alpha: Internal consistency (0.7-0.9 is acceptable, 0.6+ for exploratory)
• Test-Retest Reliability: Stability over time (typically ICC > 0.7)
• Inter-rater Reliability: Agreement between raters (Cohen's kappa, ICC)

Measurement Model Fit

• CFI/TLI: Comparative fit indices (>0.90 is good)
• RMSEA: Root Mean Square Error of Approximation (<0.08 is acceptable)
• SRMR: Standardized Root Mean Square Residual (<0.08 is good)

Validated Wellbeing Instruments

Multidimensional Wellbeing Scales

PERMA-Profiler (Kern et al., 2015)

Structure: 23 items across 6 domains

• Positive Emotion (hedonic wellbeing)
• Engagement (flow, absorption)
• Relationships (social connection)
• Meaning (life purpose)
• Accomplishment (achievement, mastery)
• Negative Emotion (reverse-scored)

Strengths: Brief, validated across cultures, theory-grounded (Seligman's PERMA model) Use for: General wellbeing assessment, product/experience evaluation Psychometrics: α ≈ 0.70-0.85 across domains Administration: 5-10 minutes

Personal Wellbeing Index (PWI-8) (International Wellbeing Group)

Structure: 8 life satisfaction domains

• Standard of living
• Health
• Life achievement
• Personal relationships
• Personal safety
• Community connectedness
• Future security
• Life satisfaction (overall)

Strengths: Short, universal, used in major population studies Use for: Population-level monitoring, longitudinal tracking Psychometrics: α ≈ 0.80-0.85 Administration: 3-5 minutes

Hedonic & Eudaimonic Wellbeing

Scale of Positive and Negative Experience (SPANE) (Diener et al., 2010)

Structure: 12 items in 2 factors

• Positive experiences (positive, negative reversed, good, bad reversed, etc.)
• Negative experiences (negative, worried, sad, etc.)

Strengths: Brief, captures both dimensions, good cross-cultural validity Use for: Affective wellbeing, emotional state tracking Psychometrics: α ≈ 0.81-0.89 Administration: 2-3 minutes

Meaning in Life Scale (MLQ) (Steger et al., 2006)

Structure: 5 items in 2 dimensions

• Presence of meaning
• Search for meaning

Strengths: Concise eudaimonic measure, validated widely Use for: Purpose and meaning assessment Psychometrics: α ≈ 0.73-0.90 Administration: 2 minutes

Flourishing & Flourishing Specific Scales

Psychological Wellbeing Scale (PWB-18) (Ryff, 1989)

Dimensions: 6 core elements (3 items each)

• Autonomy
• Competence (mastery)
• Personal growth
• Purpose in life
• Positive relationships
• Self-acceptance

Strengths: Theoretically grounded in human potential, eudaimonic focus Use for: Comprehensive psychological wellbeing assessment Psychometrics: α ≈ 0.83-0.87 Administration: 10-15 minutes

Flourishing Scale (FS) (Diener et al., 2009)

Structure: 8 items across psychological flourishing

• Purpose, engagement, relationships, competence, optimism, self-respect

Strengths: Brief, robust factor structure, used widely in research Use for: General flourishing assessment Psychometrics: α ≈ 0.87-0.90 Administration: 3 minutes

Domain-Specific Measures

Satisfaction With Life Scale (SWLS) (Diener et al., 1985)

Structure: 5 items measuring global life satisfaction Strengths: Gold standard for life satisfaction, extensive validation Psychometrics: α ≈ 0.79-0.89 Administration: 2 minutes

UCLA Loneliness Scale (ULS-8) (Hughes et al., 2004)

Structure: 8 items measuring perceived social isolation Strengths: Short form, validated, predictive of health outcomes Psychometrics: α ≈ 0.82 Administration: 2 minutes

Rosenberg Self-Esteem Scale (RSE) (Rosenberg, 1965)

Structure: 10 items measuring global self-worth Strengths: Most widely used self-esteem measure, culturally adapted Psychometrics: α ≈ 0.77-0.88 Administration: 3 minutes

Experience Sampling & Real-time Measures

Experience Sampling Method (ESM) / Ecological Momentary Assessment (EMA)

Structure: Brief surveys delivered via app in real context

• Current activity and location
• Social context
• Emotional state (affect grid or PANAS)
• Engagement and stress levels

Strengths: Captures real-time experience, reduces recall bias Use for: Product experience evaluation, diary-style wellbeing tracking Consideration: Higher participant burden, data analysis complexity

Measurement Design Best Practices

Scale Selection Criteria

• Validity: Evidence of measuring intended construct
• Reliability: Adequate internal consistency and stability
• Responsiveness: Sensitive to meaningful changes
• Brevity: Minimizes participant burden
• Cross-cultural: Available translations and validation
• Theory-alignment: Matches your wellbeing framework
• Licensing: Open access or affordable permissions

Administration Considerations

Frequency:

• Baseline: Before intervention/new design
• Post-test: Immediately after experience (1-7 days)
• Follow-up: Long-term effects (weeks to months)

Response Mode:

• Online/mobile preferred for research-through-design
• Paper for in-person contexts
• Experience sampling for real-time tracking

Anchoring Scales:

• Consistent 1-10 or 1-7 Likert scales
• Clear labeling ("Strongly Disagree" to "Strongly Agree")
• Avoid neutral mid-point for forced choice contexts

Data Quality Assurance

• Attention checks: Reverse-coded or logic questions
• Completion rates: Monitor for incomplete responses
• Response time: Identify rushed or suspicious patterns
• Missing data: Document and handle appropriately

Analysis & Interpretation

Descriptive Statistics

• Mean, median, standard deviation by subscale
• Floor/ceiling effects (>15% responses at extremes)
• Skewness and kurtosis

Inferential Analysis

• t-tests/ANOVA: Compare groups (e.g., treatment vs. control)
• Paired tests: Pre-post comparisons
• Correlation: Relationships between wellbeing dimensions
• Regression: Predictive relationships

Effect Sizes

• Cohen's d: 0.2 (small), 0.5 (medium), 0.8 (large)
• ηp²: 0.01 (small), 0.06 (medium), 0.14 (large)
• Report alongside p-values for practical significance

Qualitative Integration

• Triangulate quantitative findings with interview data
• Use scores to guide depth interviews with high/low scorers
• Contextualize numerical changes with lived experience

Quick Reference: Instrument Selection Matrix

Common Pitfalls to Avoid

• Cherry-picking scales: Choose based on theory, not convenience
• Ignoring psychometrics: Always verify reliability/validity for your population
• Over-interpretation: Acknowledge measurement error and confidence intervals
• Single measure: Combine multiple instruments for comprehensive picture
• Ignoring context: Same score means differently in different populations
• Neglecting qualitative data: Numbers without stories miss crucial nuance

Resources

• Open Science Framework (OSF): Repository of validated instruments and protocols
• PubMed/Google Scholar: Search for validation studies in your population
• COSMIN: Guidelines for selecting Patient-Reported Outcome Measures
• International Wellbeing Group: PWI and related resources