ilog3 Education Psychometric Scale Development
Goal
Design and validate scales, tests, questionnaires, rubrics, or educational measurement instruments.
Inputs
- Construct definition
- Target population
- Item pool or dimensions
- Response format
- Pilot/validation sample plan
- Existing theory/scales
Workflow
- Define construct and dimensions.
- Generate item pool and expert review plan.
- Plan pilot testing and item analysis.
- Plan reliability: Cronbach alpha, omega, test-retest, inter-rater if relevant.
- Plan validity: content, structural, convergent, discriminant, criterion.
- Choose EFA/CFA/IRT/invariance analyses.
- Draft measurement paper method/results templates.
Tool Calls
R packages:
install.packages(c("psych", "lavaan", "semTools", "mirt", "ltm", "TAM", "GPArotation"))
Interactive:
ShinyItemAnalysis: https://shinyitemanalysis.org/
jamovi: https://www.jamovi.org/
JASP: https://jasp-stats.org/
Mplus: https://www.statmodel.com/
AMOS: https://www.ibm.com/products/structural-equation-modeling-sem
Output Format
| Stage | Task | Output |
|---|
Include:
- Construct map
- Item generation table
- Expert validity form
- Pilot analysis plan
- EFA/CFA/IRT plan
- Reporting template
Quality Rules
- Do not claim validity as a property of a scale in general; state validity evidence for a use/context.
- Separate item development sample and validation sample when feasible.
- Match sample size to model complexity.