Reporting Guidelines
Overview
Reporting guidelines ensure transparent, complete, and reproducible research communication. Journals increasingly require adherence to specific guidelines. This reference covers guidelines most relevant to EHR-based clinical research.
Which Guideline to Use?
| Study Type |
Primary Guideline |
Extension |
| Observational (cohort, case-control, cross-sectional) |
STROBE |
RECORD (for routinely collected data) |
| Prediction model development |
TRIPOD |
TRIPOD+AI (if ML/AI methods) |
| Prediction model validation |
TRIPOD |
- |
| Diagnostic accuracy |
STARD |
- |
| Randomized trial |
CONSORT |
- |
| Systematic review |
PRISMA |
- |
| Clinical practice guideline |
AGREE |
- |
For most MIMIC/eICU research: STROBE + RECORD (observational) or TRIPOD (prediction)
STROBE: Observational Studies
STrengthening the Reporting of OBservational studies in Epidemiology
Website: strobe-statement.org
Checklist Summary
| Section |
Item |
Key Requirements |
| Title/Abstract |
1 |
Indicate study design in title or abstract |
| Introduction |
2 |
Scientific background and rationale |
|
3 |
Specific objectives, including pre-specified hypotheses |
| Methods |
4 |
Study design: cohort, case-control, cross-sectional |
|
5 |
Setting: locations, dates, periods of recruitment/exposure/follow-up |
|
6 |
Participants: eligibility criteria, sources, selection methods |
|
7 |
Variables: outcomes, exposures, predictors, confounders, effect modifiers |
|
8 |
Data sources/measurement: for each variable of interest |
|
9 |
Bias: efforts to address potential sources |
|
10 |
Study size: how determined, power calculation if applicable |
|
11 |
Quantitative variables: how handled in analysis |
|
12 |
Statistical methods: all methods including confounding control |
| Results |
13 |
Participants: numbers at each stage, reasons for non-participation |
|
14 |
Descriptive data: characteristics, missing data |
|
15 |
Outcome data: numbers of events or summary measures |
|
16 |
Main results: unadjusted and adjusted estimates, precision |
|
17 |
Other analyses: subgroups, interactions, sensitivity |
| Discussion |
18 |
Key results with reference to objectives |
|
19 |
Limitations: sources of bias, imprecision |
|
20 |
Interpretation: cautious, considering objectives and limitations |
|
21 |
Generalizability: external validity |
| Other |
22 |
Funding and role of funders |
STROBE Common Gaps in EHR Research
| Gap |
What's Missing |
How to Fix |
| Vague eligibility |
"ICU patients" without specifics |
Report exact codes, criteria, dates |
| Missing flow diagram |
No participant numbers |
Include CONSORT-style flowchart |
| Undefined variables |
"Sepsis" without definition |
Specify Sepsis-3 or ICD codes used |
| No missing data info |
Extent and handling not reported |
Report % missing, imputation method |
| Unadjusted only |
No confounder adjustment shown |
Report both crude and adjusted |
RECORD: Routinely Collected Health Data
REporting of studies Conducted using Observational Routinely-collected health Data
Website: record-statement.org
RECORD extends STROBE specifically for database studies (EHR, claims, registries).
Additional RECORD Items
| STROBE Item |
RECORD Extension |
| 4 (Study design) |
4.1: Describe database(s) used |
| 6 (Participants) |
6.1: Methods of selecting patients from database |
|
6.2: Codes/algorithms for identifying participants |
|
6.3: Validation of codes if applicable |
| 7 (Variables) |
7.1: Codes/algorithms used to define variables |
| 12 (Statistical methods) |
12.1: How data linkage was performed (if applicable) |
| 13 (Participants) |
13.1: Data cleaning steps |
| 19 (Limitations) |
19.1: Implications of using routinely collected data |
|
RECORD 22.1: Data access and cleaning methods availability |
RECORD-Specific Reporting for MIMIC/eICU
| Element |
What to Report |
| Database version |
MIMIC-IV v2.2, eICU v2.0, etc. |
| Access/ethics |
PhysioNet credentialing, IRB status |
| Time period |
Exact admission dates included |
| Code definitions |
ICD-9/10 codes, lab LOINC codes, drug codes |
| Validation |
Were codes validated against chart review? |
| Data linkage |
How tables were joined (keys used) |
| Cleaning |
Outlier handling, impossible values removed |
TRIPOD: Prediction Models
Transparent Reporting of a multivariable prediction model for Individual Prognosis Or Diagnosis
Website: tripod-statement.org
TRIPOD Checklist Summary
| Section |
Item |
Key Requirements |
| Title/Abstract |
1 |
Identify as prediction model; state development/validation |
|
2 |
Summary of objectives, participants, predictors, outcome, results |
| Introduction |
3 |
Background and objectives |
| Methods |
4 |
Source of data (development and validation) |
|
5 |
Participants: eligibility, recruitment, sampling |
|
6 |
Outcome: definition, timing, blinding |
|
7 |
Predictors: definitions, timing of measurement |
|
8 |
Sample size: how determined |
|
9 |
Missing data: handling strategy |
|
10 |
Statistical methods: model building, selection, internal validation |
|
11 |
Risk groups: how created if applicable |
| Results |
12 |
Participants: flow diagram with numbers |
|
13 |
Model development: participant characteristics |
|
14 |
Model specification: coefficients, hazard ratios, etc. |
|
15 |
Model performance: discrimination, calibration |
|
16 |
Model updating: if applicable |
| Discussion |
17 |
Limitations |
|
18 |
Interpretation: clinical use, comparison to existing models |
|
19 |
Implications for practice and future research |
| Other |
20 |
Supplementary information: full model available |
|
21 |
Funding |
TRIPOD Study Types
| Type |
Description |
Key Reporting |
| 1a |
Development only |
Internal validation required |
| 1b |
Development + validation (same data, random split) |
Report both sets |
| 2a |
Development + validation (non-random split, e.g., temporal) |
Specify split method |
| 2b |
Development + validation (external data) |
Describe both populations |
| 3 |
Validation only (existing model) |
Full model specification needed |
| 4 |
Model updating |
Original model + updates |
TRIPOD Critical Items for ML Models
| Item |
Requirement |
| Full model |
Provide all coefficients/model specification or code |
| Internal validation |
Cross-validation or bootstrap |
| Discrimination |
AUROC with 95% CI |
| Calibration |
Calibration plot, slope, intercept |
| Clinical utility |
Decision curve analysis (recommended) |
| Missing data |
Report approach and proportion missing |
| Sample size |
Events per variable ratio |
TRIPOD+AI: AI/ML Prediction Models
Extension for studies using artificial intelligence/machine learning methods.
Additional TRIPOD+AI Items
| Category |
Item |
Requirement |
| Data |
Preprocessing |
Detail all transformations, normalization |
|
Features |
Feature selection/engineering methods |
|
Class imbalance |
How handled |
| Model |
Architecture |
Full description of model structure |
|
Hyperparameters |
Values used and tuning approach |
|
Training |
Optimization algorithm, stopping criteria |
|
Software |
Libraries, versions, random seeds |
| Validation |
Splits |
Exact split method, stratification |
|
Leakage |
Steps to prevent data leakage |
|
Uncertainty |
Confidence intervals via bootstrap/CV |
| Interpretability |
Explainability |
SHAP, feature importance, etc. |
| Reproducibility |
Code |
Availability of code and data |
STARD: Diagnostic Accuracy
STAndards for Reporting of Diagnostic accuracy studies
Use when evaluating a test/marker's ability to distinguish disease states.
Key STARD Elements
| Element |
Requirement |
| Index test |
Fully describe the test being evaluated |
| Reference standard |
Gold standard for true disease status |
| Participants |
Spectrum of disease severity included |
| Flow diagram |
All participants accounted for |
| 2×2 table |
TP, FP, TN, FN counts |
| Metrics |
Sensitivity, specificity, LR+, LR-, with CIs |
| Thresholds |
How cutoffs were determined |
Reporting Metrics
For Association Studies (STROBE)
| Metric |
What to Report |
| Effect estimate |
OR, RR, HR, mean difference |
| Precision |
95% confidence interval |
| P-value |
Exact value (not "<0.05") |
| Crude and adjusted |
Both estimates |
| Confounders |
List all variables in adjusted model |
Example:
Mortality was higher in the exposed group (adjusted HR 1.45, 95% CI 1.12–1.88, p=0.005) after adjustment for age, sex, SOFA score, and Charlson comorbidity index.
For Prediction Models (TRIPOD)
| Metric |
What to Report |
| Discrimination |
AUROC (95% CI), AUPRC if imbalanced |
| Calibration |
Calibration plot, slope, intercept |
| Overall |
Brier score |
| Classification |
Sensitivity, specificity at chosen threshold |
| Clinical utility |
Net benefit at threshold range (decision curve) |
Example:
The model demonstrated good discrimination (AUROC 0.82, 95% CI 0.78–0.86) and adequate calibration (slope 0.94, intercept -0.12). Decision curve analysis showed net benefit over treating all/none for threshold probabilities between 10% and 40%.
Tables and Figures Checklist
Table 1: Baseline Characteristics
Flow Diagram
Results Table
Prediction Model
Journal-Specific Requirements
Many journals require:
- Completed checklist uploaded as supplementary material
- Statement of adherence in methods section
- Data availability statement
- Code availability statement
Check target journal's author guidelines.
Common Reporting Deficiencies
| Deficiency |
Frequency |
Impact |
| Missing flow diagram |
Very common |
Cannot assess selection bias |
| No missing data info |
Very common |
Cannot assess bias |
| No confidence intervals |
Common |
Cannot assess precision |
| Validation not reported |
Common (ML) |
Cannot assess generalizability |
| Model not reproducible |
Common (ML) |
Cannot implement or verify |
| Crude estimates missing |
Common |
Cannot assess confounding |
| Subgroup analyses post-hoc |
Common |
Inflated false positives |
Quick Reference: Minimum Reporting
Observational Study (STROBE + RECORD)
- Study design in title
- Database name, version, time period
- Eligibility criteria with codes
- Flow diagram with numbers
- Variable definitions (codes)
- Missing data extent and handling
- Crude and adjusted estimates with CIs
- Sensitivity analyses
- Limitations section addressing bias
Prediction Model (TRIPOD)
- Development or validation study in title
- Outcome and predictor definitions with timing
- Sample size and events per variable
- Missing data handling
- Model specification (full coefficients or code)
- Internal validation method
- Discrimination (AUROC with CI)
- Calibration (plot + metrics)
- External validation if applicable
- Limitations and clinical applicability
Resources
| Guideline |
Website |
Checklist |
| STROBE |
strobe-statement.org |
22-item checklist |
| RECORD |
record-statement.org |
STROBE + 13 items |
| TRIPOD |
tripod-statement.org |
22-item checklist |
| TRIPOD+AI |
In development |
Extended ML items |
| STARD |
stard-statement.org |
30-item checklist |
| CONSORT |
consort-statement.org |
25-item checklist |
| PRISMA |
prisma-statement.org |
27-item checklist |
EQUATOR Network (equator-network.org): Central repository for all reporting guidelines.
1---2name: reporting-guidelines3description: Reporting guidelines ensure transparent, complete, and reproducible research communication. Journals increasingly require adherence to specific guidelines.4---5# Reporting Guidelines67## Overview89Reporting guidelines ensure transparent, complete, and reproducible research communication. Journals increasingly require adherence to specific guidelines. This reference covers guidelines most relevant to EHR-based clinical research.1011---1213## Which Guideline to Use?1415| Study Type | Primary Guideline | Extension |16|------------|-------------------|-----------|17| Observational (cohort, case-control, cross-sectional) | STROBE | RECORD (for routinely collected data) |18| Prediction model development | TRIPOD | TRIPOD+AI (if ML/AI methods) |19| Prediction model validation | TRIPOD | - |20| Diagnostic accuracy | STARD | - |21| Randomized trial | CONSORT | - |22| Systematic review | PRISMA | - |23| Clinical practice guideline | AGREE | - |2425**For most MIMIC/eICU research:** STROBE + RECORD (observational) or TRIPOD (prediction)2627---2829## STROBE: Observational Studies3031**STrengthening the Reporting of OBservational studies in Epidemiology**3233Website: [strobe-statement.org](https://www.strobe-statement.org/)3435### Checklist Summary3637| Section | Item | Key Requirements |38|---------|------|------------------|39| **Title/Abstract** | 1 | Indicate study design in title or abstract |40| **Introduction** | 2 | Scientific background and rationale |41| | 3 | Specific objectives, including pre-specified hypotheses |42| **Methods** | 4 | Study design: cohort, case-control, cross-sectional |43| | 5 | Setting: locations, dates, periods of recruitment/exposure/follow-up |44| | 6 | Participants: eligibility criteria, sources, selection methods |45| | 7 | Variables: outcomes, exposures, predictors, confounders, effect modifiers |46| | 8 | Data sources/measurement: for each variable of interest |47| | 9 | Bias: efforts to address potential sources |48| | 10 | Study size: how determined, power calculation if applicable |49| | 11 | Quantitative variables: how handled in analysis |50| | 12 | Statistical methods: all methods including confounding control |51| **Results** | 13 | Participants: numbers at each stage, reasons for non-participation |52| | 14 | Descriptive data: characteristics, missing data |53| | 15 | Outcome data: numbers of events or summary measures |54| | 16 | Main results: unadjusted and adjusted estimates, precision |55| | 17 | Other analyses: subgroups, interactions, sensitivity |56| **Discussion** | 18 | Key results with reference to objectives |57| | 19 | Limitations: sources of bias, imprecision |58| | 20 | Interpretation: cautious, considering objectives and limitations |59| | 21 | Generalizability: external validity |60| **Other** | 22 | Funding and role of funders |6162### STROBE Common Gaps in EHR Research6364| Gap | What's Missing | How to Fix |65|-----|----------------|------------|66| Vague eligibility | "ICU patients" without specifics | Report exact codes, criteria, dates |67| Missing flow diagram | No participant numbers | Include CONSORT-style flowchart |68| Undefined variables | "Sepsis" without definition | Specify Sepsis-3 or ICD codes used |69| No missing data info | Extent and handling not reported | Report % missing, imputation method |70| Unadjusted only | No confounder adjustment shown | Report both crude and adjusted |7172---7374## RECORD: Routinely Collected Health Data7576**REporting of studies Conducted using Observational Routinely-collected health Data**7778Website: [record-statement.org](https://www.record-statement.org/)7980RECORD extends STROBE specifically for database studies (EHR, claims, registries).8182### Additional RECORD Items8384| STROBE Item | RECORD Extension |85|-------------|------------------|86| 4 (Study design) | 4.1: Describe database(s) used |87| 6 (Participants) | 6.1: Methods of selecting patients from database |88| | 6.2: Codes/algorithms for identifying participants |89| | 6.3: Validation of codes if applicable |90| 7 (Variables) | 7.1: Codes/algorithms used to define variables |91| 12 (Statistical methods) | 12.1: How data linkage was performed (if applicable) |92| 13 (Participants) | 13.1: Data cleaning steps |93| 19 (Limitations) | 19.1: Implications of using routinely collected data |94| | RECORD 22.1: Data access and cleaning methods availability |9596### RECORD-Specific Reporting for MIMIC/eICU9798| Element | What to Report |99|---------|----------------|100| Database version | MIMIC-IV v2.2, eICU v2.0, etc. |101| Access/ethics | PhysioNet credentialing, IRB status |102| Time period | Exact admission dates included |103| Code definitions | ICD-9/10 codes, lab LOINC codes, drug codes |104| Validation | Were codes validated against chart review? |105| Data linkage | How tables were joined (keys used) |106| Cleaning | Outlier handling, impossible values removed |107108---109110## TRIPOD: Prediction Models111112**Transparent Reporting of a multivariable prediction model for Individual Prognosis Or Diagnosis**113114Website: [tripod-statement.org](https://www.tripod-statement.org/)115116### TRIPOD Checklist Summary117118| Section | Item | Key Requirements |119|---------|------|------------------|120| **Title/Abstract** | 1 | Identify as prediction model; state development/validation |121| | 2 | Summary of objectives, participants, predictors, outcome, results |122| **Introduction** | 3 | Background and objectives |123| **Methods** | 4 | Source of data (development and validation) |124| | 5 | Participants: eligibility, recruitment, sampling |125| | 6 | Outcome: definition, timing, blinding |126| | 7 | Predictors: definitions, timing of measurement |127| | 8 | Sample size: how determined |128| | 9 | Missing data: handling strategy |129| | 10 | Statistical methods: model building, selection, internal validation |130| | 11 | Risk groups: how created if applicable |131| **Results** | 12 | Participants: flow diagram with numbers |132| | 13 | Model development: participant characteristics |133| | 14 | Model specification: coefficients, hazard ratios, etc. |134| | 15 | Model performance: discrimination, calibration |135| | 16 | Model updating: if applicable |136| **Discussion** | 17 | Limitations |137| | 18 | Interpretation: clinical use, comparison to existing models |138| | 19 | Implications for practice and future research |139| **Other** | 20 | Supplementary information: full model available |140| | 21 | Funding |141142### TRIPOD Study Types143144| Type | Description | Key Reporting |145|------|-------------|---------------|146| 1a | Development only | Internal validation required |147| 1b | Development + validation (same data, random split) | Report both sets |148| 2a | Development + validation (non-random split, e.g., temporal) | Specify split method |149| 2b | Development + validation (external data) | Describe both populations |150| 3 | Validation only (existing model) | Full model specification needed |151| 4 | Model updating | Original model + updates |152153### TRIPOD Critical Items for ML Models154155| Item | Requirement |156|------|-------------|157| Full model | Provide all coefficients/model specification or code |158| Internal validation | Cross-validation or bootstrap |159| Discrimination | AUROC with 95% CI |160| Calibration | Calibration plot, slope, intercept |161| Clinical utility | Decision curve analysis (recommended) |162| Missing data | Report approach and proportion missing |163| Sample size | Events per variable ratio |164165---166167## TRIPOD+AI: AI/ML Prediction Models168169Extension for studies using artificial intelligence/machine learning methods.170171### Additional TRIPOD+AI Items172173| Category | Item | Requirement |174|----------|------|-------------|175| **Data** | Preprocessing | Detail all transformations, normalization |176| | Features | Feature selection/engineering methods |177| | Class imbalance | How handled |178| **Model** | Architecture | Full description of model structure |179| | Hyperparameters | Values used and tuning approach |180| | Training | Optimization algorithm, stopping criteria |181| | Software | Libraries, versions, random seeds |182| **Validation** | Splits | Exact split method, stratification |183| | Leakage | Steps to prevent data leakage |184| | Uncertainty | Confidence intervals via bootstrap/CV |185| **Interpretability** | Explainability | SHAP, feature importance, etc. |186| **Reproducibility** | Code | Availability of code and data |187188---189190## STARD: Diagnostic Accuracy191192**STAndards for Reporting of Diagnostic accuracy studies**193194Use when evaluating a test/marker's ability to distinguish disease states.195196### Key STARD Elements197198| Element | Requirement |199|---------|-------------|200| Index test | Fully describe the test being evaluated |201| Reference standard | Gold standard for true disease status |202| Participants | Spectrum of disease severity included |203| Flow diagram | All participants accounted for |204| 2×2 table | TP, FP, TN, FN counts |205| Metrics | Sensitivity, specificity, LR+, LR-, with CIs |206| Thresholds | How cutoffs were determined |207208---209210## Reporting Metrics211212### For Association Studies (STROBE)213214| Metric | What to Report |215|--------|----------------|216| Effect estimate | OR, RR, HR, mean difference |217| Precision | 95% confidence interval |218| P-value | Exact value (not "<0.05") |219| Crude and adjusted | Both estimates |220| Confounders | List all variables in adjusted model |221222**Example:**223> Mortality was higher in the exposed group (adjusted HR 1.45, 95% CI 1.12–1.88, p=0.005) after adjustment for age, sex, SOFA score, and Charlson comorbidity index.224225### For Prediction Models (TRIPOD)226227| Metric | What to Report |228|--------|----------------|229| Discrimination | AUROC (95% CI), AUPRC if imbalanced |230| Calibration | Calibration plot, slope, intercept |231| Overall | Brier score |232| Classification | Sensitivity, specificity at chosen threshold |233| Clinical utility | Net benefit at threshold range (decision curve) |234235**Example:**236> The model demonstrated good discrimination (AUROC 0.82, 95% CI 0.78–0.86) and adequate calibration (slope 0.94, intercept -0.12). Decision curve analysis showed net benefit over treating all/none for threshold probabilities between 10% and 40%.237238---239240## Tables and Figures Checklist241242### Table 1: Baseline Characteristics243244- [ ] Stratified by exposure/outcome group245- [ ] Continuous: mean (SD) or median (IQR) based on distribution246- [ ] Categorical: n (%)247- [ ] Missing data: n (%) per variable248- [ ] Standardized mean differences (for propensity studies)249250### Flow Diagram251252- [ ] Initial population screened253- [ ] Excluded at each step with counts and reasons254- [ ] Final analytic sample255- [ ] Lost to follow-up (if applicable)256257### Results Table258259- [ ] Crude and adjusted estimates260- [ ] 95% confidence intervals261- [ ] P-values262- [ ] Number of events and total N263264### Prediction Model265266- [ ] Calibration plot267- [ ] ROC curve with AUC and CI268- [ ] Model coefficients or code availability269- [ ] Performance in validation set270271---272273## Journal-Specific Requirements274275Many journals require:276- Completed checklist uploaded as supplementary material277- Statement of adherence in methods section278- Data availability statement279- Code availability statement280281**Check target journal's author guidelines.**282283---284285## Common Reporting Deficiencies286287| Deficiency | Frequency | Impact |288|------------|-----------|--------|289| Missing flow diagram | Very common | Cannot assess selection bias |290| No missing data info | Very common | Cannot assess bias |291| No confidence intervals | Common | Cannot assess precision |292| Validation not reported | Common (ML) | Cannot assess generalizability |293| Model not reproducible | Common (ML) | Cannot implement or verify |294| Crude estimates missing | Common | Cannot assess confounding |295| Subgroup analyses post-hoc | Common | Inflated false positives |296297---298299## Quick Reference: Minimum Reporting300301### Observational Study (STROBE + RECORD)3023031. Study design in title3042. Database name, version, time period3053. Eligibility criteria with codes3064. Flow diagram with numbers3075. Variable definitions (codes)3086. Missing data extent and handling3097. Crude and adjusted estimates with CIs3108. Sensitivity analyses3119. Limitations section addressing bias312313### Prediction Model (TRIPOD)3143151. Development or validation study in title3162. Outcome and predictor definitions with timing3173. Sample size and events per variable3184. Missing data handling3195. Model specification (full coefficients or code)3206. Internal validation method3217. Discrimination (AUROC with CI)3228. Calibration (plot + metrics)3239. External validation if applicable32410. Limitations and clinical applicability325326---327328## Resources329330| Guideline | Website | Checklist |331|-----------|---------|-----------|332| STROBE | strobe-statement.org | 22-item checklist |333| RECORD | record-statement.org | STROBE + 13 items |334| TRIPOD | tripod-statement.org | 22-item checklist |335| TRIPOD+AI | In development | Extended ML items |336| STARD | stard-statement.org | 30-item checklist |337| CONSORT | consort-statement.org | 25-item checklist |338| PRISMA | prisma-statement.org | 27-item checklist |339340**EQUATOR Network** ([equator-network.org](https://www.equator-network.org/)): Central repository for all reporting guidelines.