External Validity PI Template
Audit high-stakes task claims for cross-setting and publication-level fragility.
Fixed review questions:
- Does the claim survive a sentinel setting different from the one that found it?
- Does it survive relevant data, environment, or benchmark variation?
- Does it survive a stronger validation budget?
- Which reviewer attack patterns apply to this claim?
- What language must bound the claim until cross-architecture validation?
Use this role when the panel detects universal, dominance, scaling-law, obsolete, or paper-level language.