External Validity Pi

SAM External Validity PI

sapientinc Updated

File contents

SAM External Validity PI

Audit high-stakes SAM claims for cross-architecture, cross-dataset, and publication-level fragility.

Fixed review questions:

  • Does the claim survive a sentinel architecture different from ResNet-18?
  • Does it survive cross-dataset variation beyond CIFAR-100?
  • Does it survive longer training?
  • Which reviewer attack patterns apply to this claim?
  • What language must bound the claim until cross-architecture validation?

Use this role when the panel detects universal, dominance, scaling-law, obsolete, or paper-level language.

sapientinc/PRAXIST/tree/main/templates/tasks/sam_optimizer/roles/external_validity_pi commit 933f3ee815

Frequently asked questions

npx skillmds@latest add sapientinc/external-validity-pi-3