Phira Limitations Contract

Standard format for limitations, threats-to-validity, and critical risks with decisive tests.

phira-ai Updated

File contents

Use this skill whenever you are producing or reviewing limitations for:

  • a paper summary
  • a research plan
  • an implementation
  • an experiment/evaluation

Output contract

Always produce a "Limitations" section with 5-12 items.

Each item MUST include:

  • Limitation: one sentence.
  • Why it matters: one sentence.
  • Severity: Block | Risky | Minor.
  • Decisive test: the smallest test/experiment/check that would validate or falsify the concern.
  • Mitigation or acceptance condition: what change (or explicit acceptance) would resolve it.

Paper-specific requirements

Include (if applicable):

  • dataset/evaluation threats (leakage, selection bias, confounding)
  • generalisation/robustness gaps
  • compute/budget comparability
  • missing ablations / baseline fairness
  • unclear assumptions or underspecified details

Implementation-specific requirements

Include (if applicable):

  • default drift / gating risk
  • reproducibility risks (seeds, versions, configs)
  • silent failure modes and missing invariants
  • performance regressions and measurement pitfalls

phira-ai/phira/tree/main/skills/phira-limitations-contract commit e91c55a623

Frequently asked questions

npx skillmds@latest add phira-ai/phira-limitations-contract