Statistical Theory Analysis

Analyze theoretical properties of statistical methods under the formal formulation: identifiability, bias, variance, consistency, asymptotics, coverage, error bounds, robustness, and limitations.

gabrielmoreira Updated 17 repo stars

File contents

Statistical Theory Analysis

Overview

Use this skill after method proposal and before final experimental comparison. Theory is required as a stage even if the final output is a simulation paper.

Theory Outputs

Depending on the topic, provide:

  • Identifiability argument
  • Bias or variance calculation
  • Consistency statement
  • Asymptotic distribution
  • Coverage or calibration argument
  • Risk or error bound
  • Robustness analysis
  • Sensitivity or impossibility result
  • Counterexample showing failure outside assumptions

Theorem Template

## Proposition
Under assumptions A1-Ak, method M satisfies ...

## Proof Sketch
1. ...
2. ...
3. ...

## Interpretation
This predicts that ...

## Limitations
The result does not cover ...

Experimental Predictions

Every theoretical claim should produce an empirical prediction when possible:

  • Direction of metric change
  • Condition under which the method should improve
  • Stress condition under which it should fail
  • Baseline it should outperform

gabrielmoreira/agent-skills-mirror/tree/main/mirrors/repos/aiming-lab@AutoResearchClaw/external/agents/stat_research_agent/skills/statistical-theory-analysis commit 2e2dd052e7

Frequently asked questions

npx skillmds@latest add gabrielmoreira/statistical-theory-analysis