Documentation Audit SOP
Assess benchmark documentation completeness against established standards: BetterBench 46-criterion framework, Datasheets for Datasets, and Data Statements for NLP.
Input
- benchmark_documentation: All available documentation for the benchmark (paper, README, website, datasheet)
Procedure
- Check documentation against BetterBench 46 criteria
- Check against Datasheets for Datasets questions
- Identify critical missing information
- Assess reproducibility from documentation alone
- Grade overall documentation quality
Output
Documentation completeness score with per-criterion pass/fail and prioritized gaps.
Source: yogsoth-ai/knowledge-acquisition — distributed by TomeVault.