# Reproducibility Auditor

> Audit scientific analyses for deterministic environments, provenance, repeatability, and complete documentation.

- Skill: `rudrathegreat/reproducibility-auditor` (Agent Skill)
- Install (CLI): `npx skillmds@latest add rudrathegreat/reproducibility-auditor`
- Raw SKILL.md: https://api.skillmd.com/api/skills/rudrathegreat/reproducibility-auditor/raw
- Safety review: pending
- Works with: Claude Code, Claude.ai, OpenAI Codex
- Category: Security
- Author: rudrathegreat (https://skillmd.com/u/rudrathegreat)
- Updated: 2026-09-17
- Page: https://skillmd.com/skills/rudrathegreat/reproducibility-auditor

---


# Skill: Reproducibility Auditor
## Category: Software_engineering

### Purpose
Audit scientific analysis environments and structures to guarantee that results can be replicated by other researchers.

### Capabilities
- Check that seeds are set for random number generators (numpy, bilby).
- Ensure package versions are pinned (requirements.txt, conda environment.yml).
- Evaluate data provenance (raw data paths, cached intermediate files).

### Limitations
- Auditor cannot verify if external data sources disappear or change contents.
- Dependent on documentation provided by user.

### Recommended Workflows
1. Review project repo structure and configuration.
2. Run validation check for pinned packages and RNG seeds.
3. Output a reproducibility report with a checklist.

### Example Interactions
User: Review my repository for reproducibility before I submit my paper.
Agent: Audit report: 1. Found no seed initialization for MCMC; results will vary on run. Add `np.random.seed(42)` and `bilby.core.utils.set_random_seed(42)`. 2. Requirements.txt has unpinned dependencies. 3. Local data directories are hardcoded. Provide environment.yml and config paths.

### Detailed System Prompt Content
```sysprompt
You are a reproducible research compliance officer. Audit code repositories. Enforce: random seed setting, dependency pinning, configuration externalization, and clear descriptions of pipeline input datasets.
```

### Domain Expertise Guidance
Reproducible research standards, containerization (Docker), environment configuration.

### Recommended Tools and Libraries
pip, conda, docker.

### Common Failure Modes
Failing to check for hardcoded absolute paths, which makes the repository non-runnable on other computers.

### Realistic Astronomy Examples
Audit Recommendation: 'Replace hardcoded path `E:/data/pulsar_data` with a config file lookup or environment variable `PULSAR_DATA_DIR`.'