Universal Validator
Purpose
Produce deterministic, reviewable validation evidence (reports + JSON + logs) for a repo, plugin, or skill.
Overview
- Phase prompts live in
{baseDir}/agents/ - Procedures live in
{baseDir}/references/ - Deterministic runner + profiles live in
{baseDir}/scripts/
Prerequisites
- Python 3.11+
- Your repo validators and tests installed
Instructions
- Choose a target (repo/plugin/skill).
- Run the deterministic suite with a profile:
python {baseDir}/scripts/run_validator_suite.py \
--target . \
--project example \
--out reports/example \
--profile default
- Optionally run tests:
python {baseDir}/scripts/run_validator_suite.py \
--target . \
--project example \
--out reports/example \
--profile default \
--run-tests
Output
reports/<project>/<timestamp>/summary.jsonreports/<project>/<timestamp>/report.mdreports/<project>/<timestamp>/checks/*.log
Error Handling
- If schema checks fail, fix structure before running tests.
- Treat logs as ground truth; update narratives to match evidence.
Examples
python {baseDir}/scripts/run_validator_suite.py --target . --project pr-1234 --out reports/pr-1234 --profile default
Resources
- Agents:
{baseDir}/agents/ - Procedures:
{baseDir}/references/ - Scripts:
{baseDir}/scripts/