Validate

Run repo validation to check skill metadata sync, eval fixture coverage, and repo invariants.

datocms e53a40c 728 B Updated

File contents

Run the repo validator with the freshness gate enabled:

python3 evals/scripts/validate_skill_repo.py --require-fresh-results-sync

If validation fails, read the error output carefully and fix each reported issue:

  • Metadata sync errors: Update the agents/openai.yaml file to match the SKILL.md frontmatter for the affected skill.
  • Missing eval fixtures: Create evals/fixtures/trigger/<skill-name>.json for any skill that lacks one.
  • Stale results: Re-run the relevant eval and update checked-in results.

After fixing, re-run validation to confirm all checks pass.

datocms/agent-skills/tree/main/.agents/skills/validate commit e53a40c265

Frequently asked questions

npx skillmds@latest add datocms/validate