How do I install the Eval Triggers skill?

Run npx skillmds@latest add datocms/eval-triggers in your terminal (requires Node.js), paste this page's agent-chat prompt into Claude, Cursor, or any MCP-connected agent, or download the SKILL.md file and copy it into your agent's skills directory.

What does the Eval Triggers skill do?

Run the trigger evaluation pipeline — classify, analyze, and optionally compare against a baseline. Only run when explicitly asked — evals are expensive. It is listed under DevOps & Infra on SkillMD.

Is Eval Triggers safe to use?

This skill has not completed SkillMD's automated safety review yet. SkillMD never runs a skill's scripts for you; review the SKILL.md before installing.

Which AI agents work with Eval Triggers?

This skill is tagged as working with Claude Code, Claude.ai, OpenAI Codex. SKILL.md is an open format, so most agents that read a skills directory can load it too.

Is Eval Triggers free to use?

Yes. Installing skills from SkillMD is free, and the skill stays under its author's original license.

Who published Eval Triggers?

datocms (@datocms) published this skill. Their other Agent Skills are listed on their SkillMD profile.

Eval Triggers by datocms — Agent Skill

Name: Eval Triggers
Author: datocms

File contents

IMPORTANT: This skill is expensive (makes many LLM API calls). Only run when the user explicitly asks for it. Never run proactively.

Before running, ask the user which eval source to run unless they already specified it in $ARGUMENTS:

Claude Code only — uses run_trigger_eval.py --track claude
Codex only — uses run_trigger_eval.py --track codex
Both — runs both tracks sequentially

Step 1 — Classify:

The runner writes to the canonical layout at evals/results/trigger/<skill>/<track>/<source>/results.json. You do not pass an output directory.

For Claude Code:

python3 evals/scripts/run_trigger_eval.py --track claude --source combined

For Codex:

python3 evals/scripts/run_trigger_eval.py --track codex

Step 2 — Analyze:

python3 evals/scripts/analyze_trigger_results.py \
  --track claude --source frontmatter

This writes the cross-skill summary to evals/results/trigger/_summary/<track>/<source>/summary.{json,md}. Report:

The gate verdict (pass/fail at F1 ≥ 0.90, with the list of skills below threshold).
Per-skill precision, recall, F1.
Any noteworthy false negatives / positives.

Step 3 — Compare (optional):

If the user provides a baseline summary or you have one from a previous run:

python3 evals/scripts/compare_trigger_runs.py \
  --baseline <baseline-summary>.json \
  --candidate evals/results/trigger/_summary/<track>/<source>/summary.json \
  --output-markdown local/comparison.md

Summarize regressions and improvements. For ad-hoc baselines that should not be committed, store them under local/ (gitignored).

Frequently asked questions

Eval Triggers