# Run Tests > Verify plugins marketplace structure, version consistency, and JSON/frontmatter validity via subagent - Skill: `hiroro-work/run-tests` (Agent Skill) - Install (CLI): `npx skillmds@latest add hiroro-work/run-tests` - Raw SKILL.md: https://api.skillmd.com/api/skills/hiroro-work/run-tests/raw - Safety review: pending - Works with: Claude Code, Claude.ai, OpenAI Codex - Category: Coding & Dev Tools - Author: hiroro-work (https://skillmd.com/u/hiroro-work) - Updated: 2026-09-10 - Page: https://skillmd.com/skills/hiroro-work/run-tests --- # Test Runner This project is a Claude Code plugins marketplace. "Tests" here means verifying the repository structure, version consistency, JSON syntax, and SKILL.md/agent frontmatter validity. ## Process 1. Determine test scope: - If `$ARGUMENTS` contains `--base-commit `: run `git diff --name-only ` to get changed files (includes committed, staged, and unstaged changes) - Otherwise: run `git diff --name-only HEAD` to detect changed files (if HEAD is unavailable or no changed files detected, run full verification) - Any change touching `.claude-plugin/marketplace.json`, `plugins/**`, `skills/**`, or `.claude-plugin/plugin.json` should trigger full verification. If only unrelated files (e.g. `README.md`, `CHANGELOG.md`, `docs/**`) changed, still run full verification 2. Spawn a subagent (Agent tool, subagent_type: `general-purpose`, `model: sonnet`) to execute verification — pass `sonnet` as the `Agent` tool's `model` parameter. 3. Return the subagent's structured summary to the caller ## Subagent Instructions > Verify this Claude Code plugins marketplace repository. Perform the following checks **yourself, directly, in this agent, using Read/Bash/Glob** — do not spawn a nested `Agent` and do not dispatch any `Skill()`. Re-delegation is an observed failure mode: the executor stops to wait on its child and returns no verdict, which the caller then treats as a parse failure. Return a structured summary. > > ### Checks > > 1. **Load marketplace manifest**: Read `.claude-plugin/marketplace.json`. Extract the `plugins` array. For each plugin, capture `name`, `source`, `skills` (optional), and `version`. > > 2. **Skill entity existence**: Verify each `skills/*/` directory contains `SKILL.md`. > > 3. **Plugin source directory structure**: For each plugin in marketplace.json, dispatch by `source` prefix: > - **If `source` starts with `./skills/`** (direct-skill plugin): verify `/SKILL.md` exists, `skills: ["./"]` is present, and `/.claude-plugin/plugin.json` exists with a `name` equal to the marketplace entry's `name` > - **If `source` starts with `./plugins/`** (wrapper plugin): verify `/` exists; if `/skills/` exists, each entry under it must be **either** a symlink (use `readlink`) resolving to an existing `skills//SKILL.md` **or** a real directory containing `SKILL.md`; if `/agents/` exists, each `.md` file must have YAML frontmatter; `/.claude-plugin/plugin.json` must exist with a `name` equal to the marketplace entry's `name` > - **Real directories are expected, not a defect.** Do **not** report a real directory as a broken/missing symlink. Content equality between a real-directory copy and its canonical `skills//` is **out of scope here**: `verify-bundle-sync` owns that check > - **Additionally, for wrapper bundles** (wrapper plugin with `skills` array of specific paths like `./skills/`): verify each path in `skills` array resolves to an existing `skills//SKILL.md`, AND verify the set of paths matches the set of entries under `/skills/` (each entry has a corresponding `skills` entry, and vice versa — detect drift in either direction) > > 4. **Version consistency**: For each plugin, if `/.claude-plugin/plugin.json` declares a `version`, verify it matches marketplace.json. A manifest with no `version` field is correct, not a defect — `marketplace.json` is the single version source, and the manifest inherits it. Only `plugins/caffeinate` and `plugins/translate` currently declare one. > > 5. **JSON syntax**: Validate `.claude-plugin/marketplace.json` and every `plugins/*/.claude-plugin/plugin.json` and `skills/*/.claude-plugin/plugin.json` with `jq empty`. > > 6. **Frontmatter presence**: Verify each `skills/*/SKILL.md` and each agent file (`plugins/*/agents/*.md`) starts with `---` on the first line (YAML frontmatter). > > 7. **Cross-member directive identity**: for each path in the `dev-workflow-bundle` plugin's `skills` array, verify `/SKILL.md` contains a line that is exactly `## Dispatch authorization` (an anchored whole-line match — a heading carrying extra text, e.g. `## Dispatch authorization (caller-side)`, does not count and is reported as missing), and that that section's body — the lines between that heading and the next `## ` heading (or end of file, if it is the last `## ` section), with leading and trailing blank lines trimmed — is identical character-for-character, internal whitespace included, across every member, taking the **first member that has the section** as the reference body. `Read` each member's section and compare the delimited bodies directly — the directive sits in each member's preamble (within the first ~170 lines of every current member), so pass `Read` an `offset`/`limit` window around the heading instead of reading whole files. The sections that *follow* the directive differ per member, so comparing anything wider than the delimited body reports false divergence. Report any member that is missing the section or whose body diverges. > > ### Return Format > > Return a structured summary with one of three statuses: > > **Status: SUCCESS** > - All checks passed > - Per-check summary: counts (e.g., "15 skills verified, 13 plugins, 0 version mismatches") > > **Status: TEST_FAILED** > - Per-check results with failures highlighted > - For each failure: > - The specific check that failed > - File path and what was expected vs actual > - Remediation hint (e.g., "recreate symlink", "bump version in plugin.json") > - Keep the summary concise but include enough detail to fix without re-running > > **Status: EXECUTION_ERROR** > - Command that failed to execute (e.g., `jq` missing, marketplace.json unreadable) > - Error output > - This status is for infrastructure/environment errors, not verification failures