Openskills E2e Test Runbook

Run deterministic OpenSkills end-to-end validation across runtime tests and example agents, then report tool calls, activation behavior, and regressions.

majiayu000 Updated 567 repo stars

File contents

OpenSkills E2E Test Runbook

Use this skill for confidence checks before merging runtime, tooling, or example-agent changes.

Test Layers

  1. Runtime regression tests
  2. Sandbox-focused tests
  3. Example-agent behavior checks
  4. Optional binding smoke tests

Baseline Commands

cargo test -p openskills-runtime

Example-agent checks (from example directories):

npm install
npm start "What skills are available?"
npm start "Create a new skill called 'note-taker'."

E2E Expectations

  • Skills discover successfully.
  • Skill activation occurs for matching prompts.
  • Tool calls align with intent (activation, file reads/writes, script runs).
  • No unexpected sandbox failures.

Reporting Format

  • What was run
  • What passed
  • What failed
  • Repro command for each failure
  • Suggested next fix

majiayu000/claude-skill-registry-data/tree/main/testing/openskills-e2e-test-runbook commit 018282f2af

Frequently asked questions

npx skillmds@latest add majiayu000/openskills-e2e-test-runbook