SkillMD SkillMD
light-dark-mode
Profile My skills Saved Collections Edit profile Submit a skill

← all plugins

Run Agent Evaluation

curated by SkillMD · plugin · 9 skills

Sets up evaluation framework, runs benchmarks, and produces comparative analysis of agent performance.

Install the whole plugin (CLI)
npx skillmds add affaan-m/agent-eval npx skillmds add alirezarezvani/run npx skillmds add affaan-m/verification-loop npx skillmds add dvcrn/aice npx skillmds add sakamoto-family-smile/eval-harness npx skillmds add jorcan/agents npx skillmds add mhassan0000/agent-eval npx skillmds add mhassan0000/santa-method npx skillmds add mhassan0000/skill-comply
⬇ Download

Skills in this plugin

  1. ▌
    agent-eval · affaan-m
    Compare coding agents head-to-head on reproducible tasks with pass rate, cost, time, and consistency metrics.
    226k
    repo stars
  2. ▌
    run · alirezarezvani
    Execute the full AgentHub competition lifecycle in a single command: initialize, capture baseline, spawn agents, evaluate results, and merge the winner.
    20.4k
    repo stars
  3. ▌
    verification-loop · affaan-m
    Runs a multi-phase verification pipeline including build, type-check, lint, tests, security scan, and diff review to ensure code quality before creating a PR.
    226k
    repo stars
  4. ▌
    aice · dvcrn bundle
    Tracks bidirectional confidence scores across five domains (TECH, OPS, JUDGMENT, COMMS, ORCH) for agents and users, with triggers, anti-patterns, and pool scoring per runtime.
    32
    repo stars
  5. ▌
    eval-harness · sakamoto-family-smile
    Formal evaluation framework for Claude Code sessions implementing eval-driven development (EDD) principles.
    0
    repo stars
  6. ▌
    agents · jorcan bundle
    Evaluates execution transcripts and output files against a list of expectations, assigning pass/fail verdicts with cited evidence and critiquing the assertions themselves.
    0
    repo stars
  7. ▌
    agent-eval · mhassan0000
    Compares coding agents head-to-head on reproducible tasks, measuring pass rate, cost, time, and consistency.
    1
    repo stars
  8. ▌
    santa-method · mhassan0000
    Runs a multi-agent adversarial verification loop where two independent reviewers must both pass before output ships, with a fix cycle for convergence.
    1
    repo stars
  9. ▌
    skill-comply · mhassan0000 bundle
    Measures whether coding agents actually follow skills, rules, or agent definitions by generating test scenarios, running agents, and classifying tool calls to report compliance rates.
    1
    repo stars