Plugins
12 pluginscurated
Run Agent Evaluation
Sets up evaluation framework, runs benchmarks, and produces comparative analysis of agent performance.
9 skills · plugin
@microsoft
Microsoft 365 Agents Toolkit
Toolkit for building and evaluating Microsoft 365 Copilot declarative agents — scaffolding, JSON manifest development, capability configuration, and eval workflows.
6 skills · plugin
curated
ML Model Lifecycle
Train, evaluate, and deploy a production ML system with monitoring.
10 skills · plugin
curated
Design Pricing Strategy
Design a pricing strategy by analyzing market, evaluating financial impact, and recommending pricing models.
6 skills · plugin
curated
Monetization to Billing Pipeline
For product managers and finance ops: brainstorm strategies, evaluate financial impact, then execute billing workflows.
4 skills · plugin
curated
Analyze and Prioritize Feature Requests
Install this pack to categorize, evaluate, and prioritize customer feature requests against product goals.
3 skills · plugin
@owl-listener
Prototyping Testing
Prototyping and testing skills: wireframe specs, usability heuristics, heuristic evaluations, accessibility audits, A/B test design, and benchmark analysis.
8 skills · plugin
curated
Google Cloud Well-Architected
For architects evaluating Google Cloud workloads against the Well-Architected Framework pillars: reliability, cost optimization, and operational excellence.
6 skills · plugin
@owl-listener
Visual Critique
Visual critique skills: hierarchy analysis, brand consistency checks against mood/voice/tokens, composition evaluation, and typography audits — with a /critique-screen command that compiles a prioritised fix list.
7 skills · plugin
@alirezarezvani
Ra Qm Team
14 regulatory affairs & quality management skills for HealthTech/MedTech: ISO 13485 QMS, MDR 2017/745, FDA 510(k)/PMA, GDPR/DSGVO, ISO 27001 ISMS, CAPA management, risk management, clinical evaluation, SOC 2 compliance.
10 skills · plugin
@alirezarezvani
Agenthub
Multi-agent collaboration — spawn N parallel subagents that compete on code optimization, content drafts, research approaches, or any task that benefits from diverse solutions. 7 slash commands (/hub:init, /hub:spawn, /hub:status, /hub:eval, /hub:merge, /hub:board, /hub:run), agent templates, DAG-based orchestration, LLM judge mode, message board coordination.
8 skills · plugin
@alirezarezvani
Engineering Team
32 engineering skills: architecture, frontend, backend, fullstack, QA, DevOps, security, AI/ML, data engineering, Playwright (9 sub-skills), self-improving agent, Stripe integration, TDD guide, tech stack evaluator, Google Workspace CLI, a11y audit (WCAG 2.2), Azure cloud architect, GCP cloud architect, security pen testing, Snowflake development, adversarial-reviewer, ai-security, cloud-security,
16 skills · plugin
Results for “eval”
809 skillsEval Pipeline
Design automated evaluation pipelines for LLM and agent systems — combining deterministic checks, statistical metrics, and LLM-as-judge scoring into repeatable, CI-integrated eval suites. Load when the user asks to set up automated evals, design an eval pipeline, integrate evals into CI/CD, create an eval suite, do eval-driven development, or says "automate my evals", "CI eval integration", "evaluation pipeline", "continuous evaluation", "monitoring eval quality", "set up regression testing for my agent". Sub-skill of eval-output orchestrator.
3 · bundle
Phoenix Evals
Build and run evaluators for AI/LLM applications using Phoenix, covering error analysis, custom evaluators, experiments, and production monitoring.
36.2k · bundle
Evaluation
Build evaluation frameworks for agent systems, covering rubric design, test set creation, and automated evaluation pipelines.
42.4k
Scholar Evaluation
Scholar Evaluation
0 · bundle
Eval Harness
Formal evaluation framework for Codex sessions implementing eval-driven development (EDD) principles
1
Ivx Cf Sid Evals
PASS/FAIL eval rubrics and alignment loops for Sid Orchestra. Use when the user says sid evals, @sid-evals, grade this, eval gate, alignment score, or wants to stop AI slop with evaluation gates.
0 · bundle
More results
Outcome Eval
Outcome Eval
18 · bundle
Eval
Evaluate and rank agent results by metric or LLM judge for an AgentHub session.
20.4k
Acceptance Eval
Acceptance Eval
18 · bundle
Eval Harness
Formal evaluation framework for Claude Code sessions implementing eval-driven development (EDD) principles
0
Eval Harness
Formal evaluation framework for Claude Code sessions implementing eval-driven development (EDD) principles
0
Evaluation
Imported skill evaluation from anthropic
3
Agent Platform Eval Flywheel
Measures and improves the quality of AI models and agents on Google Cloud using the Eval Quality Flywheel methodology, including dataset creation, metric selection, failure analysis, and iterative improvement.
14.4k · bundle
Eval Harness
Formal evaluation framework for Claude Code sessions implementing eval-driven development (EDD) principles
1
Eval Harness
Formal evaluation framework for Claude Code sessions implementing eval-driven development (EDD) principles
0
Eval Harness
Formal evaluation framework for Claude Code sessions implementing eval-driven development (EDD) principles.
1
Eval Rubric Design
Design structured evaluation rubrics for scoring LLM and agent outputs — defining quality dimensions, scoring scales, hard gates, score descriptions, and edge cases. Load when the user asks to create an eval rubric, define evaluation criteria, design scoring dimensions, write an eval spec, or says "what should I evaluate", "design a rubric", "create eval criteria", "define quality dimensions", "evaluation rubric for", "how do I measure quality of". Sub-skill of eval-output orchestrator.
3 · bundle
Evals Run
Workflow skill for evals run.
542
Evaluation
Build evaluation frameworks for agent systems
6
Nemo Evaluator Plugin
Run evaluation tasks against a NeMo Platform server using the Evaluator plugin CLI and Python SDK.
2.2k · bundle
Eval
Evaluate everything the PA agent manages — tasks, skills, PA network health, billing, calendar connections, and memory quality. Use when: owner asks for an evaluation, wants to know what's working and what isn't, or requests a performance report. Combines supervisor status with quality scoring.
6
Eval
Evaluate and rank agent results by metric or LLM judge for an AgentHub session. Use when the user runs /hub:eval or asks to score, compare, or pick a winner among completed AgentHub agents.
11
Ivx Sid Evals
PASS/FAIL eval rubrics and alignment loops for Sid Orchestra (global). Use when the user says sid evals, @sid-evals, grade this, eval gate, alignment score, or wants to stop AI slop. Works in any workspace; bootstraps EVALS.md from ~/.cursor/skills/sid-orchestra/templates if missing.
0 · bundle
Eval
Evaluate and rank agent results by metric or LLM judge for an AgentHub session. Use when the user runs /hub:eval or asks to score, compare, or pick a winner among completed AgentHub agents.
2
Eval
Evaluate and rank agent results by metric or LLM judge for an AgentHub session.
0
Self Eval
Honestly evaluate AI work quality using a two-axis scoring system with mandatory devil's advocate reasoning and cross-session anti-inflation detection.
20.4k
Eval Run
Launches a model evaluation batch with parameter collection, pre-flight checks, execution, and post-run analysis for interactive or foreground runs.
0
Eval
Evaluate and rank agent results by metric or LLM judge for an AgentHub session.
3
L Eval
Benchmarks long-context language models across 20 sub-tasks spanning 3k–200k tokens, covering retrieval, reasoning, summarization, and instruction understanding, with exact-match accuracy as the primary metric.
3
Overnight Eval
Launches long-running evaluation batches in isolated tmux sessions with pre-flight verification, monitoring, and post-flight analysis for unattended runs.
0
Eval Harness
Provides a formal evaluation framework for Claude Code sessions, implementing eval-driven development (EDD) principles to define pass/fail criteria, measure reliability with pass@k metrics, and create regression test suites.
226k
Evm
Read-only EVM client: wallets, tokens, gas across 8 chains.
0 · bundle
Evm
Read-only EVM client: wallets, tokens, gas across 8 chains.
0 · bundle
Edd
Defines a structured eval-driven development workflow with define, implement, and verify phases, including capability, behavior, and non-functional checks, plus optional swarm mode for parallel evaluation.
54 · bundle
Eval Output
Orchestrator for the eval-output skill suite — evaluate LLM and agent outputs for quality, accuracy, helpfulness, and safety using structured rubrics and LLM-as-judge techniques. Load when the user says "evaluate this output", "score this response", "run an eval", "LLM as judge", "evaluate agent output", "how good is this response", "rate this answer", "eval this", or provides an LLM output that should be assessed for quality. Single entry point for all output evaluation workflows.
3 · bundle
Agent Eval
Compare coding agents head-to-head on reproducible tasks with pass rate, cost, time, and consistency metrics.
226k