Plugins

12 plugins

Run Agent Evaluation

Sets up evaluation framework, runs benchmarks, and produces comparative analysis of agent performance.

9 skills · plugin

Microsoft 365 Agents Toolkit

Toolkit for building and evaluating Microsoft 365 Copilot declarative agents — scaffolding, JSON manifest development, capability configuration, and eval workflows.

6 skills · plugin

ML Model Lifecycle

Train, evaluate, and deploy a production ML system with monitoring.

10 skills · plugin

Design Pricing Strategy

Design a pricing strategy by analyzing market, evaluating financial impact, and recommending pricing models.

6 skills · plugin

Monetization to Billing Pipeline

For product managers and finance ops: brainstorm strategies, evaluate financial impact, then execute billing workflows.

4 skills · plugin

Analyze and Prioritize Feature Requests

Install this pack to categorize, evaluate, and prioritize customer feature requests against product goals.

3 skills · plugin

Prototyping Testing

Prototyping and testing skills: wireframe specs, usability heuristics, heuristic evaluations, accessibility audits, A/B test design, and benchmark analysis.

8 skills · plugin

Google Cloud Well-Architected

For architects evaluating Google Cloud workloads against the Well-Architected Framework pillars: reliability, cost optimization, and operational excellence.

6 skills · plugin

Visual Critique

Visual critique skills: hierarchy analysis, brand consistency checks against mood/voice/tokens, composition evaluation, and typography audits — with a /critique-screen command that compiles a prioritised fix list.

7 skills · plugin

@alirezarezvani

14 regulatory affairs & quality management skills for HealthTech/MedTech: ISO 13485 QMS, MDR 2017/745, FDA 510(k)/PMA, GDPR/DSGVO, ISO 27001 ISMS, CAPA management, risk management, clinical evaluation, SOC 2 compliance.

10 skills · plugin

@alirezarezvani

Multi-agent collaboration — spawn N parallel subagents that compete on code optimization, content drafts, research approaches, or any task that benefits from diverse solutions. 7 slash commands (/hub:init, /hub:spawn, /hub:status, /hub:eval, /hub:merge, /hub:board, /hub:run), agent templates, DAG-based orchestration, LLM judge mode, message board coordination.

8 skills · plugin

@alirezarezvani

Engineering Team

32 engineering skills: architecture, frontend, backend, fullstack, QA, DevOps, security, AI/ML, data engineering, Playwright (9 sub-skills), self-improving agent, Stripe integration, TDD guide, tech stack evaluator, Google Workspace CLI, a11y audit (WCAG 2.2), Azure cloud architect, GCP cloud architect, security pen testing, Snowflake development, adversarial-reviewer, ai-security, cloud-security,

16 skills · plugin

Results for “eval”

809 skills

Instrument LLM applications with Langfuse for tracing, prompt versioning, evaluation, and dataset management across Python and JavaScript SDKs.

Summarize a contributor's Git history, a provided work log, or both into a concise, review-friendly self-evaluation for quarterly, semi-annual, or promotion cycles.

Script Evaluator

从思想性、艺术性、观赏性三维度评估影视剧本并打分。适用于剧本开发质量评估、修改方向确定、项目立项前审查

Novel Evaluator

严格细致判断与评分故事文本，从市场潜力、创新属性、内容亮点维度分析质量。适用于小说初筛选、多维度评估打分

orchestra-research

Evaluating Code Models

Evaluates code generation models across HumanEval, MBPP, MultiPL-E, and 15+ benchmarks with pass@k metrics. Use when benchmarking code models, comparing coding abilities, testing multi-language support, or measuring code generation quality.

10.4k · bundle

Nemotron Retrieval Recipes

Plan, debug, tune, evaluate, export, or deploy public Nemotron embedding and reranking retrieval recipes using the current checkout.

Compare coding agents head-to-head on reproducible tasks with pass rate, cost, time, and consistency metrics.

Provides expertise in Langfuse for LLM observability, including tracing, prompt management, evaluation, and integration with LangChain, LlamaIndex, and OpenAI.

Prompt Optimizer

Creates, optimizes, and iteratively refines agent prompts, system prompts, developer prompts, and reusable prompt templates with evals.

Generates deep links to the Arize UI for traces, spans, sessions, datasets, labeling queues, evaluators, and annotation configs.

36.2k · bundle

Guides users through creating, editing, and optimizing agent skills, including drafting, testing, evaluating, and improving skill descriptions for better triggering.

lucaspmarie-a11y

Instruments LLM applications with Langfuse for tracing, observability, and evaluation, covering setup, OpenAI and LangChain integrations, and best practices.

Computes the InfoLM metric from torchmetrics for evaluating text generation against ground truth, with configurable information measures and sentence-level scoring.

Evaluates machine-generated log summaries without human-written references, using LLM judgment and dense embeddings to score relevance, informativeness, and coherence.

AI QA and evaluation specialist for quality gates. Use when the user asks to talk to Moody, requests AI evaluation, or needs regression tests for AI systems.

Tao Train Rtdetr

Train, evaluate, distill, quantize, export, and run inference for RT-DETR object detection models using NVIDIA TAO.

Architecture Designer

Design high-level system architecture, create Architecture Decision Records (ADRs), evaluate technology trade-offs, and plan for scalability.

10.4k · bundle

Instrument LLM applications with Langfuse for tracing, prompt management, evaluation, and cost tracking, including integrations with OpenAI, LangChain, and LlamaIndex.

Langsmith Observability

LLM observability platform for tracing, evaluation, and monitoring. Use when debugging LLM applications, evaluating model outputs against datasets, monitoring production systems, or building systematic testing pipelines for AI applications.

Langsmith Observability

LLM observability platform for tracing, evaluation, and monitoring. Use when debugging LLM applications, evaluating model outputs against datasets, monitoring production systems, or building systematic testing pipelines for AI applications.

Spawns multiple parallel AI agents that compete on the same task using isolated git worktrees, evaluates results, and merges the best solution.

20.4k · bundle

Manage Arize datasets and examples using the ax CLI: create, list, get, export, and append datasets for evaluation and experimentation.

36.2k · bundle

Aeon Skill Evals

Validate skill outputs against assertion manifests to detect regressions, enforce quality gates, and bootstrap starter manifests from historical runs.

Run autonomous optimization loops that iteratively improve artifacts against evaluators using hypothesis tree refinement, without overfitting.

30.2k · bundle

Create new skills, modify and improve existing skills, and measure skill performance through iterative evaluation and benchmarking.

Manages career workflows: resume review and scoring, job evaluation with apply recommendations, rubric development, content extraction from conversations, and pipeline quality audits.

Process tabular data with Polars' expression API, lazy evaluation, and parallel execution for fast in-memory analysis and pandas migration.

John Doerr Expert

Provides structured goal-setting and strategic guidance in the style of John Doerr, focusing on OKRs, execution, and team evaluation.

Evaluates the naturalness, speaker similarity, and real-time synthesis speed of a Mandarin speech cloning system across diverse practical application scenarios.

Computes the SQuAD metric using torchmetrics, given predictions and ground truth. Use when evaluating question-answering outputs with exact match and F1 scores.

construct-ai-primary

Innovation Evaluation

Use when assessing new ideas, technologies, or approaches before committing resources to them. This skill provides a framework for evaluating innovation opportunities systematically, separating genuine breakthroughs from hype.

Model Evaluation

Evaluate model quality with task-appropriate metrics and systematic error analysis. Use when: (1) comparing models, (2) analyzing failures, (3) setting go/no-go thresholds. NOT for: production monitoring implementation.

Build and evaluate machine learning models using scikit-learn for classification, regression, clustering, dimensionality reduction, and preprocessing.

30.2k · bundle

Harness Engineering

Designs autonomous agent harnesses with locked evaluators, editable surfaces, durable logging, novelty gates, pruning, rollback, and human approval boundaries.

Phoenix Observability

Self-hosted observability platform for LLM applications, providing tracing, evaluation, datasets, experiments, and real-time monitoring to debug and improve AI systems.

Evaluates how well internal model representations (hidden states) predict token-level information importance in summarization tasks, using NDCG@10 and Spearman's rank correlation.