Plugins

4 plugins

Results for “metrics”

93 skills
More results
joshuashepherd
Agent Tool
Creates or modifies OpenAI Agents SDK tools with Zod parameters, caching, metrics, and agent registration, following established patterns and best practices.
1
ziri22
Agent Scrum Master
Scrum master — ceremonies, facilitation, impediments, retrospectives, metrics
6
qhjqhj00
Cider
Computes CIDEr and related metrics to score how well generated image descriptions align with human consensus, using reference sentences and triplet annotations.
3
joshuashepherd
Add Tool
Creates or modifies agent tools for OpenAI Agents SDK, covering search, analysis, API integration, and database query patterns with caching and metrics.
1
qhjqhj00
Adhx
Fetches any X/Twitter post as structured JSON via the ADHX API, including full article content, author info, and engagement metrics, without scraping or a browser.
3 · bundle
tools-only
187 Step 459c2d7b
Guides analysis of Neuropixels recordings from raw data to curated units, covering preprocessing, motion correction, spike sorting, quality metrics, and export.
7 · bundle
lingxling
Adhx
Fetches any X/Twitter post as clean, structured JSON via the ADHX API, including full article content, author info, and engagement metrics, without scraping or a browser.
253
tradermonty
Portfolio Manager
Analyze investment portfolios by fetching real-time holdings via Alpaca MCP Server, then assess asset allocation, diversification, risk metrics, and generate rebalancing recommendations.
2.3k · bundle
qhjqhj00
Accuracy
Evaluates an AI judge system's pairwise ranking accuracy on generated commit messages against a heuristic ground truth from five automatic text metrics, using the MCMD dataset.
3
affaan-m
Cost Tracking
Analyze Claude Code token usage, spending, and budgets from the local ECC cost-tracker metrics log. Provides summaries, breakdowns by model, session, or date, and CSV export.
226k
lucassantana-dev
Eval
Evaluate LLM outputs systematically — benchmarks, automated metrics, human preference, and regression tracking
1 · bundle
huggingface
Huggingface Trackio
Track and visualize ML training experiments with Trackio, including logging metrics, firing alerts, and retrieving data via CLI. Supports real-time dashboards, webhook alerts, and HF Space syncing.
10.8k · bundle
danstrem2
Dexter
Autonomous financial research agent for stock analysis, financial statements, metrics, prices, SEC filings, and crypto data.
2 · bundle
ssrjkk
LLM Eval
Evaluates LLM performance using BLEU, ROUGE metrics and LLM-as-judge. Use for model testing.
2 · bundle
heath-gtm
Funnel Metrics
Build the funnel metrics that actually get trusted. Stage-by-stage conversion, velocity, win rate, and the single biggest leak, with every definition pinned so nobody relitigates the numbers in the meeting. Built for B2B RevOps teams, customizable to your CRM and your stage model. Trigger on "build my funnel metrics", "what's my conversion by stage", "where's the leak", "what's our win rate", "how fast do deals move", or any funnel diagnostic.
0 · bundle
qhjqhj00
Menli
Evaluates the robustness and alignment with human judgment of reference-based and reference-free evaluation metrics for machine translation and summarization, particularly under adversarial conditions.
3
snoodleboot-io
Model Evaluation
Every metric encodes an opinion about which mistake hurts.
2
projectious-work
AI Fundamentals
Explain and apply core ML/AI concepts — model types, training pipelines, evaluation metrics, and neural architectures.
0 · bundle
majiayu000
Ml
Guides machine learning development with experiment tracking, hyperparameter optimization, model registry, and MLOps pipeline integration.
567 · bundle
paramchordiya
Ml Engineering
Enforces rigorous ML modeling, feature engineering, training, and evaluation standards at principal-engineer level.
0
jarbitechture
Goals
Optimize prompts via process goals (controllable behavioral instructions) rather than outcome goals (sparse end-result demands). Grounded in sports psychology meta-analysis showing process goals (d=1.36) vastly outperform outcome goals (d=0.09). Use when designing prompts, optimizing LLM steering, implementing CoT/decomposition patterns, or building automatic prompt optimization pipelines. Instantiates surrogate loss paradigm for discrete prompt space.
0
dokhacgiakhoa
Ab Test Setup
Structured guide for setting up A/B tests with mandatory gates for hypothesis, metrics, and execution readiness.
505 · bundle
tianhao909
Tensorboard
Visualize training metrics, debug models with histograms, compare experiments, visualize model graphs, and profile performance with TensorBoard - Google's ML visualization toolkit
1 · bundle
qcmuu
Tensorboard
Visualize training metrics, debug models with histograms, compare experiments, visualize model graphs, and profile performance with TensorBoard - Google's ML visualization toolkit
0 · bundle
manu14357
Langsmith Fetch
Debug LangChain and LangGraph agents by fetching execution traces from LangSmith. Analyze agent behavior, investigate errors, and review tool calls and performance metrics.
16
machenjie
Failure Diagnosis
`analysis-agent`/`task-agent`/`review-agent`: use when symptoms, logs, metrics, regressions, or incidents need cause analysis; skip when no diagnosis decision exists.
4 · bundle
yanacuti1121
Agent Eval
Head-to-head comparison of coding agents (Claude Code, Aider, Codex, etc.) on custom tasks with pass rate, cost, time, and consistency metrics
2
jarbitechture
Agent Eval
Head-to-head comparison of coding agents (Claude Code, Aider, Codex, etc.) on custom tasks with pass rate, cost, time, and consistency metrics
0
livelybug
Agent Eval
Head-to-head comparison of coding agents (Claude Code, Aider, Codex, etc.) on custom tasks with pass rate, cost, time, and consistency metrics
0
rajanthar
Agent Eval
Head-to-head comparison of coding agents (Claude Code, Aider, Codex, etc.) on custom tasks with pass rate, cost, time, and consistency metrics
0