Results for “benchmark”

Guides users through creating, editing, and optimizing agent skills, including drafting, testing, evaluating, and improving skill performance.

Therapeutics Data Commons. AI-ready drug discovery datasets (ADME, toxicity, DTI), benchmarks, scaffold splits, molecular oracles, for therapeutic ML and pharmacological prediction.

Multi-objective optimization framework. NSGA-II, NSGA-III, MOEA/D, Pareto fronts, constraint handling, benchmarks (ZDT, DTLZ), for engineering design and optimization problems.

Use when you need to characterize score distributions of a profile HMM on random sequences, such as calibration checks, benchmarking, or filter-behavior experiments.

Proposal research workflow that matches local case studies and gathers web evidence into an HTML research dossier. Use when the user needs proposal research, client intel, tech stack discovery, pricing benchmarks, competitive context, or case-study matching for a brief. Triggers: 'research this proposal', 'build a research dossier', 'match case studies', 'find pricing benchmarks', 'client intel for', 'what tech does X use'.

AIDE file integrity monitoring reference. Database initialization, integrity checks, update workflow, aide.conf configuration, selection rules, report parsing, and production deployment with CIS benchmark compliance.

Multi-objective optimization framework. NSGA-II, NSGA-III, MOEA/D, Pareto fronts, constraint handling, benchmarks (ZDT, DTLZ), for engineering design and optimization problems.

Researching competitors and shaping positioning: feature matrices, SWOT, benchmarking, positioning maps, battle cards, win/loss, LLM brand visibility. Research only — use for strategy, not code.

Design and implement evaluation harnesses for models, agents, and code. Use when creating benchmarks, designing eval metrics, or comparing system outputs.

POLAR v2.0 — ETH Alpha Hunter. The patience benchmark. Thesis exit permanently removed. Scanner enters, DSL exits. +19.8% ROE trades after removing thesis exit.

Run evaluation tasks against a NeMo Platform server using the Evaluator plugin CLI and Python SDK.

Creates, runs, and analyzes Arize experiments for evaluating and comparing model performance using the ax CLI.

Guides users through creating, refining, and evaluating agent skills, including drafting, testing, and optimizing descriptions for better triggering.

Compares coding agents head-to-head on reproducible tasks, measuring pass rate, cost, time, and consistency.

Build, deploy, and manage continuous AI agents using a visual workflow editor or development toolkit.

Launches long-running evaluation batches in isolated tmux sessions with pre-flight verification, monitoring, and post-flight analysis for unattended runs.

Framework de otimização multi-objetivo. NSGA-II, NSGA-III, MOEA/D, frentes de Pareto, tratamento de restrições, benchmarks (ZDT, DTLZ), para problemas de design e otimização em engenharia.

Therapeutics Data Commons. Conjuntos de dados prontos para IA em descoberta de drogas (ADME, toxicidade, DTI), benchmarks, divisões de scaffold, oráculos moleculares, para ML terapêutico e predição farmacológica.

Analyzes email sequence performance metrics. Evaluates open rates, click rates, reply rates, and conversion by step. Identifies drop-off points, benchmarks against industry averages, and recommends optimizations.

Design, optimize, and communicate SaaS pricing — tier structure, value metrics, pricing pages, and price increase strategy.

Compare coding agents head-to-head on reproducible tasks with pass rate, cost, time, and consistency metrics.

Delivers measurement-driven performance optimization for latency, throughput, memory, and tail behavior, with correctness preservation and regression guards.

Guides users through creating, editing, and optimizing agent skills, including drafting, testing, evaluating, and improving skill descriptions for better triggering.

Use in TURBO mode when Codex should compare top current solutions before choosing architecture, UI components, 3D stack, mobile stack, SEO/PPC strategy, or programming patterns.

Implement comprehensive evaluation strategies for LLM applications using automated metrics, human feedback, and benchmarking. Use when testing LLM performance, measuring AI application quality, or establishing evaluation frameworks.

Launches a model evaluation batch with parameter collection, pre-flight checks, execution, and post-run analysis for interactive or foreground runs.

Scaffolds a program.md research program for autoresearch by auto-detecting codebase signals and interviewing for missing details.

Dataset analysis and data quality specialist. Use when the user asks to talk to Cypher, requests the data detective, or needs dataset assessment, bias analysis, and benchmark evaluation.

Multi-language test infrastructure for the Pump SDK — Rust unit/integration/security/performance tests, TypeScript Jest tests, Python fuzz tests, shell test orchestration, Criterion benchmarks, and CI quality gates.

Run autonomous optimization loops that iteratively improve artifacts against evaluators using hypothesis tree refinement, without overfitting.

Formal evaluation framework for Claude Code sessions implementing eval-driven development (EDD) principles.

Performance baseline measurement and regression detection. Use when measuring perf before/after a PR, setting up baselines, investigating "feels slow" reports, validating launch performance targets, or comparing your stack against alternatives.

Design and run Pump.fun SDK test infrastructure across Rust, TypeScript, Python, and Bash, including unit tests, integration tests, security tests, fuzzing, shell orchestration, Criterion benchmarks, coverage, and CI gates.

Evaluates a containerized framework for deploying distributed big data workloads, measuring execution time and cloud cost scaling from four to eight nodes.

Run a skill's evals and report results. Use when the user wants to evaluate a skill, run evals, benchmark a skill, validate triggers, optimize a description, or grade skill outputs.

Use when evaluating, measuring, or comparing the performance of systems, functions, or services. This skill provides a framework for establishing baselines, measuring performance, and validating that changes meet performance requirements.