Results for “test”

Runs regression evaluations comparing agent edits against human-approved golden projects, and registers new goldens after human approval.

Guides the creation of high-quality MCP servers, covering design, implementation, testing, and evaluation for Python and TypeScript.

Implement comprehensive evaluation strategies for LLM applications using automated metrics, human feedback, and benchmarking. Use when testing LLM performance, measuring AI application quality, or establishing evaluation frameworks.

Guides implementation of new model architectures in NeMo AutoModel through five phases: discovery, implementation, registration, validation, and testing.

Test vector stores for embedding inversion, cross-tenant leakage, and poisoning.

Probe RAG applications for prompt injection via poisoned retrieved context and embedding manipulation.

Build Django web applications and REST APIs with Django REST Framework, including models, serializers, viewsets, authentication, and testing.

Scaffolds a program.md research program for autoresearch by auto-detecting codebase signals and interviewing for missing details.

LLM observability platform for tracing, evaluation, and monitoring. Use when debugging LLM applications, evaluating model outputs against datasets, monitoring production systems, or building systematic testing pipelines for AI applications.

Extract structured data from LLM responses with Pydantic validation, retry failed extractions automatically, parse complex JSON with type safety, and stream partial results with Instructor - battle-tested structured output library

LLM observability platform for tracing, evaluation, and monitoring. Use when debugging LLM applications, evaluating model outputs against datasets, monitoring production systems, or building systematic testing pipelines for AI applications.

Extract structured data from LLM responses with Pydantic validation, retry failed extractions automatically, parse complex JSON with type safety, and stream partial results with Instructor - battle-tested structured output library

Browser automation CLI for AI agents. Use when the user needs to interact with websites, including navigating pages, filling forms, clicking buttons, taking screenshots, extracting data, testing web apps, or automating any browser task. Triggers include requests to "open a website", "fill out a form", "click a button", "take a screenshot", "scrape data from a page", "test this web app", "login to a site", "automate browser actions", or any task requiring programmatic web interaction.

Browser automation CLI for AI agents. Use when the user needs to interact with websites, including navigating pages, filling forms, clicking buttons, taking screenshots, extracting data, testing web apps, or automating any browser task. Triggers include requests to "open a website", "fill out a form", "click a button", "take a screenshot", "scrape data from a page", "test this web app", "login to a site", "automate browser actions", or any task requiring programmatic web interaction.

Browser automation CLI for AI agents. Use when the user needs to interact with websites, including navigating pages, filling forms, clicking buttons, taking screenshots, extracting data, testing web apps, or automating any browser task. Triggers include requests to "open a website", "fill out a form", "click a button", "take a screenshot", "scrape data from a page", "test this web app", "login to a site", "automate browser actions", or any task requiring programmatic web interaction.

Manage Arize datasets and examples using the ax CLI: create, list, get, export, and append datasets for evaluation and experimentation.

Generates comprehensive GitHub project plans with Epic > Feature > Story/Enabler > Test hierarchy, dependencies, priorities, and automated issue tracking.

Formal evaluation framework for Claude Code sessions implementing eval-driven development (EDD) principles.

Use when adding a new agent harness (CLI-based coding agent) adapter to adapters. Covers capability audit, adapter scaffold, session parsing, auth detection, hooks/plugins wiring, tests, and docs.

Generate a complete Rust Model Context Protocol server project with tools, prompts, resources, and tests using the official rmcp SDK.

Formulate testable hypotheses from observations, design experiments, and generate predictions using a structured scientific method framework.

Performs differential expression analysis on bulk RNA-seq or pseudo-bulk count matrices with QC, PCA, and contrast testing.

Write idiomatic Ruby code with metaprogramming, Rails patterns, and performance optimization. Specializes in Ruby on Rails, gem development, and testing frameworks. Use PROACTIVELY for Ruby refactoring, optimization, or complex Ruby features.

Write idiomatic Ruby code with metaprogramming, Rails patterns, and performance optimization. Specializes in Ruby on Rails, gem development, and testing frameworks. Use PROACTIVELY for Ruby refactoring, optimization, or complex Ruby features.

Measurement-driven model router for Claude Code. Routes Haiku/Sonnet/Opus per task class, logs every routed task with real $ numbers, and A/B tests cheaper tiers before you trust the savings.

Conducts multi-axis code review across correctness, readability, architecture, security, and performance before merging any change.

Run, debug, and interactively test C# MCP servers locally with IDE configuration, MCP Inspector, and GitHub Copilot Agent Mode integration.

Build production ML systems with PyTorch 2.x, TensorFlow, and modern ML frameworks, including model serving, feature engineering, A/B testing, and monitoring.

Build production-ready AI agents with type-safe tool use, structured outputs, dependency injection, and multi-model support using PydanticAI.

Scaffolds a coder-eval task suite in a repository by scanning for testable components, writing one real task, and validating it.

Builds a complete Uniswap V4 hook by delegating to a hook-builder agent, generating Solidity contracts, Foundry tests, CREATE2 address mining, and deployment scripts.

Runs a local voice MCP server in Rust for text-to-speech and speech-to-text, with build, test, and configuration guidance.

AI-driven Game Development Studio (BMAD-GDS). Routes game projects through Pre-production, Design, Architecture, Production, and Game Testing phases using 6 specialized agents. Supports Unity, Unreal Engine, Godot, and custom engines.

Provides guidance for performing causal interventions on PyTorch models using pyvene's declarative intervention framework. Use when conducting causal tracing, activation patching, interchange intervention training, or testing causal hypotheses about model behavior.

Provides guidance for performing causal interventions on PyTorch models using pyvene's declarative intervention framework. Use when conducting causal tracing, activation patching, interchange intervention training, or testing causal hypotheses about model behavior.

Use when user experience design, interface optimization, usability testing, or conversion-focused design is needed. This agent specializes in UX design and user experience optimization within the ContentForge AI ecosystem.