Results for “human-eval”

Evaluate and rank agent results by metric or LLM judge for an AgentHub session.

Compare coding agents head-to-head on reproducible tasks with pass rate, cost, time, and consistency metrics.

Formal evaluation framework for Claude Code sessions implementing eval-driven development (EDD) principles.

Benchmarks language model agents on the C2C multi-agent negotiation task, reporting win rate across starting positions.

Provides a formal evaluation framework for Claude Code sessions, implementing eval-driven development (EDD) principles to define pass/fail criteria, measure reliability with pass@k metrics, and create regression test suites.

Compares coding agents head-to-head on reproducible tasks, measuring pass rate, cost, time, and consistency.

Designs autonomous agent harnesses with locked evaluators, editable surfaces, durable logging, novelty gates, pruning, rollback, and human approval boundaries.