Evoclawbench

EvoClawBench - Benchmark for evaluating LLM agent skill evolution capabilities. Tests whether agents can identify repeating patterns, create reusable skills, and effectively reuse them across sub-problems.

pzy2000 358d599 673 files · 74.9 MB Updated

File contents

EvoClawBench

An open-source benchmark for evaluating LLM agents' ability to create and reuse skills (auto-evolution) at runtime.

Quick Start

uv run scripts/benchmark.py --model anthropic/claude-sonnet-4 --runtime nanobot --mode both

Key Concepts

  • Baseline mode: Agent is forbidden from creating skills
  • Evolution mode: Agent is encouraged to create reusable skills
  • fail2pass ratio: Measures the benefit of skill creation

pzy2000/evoclawbench/tree/main/evoclawbench commit 358d599719

Frequently asked questions

npx skillmds@latest add pzy2000/evoclawbench