Terminal Bench Agent Evaluation

Evaluate agents on 89 challenging terminal-based tasks where frontier models score below 65%, providing realistic assessment of command-line interface automation capability. Use when benchmarking agents designed for system administration, automation, or DevOps tasks.

adu2021 Updated 7 repo stars

File contents

adu2021/skillxiv commit 6a795a2e2d

Frequently asked questions

npx get-skill add adu2021/terminal-bench-agent-evaluation