.local-workspace/ - Git-ignored directory for cloning PRs, temporary files, external repos, etc.
.local-workspace/.env - May contain ANTHROPIC_API_KEY and other API credentials. Check and use when running harbor with API access.
Quick Workflow
# 1. Install harbor and initialize a task
uv tool install harbor
harbor tasks init tasks/<task-name>
# 2. Write files (see harbor skill for templates)
# 3. Validate
harbor tasks check tasks/my-task
harbor run -p tasks/my-task -a oracle # Must pass 100%
# 4. Test with agent
# you can test agents with your claude code/cursor/codex/vscode/GitHub copilot subscriptions, etc.
# you can also trigger harbor run with your own API keys.
# for PR we only need some idea of how sota level models and agents perform on the task with and without skills.
harbor run -p tasks/my-task -a claude-code -m 'anthropic/claude-opus-4-5'
# 5. Submit PR
# please see our PR template for more details.
Task Requirements
Things people actually do
Agent should be more performant with skills than without skills.
task.toml and solve.sh must be human-authored
Prioritize verifiable tasks. LLM-as-judge or agent-as-a-judge is not priority right now. But we are open to these ideas and will brainstorm if we can make these tasks easier to verify.
Converted and distributed by TomeVault — claim your Tome and manage your conversions.
1---2name: benchflow-ai-skillsbench-skillsbench3description: SkillsBench4---56# SkillsBench78Benchmark evaluating how well AI agents use skills.910## Official Resources1112- **GitHub**: https://github.com/benchflow-ai/skillsbench13- **Harbor Docs**: https://harborframework.com/docs14- **Terminal-Bench Task Guide**: https://www.tbench.ai/docs/task-quickstart1516## Repo Structure1718```19tasks/<task-id>/ # Benchmark tasks20.claude/skills/ # Contributor skills (harbor, skill-creator)21CONTRIBUTING.md # Full contribution guide22```2324## Local Workspace & API Keys2526- **`.local-workspace/`** - Git-ignored directory for cloning PRs, temporary files, external repos, etc.27- **`.local-workspace/.env`** - May contain `ANTHROPIC_API_KEY` and other API credentials. Check and use when running harbor with API access.2829## Quick Workflow3031```bash32# 1. Install harbor and initialize a task33uv tool install harbor34harbor tasks init tasks/<task-name>3536# 2. Write files (see harbor skill for templates)3738# 3. Validate39harbor tasks check tasks/my-task40harbor run -p tasks/my-task -a oracle # Must pass 100%4142# 4. Test with agent43# you can test agents with your claude code/cursor/codex/vscode/GitHub copilot subscriptions, etc.44# you can also trigger harbor run with your own API keys.45# for PR we only need some idea of how sota level models and agents perform on the task with and without skills.46harbor run -p tasks/my-task -a claude-code -m 'anthropic/claude-opus-4-5'4748# 5. Submit PR49# please see our PR template for more details.50```5152## Task Requirements5354- Things people actually do55- Agent should be more performant with skills than without skills.56- task.toml and solve.sh must be human-authored57- Prioritize verifiable tasks. LLM-as-judge or agent-as-a-judge is not priority right now. But we are open to these ideas and will brainstorm if we can make these tasks easier to verify.5859## References6061- Full guide: [CONTRIBUTING.md](../../../../CONTRIBUTING.md)62- Harbor commands: See harbor skill63- Task ideas: [references/task-ideas.md](references/task-ideas.md)6465---66> Converted and distributed by [TomeVault](https://tomevault.io/claim/benchflow-ai) — claim your Tome and manage your conversions.67<!-- tomevault:4.0:skill_md:2026-04-11 -->
Run npx skillmds@latest add tomevault-io/benchflow-ai-skillsbench-skillsbench in your terminal (requires Node.js), paste this page's agent-chat prompt into Claude, Cursor, or any MCP-connected agent, or download the SKILL.md file and copy it into your agent's skills directory.
SkillsBench It is listed under Coding & Dev Tools on SkillMD.
This skill has not completed SkillMD's automated safety review yet. Independent scanners report: SkillSpector: PASS, Skill Scanner: PASS. SkillMD never runs a skill's scripts for you; review the SKILL.md before installing.
This skill is tagged as working with Claude Code, Claude.ai, OpenAI Codex. SKILL.md is an open format, so most agents that read a skills directory can load it too.
Yes. Installing skills from SkillMD is free, and the skill stays under its author's original license.
tomevault-io (@tomevault-io) published this skill. Their other Agent Skills are listed on their SkillMD profile.
tomevault-io