How do I install the Automationbench Eval skill?

Run npx skillmds@latest add bionic-gpt/automationbench-eval in your terminal (requires Node.js), paste this page's agent-chat prompt into Claude, Cursor, or any MCP-connected agent, or download the SKILL.md file and copy it into your agent's skills directory.

What does the Automationbench Eval skill do?

Set up and run the pinned AutomationBench API adapter, retrieve its OpenAPI services, and provision them as Bionic integrations for a selected local team. It is listed under Integrations & APIs on SkillMD.

Is Automationbench Eval safe to use?

This skill has not completed SkillMD's automated safety review yet. SkillMD never runs a skill's scripts for you; review the SKILL.md before installing.

Which AI agents work with Automationbench Eval?

This skill is tagged as working with Claude Code, Claude.ai, OpenAI Codex. SKILL.md is an open format, so most agents that read a skills directory can load it too.

Is Automationbench Eval free to use?

Yes. Installing skills from SkillMD is free, and the skill stays under its author's original license.

Who published Automationbench Eval?

bionic-gpt (@bionic-gpt) published this skill. Their other Agent Skills are listed on their SkillMD profile.

Automationbench Eval by bionic-gpt — Agent Skill

Name: Automationbench Eval
Author: bionic-gpt

File contents

AutomationBench evaluation

Use this skill when the user asks to inspect or provision the local AutomationBench evaluation environment.

Defaults

Image: ghcr.io/bionic-gpt/automationbench-api:4a8e1061254004d9dac807054eed33fad7d1ff14
OpenAPI files: /app/openapi in the image

The adapter is deployed as the automationbench-api service by the local Stack dev profile. Bionic reaches it inside the cluster at http://automationbench-api:8080. It is intentionally not exposed on a host port by this skill.

The adapter has one shared world; use /admin/world to seed an AutomationBench initial_state and /admin/reset between evaluations when operational access is available through the local cluster tooling.

Provisioning integrations

The reusable importer is scripts/import-integrations.sh. It extracts every OpenAPI YAML from the pinned image and inserts authentication-free, team-visible OpenAPI integrations into Bionic PostgreSQL.

Before running it, identify the target team and user, inspect existing rows, and obtain explicit authorization immediately before replacement. The importer only deletes rows for the selected team and must never affect other teams.

Required variables are BIONIC_DATABASE_URL, BIONIC_TEAM_ID, and BIONIC_USER_ID; AUTOMATIONBENCH_IMAGE may override the pinned image. After provisioning, verify the row count, names, visibility, and that no connections were created.

Frequently asked questions

Automationbench Eval