Pbench Runner

Use when `.pbench/run.json` exists in a prepared PBench worktree and the public replay task must be completed exactly once.

Yaphet2015 6c68ab8 2 files · 2.8 KB Updated

File contents

PBench Runner

  1. Read .pbench/public/prompt.md, .pbench/public/replay.md, and .pbench/case.public.json.
  2. Solve the task using only this repository and .pbench/public/.
  3. Read only finishCommand from .pbench/run.json, run it once, and report its result.

Do not inspect evaluator evidence, validators, captured sessions, case storage, run artifacts, or harness source. They are outside the task and invalidate the measurement.

A failed finish is terminal. Do not retry or start a replacement run.

Yaphet2015/ya-skills/tree/main/packages/functions-pbench/assets/pbench-runner commit 6c68ab87b7

Frequently asked questions

npx skillmds@latest add yaphet2015/pbench-runner