Agent Eval Harness

Agent Eval Harness from plaited/agent-eval-harness.

by @plaited 3 skills

Skills in this plugin

3
  1. ▌
    Trial Runner · plaited
    End-to-end eval-suite orchestration with the `eval` command: run -> grade -> compare -> calibrate, using strict JSON contracts and schema discovery.
    6 installs
  2. ▌
    Compare Trials · plaited bundle
    Analyze graded `trial_result` JSONL outputs from the eval pipeline, including reliability and custom slicing.
    4 installs
  3. ▌
    Trial Adapters · plaited
    Build command-only adapters for `eval` run mode using strict stdin/stdout JSON contracts.
    5 installs