Meta Skill Ab Test

Use when comparing a shipped bitranox skill against one or more modified variants on one real task in the real project repository - judging exact cost and token usage per run and which code came out better, pairwise from the diffs - or when tempted to judge a skill change from transcripts alone, to hand-roll an A/B harness, or to re-run an arm that already cost money. Keywords - A/B test, variant, control arm, abtest, pre-registration, PREREG, seal, void arm, floor, workpiece.

bitranox Updated 1 repo stars

File contents

bitranox/bitranox-skills commit 79dc521091

Frequently asked questions

npx get-skill add bitranox/meta-skill-ab-test