Validating Task Premises

Use when you are about to write an eval task, oracle, grader, or register against a generated world - the measure-first protocol that checks whether the pattern a task depends on actually exists, is evenly spread over time, is reachable by the agent through a tool, and discriminates. Load this before authoring a task from an idea of what a world "should" contain, whenever a measurement returns a suspiciously clean zero, whenever a graded field might be constant, and whenever a task's difficulty rests on a rate nobody has broken down by time.

punitarani Updated

File contents

punitarani/workbench commit 31dd928e74

Frequently asked questions

npx get-skill add punitarani/validating-task-premises