Progressive-Fidelity Tool Routing
Use this skill when an agent can answer a question at several fidelity levels
and must decide which tool call is justified.
The router is a policy layer. It is separate from every evaluator and separate
from the reasoning process that recommends a next action. A Tool Shadow must
not decide whether its own prediction is sufficient.
Fidelity ladder
Use the smallest level that can answer the current decision safely:
F0 exact-cheap: arithmetic, schemas, lookup tables, deterministic geometry,
cache hits, static checks, or analytic formulas.
F1 shadow: learned or heuristic approximation for perception, ranking, and
broad exploration.
F2 reduced: coarse simulation, reduced-order model, lower resolution, small
sample, or bounded dry run.
F3 authoritative: the real solver, compiler, database query, evaluator,
external service, or other source of software truth.
F4 physical: measurement, fit test, hardware run, user observation, or
production outcome.
The level labels describe evidence authority, not model sophistication.
Routing procedure
- Hash the candidate asset and all material conditions.
- Check for a valid cache entry produced by the same evaluator version.
- Apply exact cheap rules before any learned approximation.
- Use a Tool Shadow to compare many candidates only inside its validity
envelope.
- Estimate uncertainty, distance to constraints, decision reversibility,
downside of a false-safe result, and the expected information gained from a
higher-fidelity call.
- Escalate deterministically when any policy gate fires.
- Spend the authoritative tool budget on finalists, boundary cases, uncertain
cases, disagreements, and irreversible actions.
- Append the resulting Evaluation and rerun continuation analysis from a
quiescent evidence snapshot.
Mandatory escalation triggers
Run a higher-fidelity evaluator when:
- the candidate may be promoted, shipped, deployed, purchased, or fabricated
- the predicted result is near a hard constraint
- uncertainty or out-of-domain score exceeds policy limits
- the shadow and an exact rule disagree
- independent shadows disagree materially
- the input, conditions, or evaluator version changed
- the action is expensive, irreversible, safety-relevant, or externally visible
- the agent appears to be exploiting a recurrent shadow error
- policy explicitly requires human or authoritative review
Cost-aware behavior
Prefer batching, memoization, incremental evaluation, early rejection, and
coarse-to-fine execution. Report expected and actual cost and latency for each
call. Do not optimize only for fewer calls: optimize for decision quality per
unit cost.
Use the canonical routing strategy in
https://github.com/closedloop-technologies/climbhill/blob/main/resources/strategies/tool-shadows/ROUTING.md and the packet
contract in
https://github.com/closedloop-technologies/climbhill/blob/main/resources/strategies/tool-shadows/CONTRACT.md.
1---2name: progressive-fidelity-tool-routing3description: Choose between exact rules, cached results, Tool Shadows, reduced tools, authoritative tools, and physical tests using cost, latency, uncertainty, decision stakes, and evidence freshness.4---56# Progressive-Fidelity Tool Routing78Use this skill when an agent can answer a question at several fidelity levels9and must decide which tool call is justified.1011The router is a policy layer. It is separate from every evaluator and separate12from the reasoning process that recommends a next action. A Tool Shadow must13not decide whether its own prediction is sufficient.1415## Fidelity ladder1617Use the smallest level that can answer the current decision safely:1819- `F0 exact-cheap`: arithmetic, schemas, lookup tables, deterministic geometry,20 cache hits, static checks, or analytic formulas.21- `F1 shadow`: learned or heuristic approximation for perception, ranking, and22 broad exploration.23- `F2 reduced`: coarse simulation, reduced-order model, lower resolution, small24 sample, or bounded dry run.25- `F3 authoritative`: the real solver, compiler, database query, evaluator,26 external service, or other source of software truth.27- `F4 physical`: measurement, fit test, hardware run, user observation, or28 production outcome.2930The level labels describe evidence authority, not model sophistication.3132## Routing procedure33341. Hash the candidate asset and all material conditions.352. Check for a valid cache entry produced by the same evaluator version.363. Apply exact cheap rules before any learned approximation.374. Use a Tool Shadow to compare many candidates only inside its validity38 envelope.395. Estimate uncertainty, distance to constraints, decision reversibility,40 downside of a false-safe result, and the expected information gained from a41 higher-fidelity call.426. Escalate deterministically when any policy gate fires.437. Spend the authoritative tool budget on finalists, boundary cases, uncertain44 cases, disagreements, and irreversible actions.458. Append the resulting Evaluation and rerun continuation analysis from a46 quiescent evidence snapshot.4748## Mandatory escalation triggers4950Run a higher-fidelity evaluator when:5152- the candidate may be promoted, shipped, deployed, purchased, or fabricated53- the predicted result is near a hard constraint54- uncertainty or out-of-domain score exceeds policy limits55- the shadow and an exact rule disagree56- independent shadows disagree materially57- the input, conditions, or evaluator version changed58- the action is expensive, irreversible, safety-relevant, or externally visible59- the agent appears to be exploiting a recurrent shadow error60- policy explicitly requires human or authoritative review6162## Cost-aware behavior6364Prefer batching, memoization, incremental evaluation, early rejection, and65coarse-to-fine execution. Report expected and actual cost and latency for each66call. Do not optimize only for fewer calls: optimize for decision quality per67unit cost.6869Use the canonical routing strategy in70`https://github.com/closedloop-technologies/climbhill/blob/main/resources/strategies/tool-shadows/ROUTING.md` and the packet71contract in72`https://github.com/closedloop-technologies/climbhill/blob/main/resources/strategies/tool-shadows/CONTRACT.md`.