aoa-eval
Intent
Route one evaluation need to the narrowest procedure that preserves its real
owner, input contract, output, and proof limit. Consolidation here is a shared
front door, not a collapse of five different capabilities into generic prose.
Trigger boundary
Use this skill when:
- an eval surface must be selected or applied
- an established no-fit needs a local intake packet or a bounded suite design
- researched eval-trigger classes and supplied or retrieved session hits need
eval-owned candidate classification
Do not use this skill when:
- the task is an ordinary test run, the invariant is still unknown, the real
need is generic session harvesting, or the requested effect is central proof
promotion
Inputs
- one mode intent plus its owner, source ref, acceptance target, relevant
evidence or inventory, effect authority, and required environment details
Outputs
- one mode-specific result defined by
references/contract.yaml, including
owner, evidence class, proof limit, next route, and stop line
Procedure
Record <bundle_dir> as the directory containing this loaded SKILL.md.
Choose exactly one mode
| Mode |
Use when |
Required procedure |
select |
No exact evidence surface has been selected. |
references/select.md |
apply |
The exact surface and acceptance contract are explicit. |
references/apply.md |
local-need |
Selection proved no fit and an existing local eval port should receive pressure. |
references/local-need.md |
design |
Selection proved no fit and a stable invariant needs a bounded local suite or report design. |
references/design.md |
session-mining |
Prior research defined eval-trigger classes that need real session examples. |
references/session-mining.md |
Mode: select
Read and follow references/select.md.
Mode: apply
Read and follow references/apply.md.
Mode: local-need
Read and follow references/local-need.md.
Mode: design
Read and follow references/design.md.
Mode: session-mining
Read and follow references/session-mining.md.
- Read
references/contract.yaml and the selected mode reference completely
before acting. Do not load unrelated mode references.
- Read the target owner's route law and preserve source, environment,
freshness, evidence class, effect posture, and proof authority.
- If a required mode input cannot be obtained from permitted sources, stop as
blocked_missing_input; do not guess, substitute a broader action, or
relabel absence as an owner-boundary deferral.
In apply, the mode reference's complete dotted-field preflight must be
observed before reading or executing the selected target; a summary claim
that the contract is complete is not a preflight.
- Execute each chosen procedure as one task-local node and return its typed
output. A request that explicitly asks to find and run may form
select -> apply only after an exact fit provides the complete apply ABI.
Other later modes remain explicit handoffs, never automatic continuation.
- When the task asks what an applied observation actually constrains, hand the
evaluation-observation to aoa-verification; do not reinterpret command
success as proof inside this bundle.
- When the task explicitly asks for central proof meaning, a central verdict,
admission, or lifecycle interpretation, preserve the observation and its
source, claim class, environment, and proof limit in a
central-proof-review-request, then hand it to aoa-evals-skills. Do not invoke
that owner merely because an eval ran successfully.
- When prior-session evidence still must be found, let the session-memory
evidence route retrieve and ground it, then consume the bounded packet here.
The evidence route owns retrieval;
session-mining owns eval-trigger
classification and its local eval handoff.
Contracts
- selection, execution, intake, design, session evidence, and proof promotion
are different effects
- eval discovery/application and interpretation of invariant coverage are
distinct but composable nodes
- local evidence stays local until a stronger proof owner accepts it
- Eval Forge health, command success, and generated dashboards are not result
proof
.aoa evidence is optional candidate evidence and never overrides owner
source truth
- technique records may explain provenance but are not runtime dependencies
Risks and anti-patterns
- choosing by keyword or replacing the selected action with a broader green
gate
- collapsing local pressure and executable design into one vague proposal
- mining sessions before trigger classes and owner routes are known
- creating a permanent validator before manual cases establish a durable
invariant
Verification
- confirm one mode, exact owner/source/environment posture, required inputs,
output type, effect, and termination condition
- inspect commands and artifacts manually against the declared acceptance
target
- state what the result proves, what it does not prove, skipped checks, drift,
and the next owner route
Adaptation points
Owners supply local eval ports, schemas, command runners, artifacts, acceptance
criteria, privacy rules, session providers, and proof-promotion workflows.
1---2name: aoa-eval3description: Select or apply an owner-local or cross-repository eval, route a confirmed no-fit to intake/design, or classify supplied session hits as eval candidates. Do not use for central proof bundles, named results or verdicts, source-linked reports, proof lifecycle, ordinary tests, undefined invariants, or generic session harvesting.4---56# aoa-eval78## Intent910Route one evaluation need to the narrowest procedure that preserves its real11owner, input contract, output, and proof limit. Consolidation here is a shared12front door, not a collapse of five different capabilities into generic prose.1314## Trigger boundary1516Use this skill when:1718- an eval surface must be selected or applied19- an established no-fit needs a local intake packet or a bounded suite design20- researched eval-trigger classes and supplied or retrieved session hits need21 eval-owned candidate classification2223Do not use this skill when:2425- the task is an ordinary test run, the invariant is still unknown, the real26 need is generic session harvesting, or the requested effect is central proof27 promotion2829## Inputs3031- one mode intent plus its owner, source ref, acceptance target, relevant32 evidence or inventory, effect authority, and required environment details3334## Outputs3536- one mode-specific result defined by `references/contract.yaml`, including37 owner, evidence class, proof limit, next route, and stop line3839## Procedure4041Record `<bundle_dir>` as the directory containing this loaded `SKILL.md`.4243### Choose exactly one mode4445| Mode | Use when | Required procedure |46|---|---|---|47| `select` | No exact evidence surface has been selected. | `references/select.md` |48| `apply` | The exact surface and acceptance contract are explicit. | `references/apply.md` |49| `local-need` | Selection proved no fit and an existing local eval port should receive pressure. | `references/local-need.md` |50| `design` | Selection proved no fit and a stable invariant needs a bounded local suite or report design. | `references/design.md` |51| `session-mining` | Prior research defined eval-trigger classes that need real session examples. | `references/session-mining.md` |5253### Mode: select5455Read and follow `references/select.md`.5657### Mode: apply5859Read and follow `references/apply.md`.6061### Mode: local-need6263Read and follow `references/local-need.md`.6465### Mode: design6667Read and follow `references/design.md`.6869### Mode: session-mining7071Read and follow `references/session-mining.md`.72731. Read `references/contract.yaml` and the selected mode reference completely74 before acting. Do not load unrelated mode references.752. Read the target owner's route law and preserve source, environment,76 freshness, evidence class, effect posture, and proof authority.773. If a required mode input cannot be obtained from permitted sources, stop as78 `blocked_missing_input`; do not guess, substitute a broader action, or79 relabel absence as an owner-boundary deferral.80 In `apply`, the mode reference's complete dotted-field preflight must be81 observed before reading or executing the selected target; a summary claim82 that the contract is complete is not a preflight.834. Execute each chosen procedure as one task-local node and return its typed84 output. A request that explicitly asks to find and run may form85 `select -> apply` only after an exact fit provides the complete apply ABI.86 Other later modes remain explicit handoffs, never automatic continuation.875. When the task asks what an applied observation actually constrains, hand the88 `evaluation-observation` to `aoa-verification`; do not reinterpret command89 success as proof inside this bundle.906. When the task explicitly asks for central proof meaning, a central verdict,91 admission, or lifecycle interpretation, preserve the observation and its92 source, claim class, environment, and proof limit in a93 `central-proof-review-request`, then hand it to `aoa-evals-skills`. Do not invoke94 that owner merely because an eval ran successfully.957. When prior-session evidence still must be found, let the session-memory96 evidence route retrieve and ground it, then consume the bounded packet here.97 The evidence route owns retrieval; `session-mining` owns eval-trigger98 classification and its local eval handoff.99100## Contracts101102- selection, execution, intake, design, session evidence, and proof promotion103 are different effects104- eval discovery/application and interpretation of invariant coverage are105 distinct but composable nodes106- local evidence stays local until a stronger proof owner accepts it107- Eval Forge health, command success, and generated dashboards are not result108 proof109- `.aoa` evidence is optional candidate evidence and never overrides owner110 source truth111- technique records may explain provenance but are not runtime dependencies112113## Risks and anti-patterns114115- choosing by keyword or replacing the selected action with a broader green116 gate117- collapsing local pressure and executable design into one vague proposal118- mining sessions before trigger classes and owner routes are known119- creating a permanent validator before manual cases establish a durable120 invariant121122## Verification123124- confirm one mode, exact owner/source/environment posture, required inputs,125 output type, effect, and termination condition126- inspect commands and artifacts manually against the declared acceptance127 target128- state what the result proves, what it does not prove, skipped checks, drift,129 and the next owner route130131## Adaptation points132133Owners supply local eval ports, schemas, command runners, artifacts, acceptance134criteria, privacy rules, session providers, and proof-promotion workflows.