GitHub Validation Journey
Parse a GitHub Issue's Validation Journey, execute the verification steps using the appropriate tools for the change type, capture evidence at each canonical [EVIDENCE: <artifact-type>: <name>] marker (while still accepting the documented legacy untyped form), and post to the issue + GitHub PR.
Arguments
$ARGUMENTS: <ISSUE_REF> [PR_NUMBER]
ISSUE_REF(required): GitHub issue ref —org/repo#<number>or full GitHub issue URL.PR_NUMBER(optional): GitHub PR number for the implementation PR. If omitted, the skill auto-detects the PR fromlisa-github-read-issue's linked-PR list (preferring the most recent open PR).
Prerequisites
ghCLI authenticated.- Appropriate services running for the verification type (dev server, database, etc.).
Workflow
Step 1: Parse the Validation Journey
gh issue view <number> --repo <org>/<repo> --json body --jq '.body'
Extract the ## Validation Journey section (plus its ### Prerequisites, ### Steps, and ### Assertions sub-sections). Parse each step into a structured form: { index, text, evidence_marker (or null) }.
If the issue has no Validation Journey, stop and instruct the caller to run /github-add-journey <issue-ref> first.
Step 2: Satisfy Prerequisites
Before starting the journey, verify each prerequisite:
- Check if required services are running (
curl localhost:<port>/health,pg_isready, etc.). - Verify database connectivity if the journey touches data.
- Ensure environment variables are set.
- Run any setup commands mentioned in
### Prerequisites.
Step 3: Execute Steps and Capture Evidence
Execute each step sequentially. Determine the verification approach based on the step text and the issue's change type (inferred from type: label, component: labels, and the body):
- API endpoints → Run curl commands, capture HTTP response to
evidence/NN-name.txt(or.json). - Database changes → Run psql/migration commands, capture schema output.
- Background jobs → Trigger the job, check queue/state, capture logs.
- Library/utility changes → Run tests, capture output.
- Security fixes → Reproduce exploit attempt, verify fix, capture output.
At each typed [EVIDENCE: <artifact-type>: <name>] marker, capture an artifact of the declared type — the type is the contract, not a suggestion:
screenshot/recording→ an actual image/video file from the driven UI (Playwright, simulator), never a text description of what was seenhttp-transcript→ the exact request (curl command or client call) plus the full responsecli-output→ the command plus stdout/stderr and exit codelog-snippet→ the correlated log lines pulled from the running systemdb-query-output→ the query plus returned rowsperf-trace→ the benchmark/frame-timing/profiler output with methodology (device profile, dataset size)test-run-log→ reporter output naming the spec and showing it ran and passeddeploy-log/state-dump→ the deployment/health-check output or observed-state JSON
A prose claim ("the error state rendered gracefully") satisfies no marker. Legacy untyped markers: infer the type from the step's action, capture accordingly, and note the inference. Write each artifact to a numbered file:
Treat only exact [EVIDENCE: ...] markers (plus the legacy local [SCREENSHOT: ...] form) as capture instructions. Both the canonical [EVIDENCE-REF: <work-item-ref> | <artifact-type>: <kebab-case-name>] and the Lisa 2.223.0 legacy alias [EVIDENCE-REF: <tracker-ref>: <artifact-type>: <kebab-case-name>] point to another work item's artifact: preserve either as explanatory text, but do not capture it, assign it a sequence number, include it in duplicate-name checks, or count it as a local manifest entry. If a runtime-changing leaf has references but no local claiming marker, stop because S14 is unsatisfied.
Evidence Naming Convention
{NN}-{evidence-name}.txt (or .json for structured data):
NN: zero-padded sequential number (01, 02, 03...).evidence-name: the<name>part of the typed marker (kebab-case).
Example:
evidence/
01-health-check.json
02-schema-after-migration.txt
03-rate-limit-response.txt
comment.md
Step 4: Generate Evidence Templates
Compose evidence/comment.md with:
- The issue ref + title.
- The PR ref.
- Each evidence marker rendered as a GitHub markdown section with a fenced code block of the captured file.
- An "Assertions verified" subsection mapping each
### Assertionsline to "PASS / FAIL".
This template generator is shared with lisa-jira-journey (the JIRA path renders the same content as wiki markup). When the markdown comment is the canonical artifact, both vendors stay aligned.
Step 5: Post Evidence
Use lisa-github-evidence to post everything:
# Equivalent of: bash scripts/post-evidence.sh — but invoked via the Skill tool
Invoke the skill with <ISSUE_REF> ./evidence <PR_NUMBER>. It uploads the files to the pr-assets release, edits the PR's ## Evidence section, and posts a comment on the issue. The build-intake owner performs the direct claimed → done lifecycle transition after success.
Step 6: Verify
Confirm:
- Evidence files exist as release assets named
pr-<PR>-NN-name.{txt,json}. - The PR description contains the
## Evidencesection with code-block embeds. - The issue has a new comment whose body matches
comment.md. - The issue has the evidence comment, and the build-intake owner can transition it from
status:in-progressdirectly to the configureddonelabel.
Verification Patterns Reference
| Change Type | Verification Method | Evidence Format |
|---|---|---|
| API endpoint | curl -s localhost:PORT/endpoint |
JSON response |
| Database migration | psql -c "\d table" or migration output |
Schema text |
| Background job | Trigger + check state | Log output |
| Library/utility | bun run test -- path/to/test |
Test output |
| Security fix | Reproduce + verify fix | Request/response |
| Auth/authz | Multi-role verification | Status codes per role |
Troubleshooting
Evidence file is empty
Ensure the command succeeded and produced output. Use 2>&1 to capture both stdout and stderr.
Parser returns no steps
The issue may not have a Validation Journey section — run /github-add-journey <ISSUE_REF> first.