instrumentation-verifier-data
Agent: Data Analyst
L2 data analyst (Nx) responsible for data modelling, instrumentation implementation, metrics dashboards, funnel analysis, and signal synthesis.
Department ethos: ideal-data-growth.md
Skill Description
The instrumentation verifier validates that tracking events fire correctly in the development and staging environment by executing test scenarios, inspecting event payloads, and confirming every event matches the approved spec before code progresses to production.
When to Use
- When instrumentation implementation is complete and deployed to the dev or staging environment.
- When a feature branch with new tracking code is ready for QA before merge.
- When a prior verification found issues and the implementer has submitted fixes for re-verification.
Workflow
- Load the spec: Pull the approved instrumentation spec and the verification handoff checklist from the implementer.
- Execute test scenarios: Walk through each user journey that should trigger events. Use the analytics debugger or network inspector to capture outgoing event payloads in real time.
- Validate payloads: For each captured event, compare the event name, property names, property types, and property values against the spec. Flag mismatches.
- Check negative cases: Confirm events do not fire in scenarios where they should not (e.g., bot traffic, internal test accounts, duplicate submissions).
- Produce verification report: Document pass/fail per event with specific failure details and screenshots of event payloads. Return failures to the implementer with remediation instructions.
Anti-Patterns
- Manual spot-checking: Testing one scenario per event instead of covering the full matrix misses edge cases. Why: instrumentation bugs often hide in less common paths (error states, back-navigation, timeout scenarios).
- Verifying without the spec: Checking that "events fire" without comparing to the spec validates presence but not correctness. Why: an event can fire with wrong property types and still appear "working" in the debugger.
Output
Success:
- A verification report with pass/fail per event, payload screenshots, and confirmation that all spec-defined events fire correctly in staging.
Failure:
- Events fail verification. Report each failure with the expected vs. actual payload, the likely implementation error, and remediation instructions.
Related Skills
instrumentation-implementer-data-- produces the implementation this skill verifies.instrumentation-verifier-prod-data-- the production verification that follows staging verification.instrumentation-spec-data-- the spec is the source of truth for verification.