Verification Audit
Systematically cross-verify every major finding in an intelligence dossier against independent sources. Downgrades confidence, retracts unverifiable claims, and documents source reliability. Ensures the dossier is trustworthy enough to inform real decisions.
When to use
- After completing a major intelligence gathering round
- Before delivering a dossier to a decision-maker
- When findings from data aggregators (ZoomInfo, RocketReach, Prospeo, SignalHire) need validation
- When a critical finding seems too good (or too bad) to be true
- After an agent reports entity registrations, corporate relationships, or financial data
The problem
Intelligence dossiers built from OSINT sources accumulate claims from data aggregators, people-intelligence platforms, and AI research agents. These sources have different reliability levels:
| Source type |
Reliability |
Common failure modes |
| Direct observation (DNS query, SMTP test, HTTP response) |
Highest |
Transient network issues |
| Archival sources (Wayback Machine, crt.sh, SEC EDGAR) |
High |
Stale data, incomplete captures |
| Official registries (MN SOS, IRS, USPTO, SAM.gov) |
High |
Requires manual portal access; blocks automation |
| People-intelligence aggregators (ZoomInfo, RocketReach, Prospeo, SignalHire) |
Medium |
Inferred data, stale associations, hallucinated entities |
| AI research agents |
Medium-Low |
Can fabricate entities, misread sources, conflate similar names |
| Single anonymous reports (Indeed salary, Glassdoor reviews) |
Low |
Self-reported, small sample, possibly misattributed |
The biggest risk: Aggregator claims treated as facts without independent verification.
Workflow
Phase 1: Inventory all major findings
Create a table of every finding that was integrated into the dossier, noting:
- The finding itself
- The original source(s)
- Whether it was verified against a second independent source
- Current confidence level
Phase 2: Verify against independent sources
For each finding type, use the appropriate verification method:
| Finding type |
Verification method |
| Entity registrations (LLCs, nonprofits) |
Check issuing authority (Secretary of State portal, IRS EOS) |
| Email addresses |
SMTP RCPT TO verification (authoritative on non-catch-all domains) |
| Employee associations |
Cross-reference 2+ aggregators OR find on company website/LinkedIn |
| Partnership claims |
Check manufacturer's own partner directory (see oem-partner-verification skill) |
| Financial data (revenue, valuation) |
Cross-reference D&B, Prospeo, Indeed salary data; note sample sizes |
| Property records |
County assessor records (not just Zillow/Redfin estimates) |
| Tech stack detections |
Require 2+ tools to agree (e.g., httpx + Prospeo + page source) |
| Salary data |
Note sample size and self-report bias (Indeed = single anonymous reports) |
| Event/membership claims |
Find archival evidence (Wayback, LinkedIn posts, event pages) |
Phase 3: Confidence tiering
Assign every finding a confidence level:
| Level |
Criteria |
Action |
| Confirmed |
2+ independent sources agree, or direct observation (DNS, SMTP, HTTP) |
Integrate as fact |
| High |
Primary source is authoritative (official registry, archival record) |
Integrate with source citation |
| Medium |
Single credible source OR 2+ aggregators agree |
Integrate with "per [source]" qualifier |
| Low-Medium |
Single aggregator report, small sample, or reasonable inference |
Flag in text, note uncertainty |
| Retracted |
Could not be independently verified after active search |
Remove from analysis; document retraction with explanation |
Phase 4: Document retractions
When retracting a finding:
- Strike through the original text (don't delete — preserve the audit trail)
- Add "RETRACTED (date)" with the reason
- Note what verification was attempted and what failed
- Update every file where the retracted finding was placed
Phase 5: Methodology note
Document the systemic patterns discovered during verification:
- Which source types proved reliable vs. unreliable
- Which aggregators fabricated data
- What verification methods were most effective
- Recommendations for future research rounds
Output template
# Verification Audit
## RETRACTED FINDINGS
| Finding | Source | Verification attempt | Result |
|---------|--------|---------------------|--------|
| ... | ... | ... | RETRACTED — [reason] |
## VERIFIED FINDINGS (high confidence)
| Finding | Sources | Confidence |
|---------|---------|------------|
| ... | ... | Confirmed/High |
## CONFIDENCE DOWNGRADES
| Finding | Was | Now | Reason |
|---------|-----|-----|--------|
| ... | High | Medium | [reason] |
## METHODOLOGY NOTE
[Systemic observations about source reliability]
Real-world example
In a June 2026 dossier audit:
- 4 entity registrations retracted (Brogav Properties LLC, Brogav Books LLC, Break The Ice LLC, BROGAV AI Builders Foundation) — reported by a research agent, zero results on IRS EOS, ProPublica, or any public database. Likely data-aggregator hallucinations.
- 1 finding partially rehabilitated — Brogav Books LLC was later discovered to be plausible when a real published book ("Technoville Adventures") was found on Amazon with BROGAV Solutions LLC as publisher. The retraction was updated to note this.
- Salary data downgraded from "new intelligence" to "low-medium confidence" — Indeed reported a $154K "Strategic Project Manager" role from a single anonymous self-report with no corroboration.
The audit caught the AI research agent's tendency to treat aggregator output as confirmed fact — the same error that put 4 fictional entities into 4 separate dossier files before correction.
Integration with other skills
- intelligence-dossier — verification audit is the QA step before delivery
- conversation-review — complementary; conversation-review checks completeness, verification-audit checks accuracy
- oem-partner-verification — specific application of this methodology to supplier claims
1---2name: verification-audit3description: Verification Audit4---5# Verification Audit67> Systematically cross-verify every major finding in an intelligence dossier against independent sources. Downgrades confidence, retracts unverifiable claims, and documents source reliability. Ensures the dossier is trustworthy enough to inform real decisions.89---1011## When to use1213- After completing a major intelligence gathering round14- Before delivering a dossier to a decision-maker15- When findings from data aggregators (ZoomInfo, RocketReach, Prospeo, SignalHire) need validation16- When a critical finding seems too good (or too bad) to be true17- After an agent reports entity registrations, corporate relationships, or financial data1819---2021## The problem2223Intelligence dossiers built from OSINT sources accumulate claims from data aggregators, people-intelligence platforms, and AI research agents. These sources have different reliability levels:2425| Source type | Reliability | Common failure modes |26|-------------|-----------|---------------------|27| **Direct observation** (DNS query, SMTP test, HTTP response) | Highest | Transient network issues |28| **Archival sources** (Wayback Machine, crt.sh, SEC EDGAR) | High | Stale data, incomplete captures |29| **Official registries** (MN SOS, IRS, USPTO, SAM.gov) | High | Requires manual portal access; blocks automation |30| **People-intelligence aggregators** (ZoomInfo, RocketReach, Prospeo, SignalHire) | Medium | Inferred data, stale associations, hallucinated entities |31| **AI research agents** | Medium-Low | Can fabricate entities, misread sources, conflate similar names |32| **Single anonymous reports** (Indeed salary, Glassdoor reviews) | Low | Self-reported, small sample, possibly misattributed |3334**The biggest risk:** Aggregator claims treated as facts without independent verification.3536---3738## Workflow3940### Phase 1: Inventory all major findings4142Create a table of every finding that was integrated into the dossier, noting:43- The finding itself44- The original source(s)45- Whether it was verified against a second independent source46- Current confidence level4748### Phase 2: Verify against independent sources4950For each finding type, use the appropriate verification method:5152| Finding type | Verification method |53|-------------|-------------------|54| Entity registrations (LLCs, nonprofits) | Check issuing authority (Secretary of State portal, IRS EOS) |55| Email addresses | SMTP RCPT TO verification (authoritative on non-catch-all domains) |56| Employee associations | Cross-reference 2+ aggregators OR find on company website/LinkedIn |57| Partnership claims | Check manufacturer's own partner directory (see oem-partner-verification skill) |58| Financial data (revenue, valuation) | Cross-reference D&B, Prospeo, Indeed salary data; note sample sizes |59| Property records | County assessor records (not just Zillow/Redfin estimates) |60| Tech stack detections | Require 2+ tools to agree (e.g., httpx + Prospeo + page source) |61| Salary data | Note sample size and self-report bias (Indeed = single anonymous reports) |62| Event/membership claims | Find archival evidence (Wayback, LinkedIn posts, event pages) |6364### Phase 3: Confidence tiering6566Assign every finding a confidence level:6768| Level | Criteria | Action |69|-------|---------|--------|70| **Confirmed** | 2+ independent sources agree, or direct observation (DNS, SMTP, HTTP) | Integrate as fact |71| **High** | Primary source is authoritative (official registry, archival record) | Integrate with source citation |72| **Medium** | Single credible source OR 2+ aggregators agree | Integrate with "per [source]" qualifier |73| **Low-Medium** | Single aggregator report, small sample, or reasonable inference | Flag in text, note uncertainty |74| **Retracted** | Could not be independently verified after active search | Remove from analysis; document retraction with explanation |7576### Phase 4: Document retractions7778When retracting a finding:791. Strike through the original text (don't delete — preserve the audit trail)802. Add "RETRACTED (date)" with the reason813. Note what verification was attempted and what failed824. Update every file where the retracted finding was placed8384### Phase 5: Methodology note8586Document the systemic patterns discovered during verification:87- Which source types proved reliable vs. unreliable88- Which aggregators fabricated data89- What verification methods were most effective90- Recommendations for future research rounds9192---9394## Output template9596```markdown97# Verification Audit9899## RETRACTED FINDINGS100| Finding | Source | Verification attempt | Result |101|---------|--------|---------------------|--------|102| ... | ... | ... | RETRACTED — [reason] |103104## VERIFIED FINDINGS (high confidence)105| Finding | Sources | Confidence |106|---------|---------|------------|107| ... | ... | Confirmed/High |108109## CONFIDENCE DOWNGRADES110| Finding | Was | Now | Reason |111|---------|-----|-----|--------|112| ... | High | Medium | [reason] |113114## METHODOLOGY NOTE115[Systemic observations about source reliability]116```117118---119120## Real-world example121122In a June 2026 dossier audit:123- **4 entity registrations retracted** (Brogav Properties LLC, Brogav Books LLC, Break The Ice LLC, BROGAV AI Builders Foundation) — reported by a research agent, zero results on IRS EOS, ProPublica, or any public database. Likely data-aggregator hallucinations.124- **1 finding partially rehabilitated** — Brogav Books LLC was later discovered to be plausible when a real published book ("Technoville Adventures") was found on Amazon with BROGAV Solutions LLC as publisher. The retraction was updated to note this.125- **Salary data downgraded** from "new intelligence" to "low-medium confidence" — Indeed reported a $154K "Strategic Project Manager" role from a single anonymous self-report with no corroboration.126127The audit caught the AI research agent's tendency to treat aggregator output as confirmed fact — the same error that put 4 fictional entities into 4 separate dossier files before correction.128129---130131## Integration with other skills132133- **intelligence-dossier** — verification audit is the QA step before delivery134- **conversation-review** — complementary; conversation-review checks completeness, verification-audit checks accuracy135- **oem-partner-verification** — specific application of this methodology to supplier claims