Performing OSINT with SpiderFoot
Overview
SpiderFoot is an open-source OSINT automation tool with 200+ modules that integrates with data sources for threat intelligence and attack surface mapping. This skill uses the SpiderFoot REST API and CLI (sf.py/spiderfoot-cli) to create and manage scans, select modules by use case (footprint, investigate, passive), parse structured results for domains, IPs, email addresses, leaked credentials, and DNS records, and generate target intelligence profiles.
When to Use
- When conducting security assessments that involve performing osint with spiderfoot
- When following incident response procedures for related security events
- When performing scheduled security testing or auditing activities
- When validating security controls through hands-on testing
Prerequisites
- SpiderFoot 4.0+ installed or SpiderFoot HX cloud account
- Python 3.8+ with requests library
- SpiderFoot server running on default port 5001
- Optional: API keys for VirusTotal, Shodan, HaveIBeenPwned modules
Steps
- Connect to SpiderFoot REST API or use CLI interface
- Create a new scan with target specification (domain, IP, email, name)
- Select scan modules by use case (all, footprint, investigate, passive)
- Monitor scan progress via API polling
- Retrieve and parse scan results by data element type
- Extract key findings: subdomains, IPs, emails, leaked credentials
- Generate structured OSINT intelligence report
Expected Output
JSON report containing OSINT findings organized by data type (domains, IPs, emails, credentials, DNS records), module source attribution, and target profile summary with risk indicators.
1---2name: performing-osint-with-spiderfoot3description: Automate OSINT collection with the SpiderFoot REST API and CLI (sf.py/spiderfoot-cli) across 200+ modules, selecting scan modes (footprint, investigate, passive) and parsing results for domains, IPs, emails, leaked credentials, and DNS records into a target intelligence profile. Use when mapping an organization's attack surface or profiling a target for threat intelligence.4domain: cybersecurity5subdomain: threat-intelligence6tags:7- osint8- spiderfoot9- reconnaissance10- threat-intelligence11- attack-surface12- target-profiling13version: '1.0'14author: mahipal15license: Apache-2.016nist_csf:17- ID.RA-0118- ID.RA-0519- DE.CM-0120- DE.AE-0221mitre_attack:22- T159123- T159224- T159325- T158926- T159527metadata:28 source: https://skillmd.com/skills/26zl/performing-osint-with-spiderfoot29---3031# Performing OSINT with SpiderFoot3233## Overview3435SpiderFoot is an open-source OSINT automation tool with 200+ modules that integrates with data sources for threat intelligence and attack surface mapping. This skill uses the SpiderFoot REST API and CLI (sf.py/spiderfoot-cli) to create and manage scans, select modules by use case (footprint, investigate, passive), parse structured results for domains, IPs, email addresses, leaked credentials, and DNS records, and generate target intelligence profiles.363738## When to Use3940- When conducting security assessments that involve performing osint with spiderfoot41- When following incident response procedures for related security events42- When performing scheduled security testing or auditing activities43- When validating security controls through hands-on testing4445## Prerequisites4647- SpiderFoot 4.0+ installed or SpiderFoot HX cloud account48- Python 3.8+ with requests library49- SpiderFoot server running on default port 500150- Optional: API keys for VirusTotal, Shodan, HaveIBeenPwned modules5152## Steps53541. Connect to SpiderFoot REST API or use CLI interface552. Create a new scan with target specification (domain, IP, email, name)563. Select scan modules by use case (all, footprint, investigate, passive)574. Monitor scan progress via API polling585. Retrieve and parse scan results by data element type596. Extract key findings: subdomains, IPs, emails, leaked credentials607. Generate structured OSINT intelligence report6162## Expected Output6364JSON report containing OSINT findings organized by data type (domains, IPs, emails, credentials, DNS records), module source attribution, and target profile summary with risk indicators.