Web Researcher
Full web research and content extraction. Replaces: firecrawl-search, firecrawl-scrape, firecrawl-agent, firecrawl-browser, agent-fetch.
Trigger
Any request to search the web, fetch content from a URL, scrape a site, extract information from web pages, research a company/topic/person, or gather structured data online.
Capabilities
This skill uses Firecrawl MCP tools and web fetch to:
- Search: Find web content with full-page results, not just snippets
- Scrape: Extract clean markdown from any URL
- Crawl: Map and extract from entire websites or sections
- Agent: Autonomously browse and extract complex multi-step data
- Browser: Interact with JS-heavy sites that require execution
Tool Selection
| Need |
Tool |
When |
| Find pages on a topic |
firecrawl_search |
Research queries, competitive intel |
| Get content from 1 URL |
firecrawl_scrape |
Articles, product pages, docs |
| Explore a whole site |
firecrawl_map + firecrawl_scrape |
Full site extraction |
| Complex multi-page task |
firecrawl_agent |
Navigating paginated results, forms |
| JS-heavy / auth-required |
firecrawl_browser_* |
SPAs, login-required content |
| Simple public URL |
WebFetch |
Fast single-page, no JS needed |
Research Workflows
Company Research
- Search:
[Company name] overview site:crunchbase.com OR linkedin.com
- Scrape: Company website → /about, /pricing, /blog
- Search:
[Company name] funding OR press OR review
- Synthesize: Founded, team size, product, pricing, positioning, traction
Competitive Analysis
- Identify competitors: Search "[product category] alternatives" or "[our product] competitors"
- For each competitor: Scrape homepage, pricing page, features page
- Extract: positioning, key features, pricing tiers, target customer
- Produce: comparison table + positioning gaps
Market Research
- Search industry reports, analyst coverage, news
- Scrape relevant articles for data points
- Search Reddit/forums for unfiltered customer opinions
- Synthesize: market size, trends, key players, customer pain points
Person Research
- Search: "[Name] site:linkedin.com"
- Search: "[Name] interview OR podcast OR talk"
- Search: "[Name] company" to find current role
- Synthesize: background, expertise, recent work, contact info
Content Research
- Search: "[Topic] guide OR tutorial OR best practices"
- Scrape top 3-5 results for structure and depth
- Identify: what's covered, what's missing, best formats
- Produce: content brief with outline, key points, differentiation
Output Formats
Research Brief
## [Topic] Research Brief
**Summary**: [2-3 sentence overview]
**Key Findings**:
- [Finding 1 with source]
- [Finding 2 with source]
- [Finding 3 with source]
**Data Points**:
| Metric | Value | Source |
|--------|-------|--------|
| ... | ... | ... |
**Implications**: [So what? → Actionable takeaways]
Competitive Overview
## Competitive Landscape: [Space]
| Company | Positioning | Key Features | Pricing | Weakness |
|---------|-------------|--------------|---------|---------|
| ... | ... | ... | ... | ... |
**Market gaps**: [What nobody is doing well]
**Our edge**: [Where we win]
Synthesis Principles
- Primary sources over summaries: Get the original page, not a cached summary
- Triangulate: Cross-check findings across 2-3 sources before stating as fact
- Cite everything: Every claim → source URL
- Flag uncertainty: "Appears to be" vs "Confirmed:" for unverified data
- Actionable output: End every research task with "So what?" implications
Firecrawl Usage Notes
firecrawl_search: Returns full page content, not just snippets — use for rich researchfirecrawl_scrape: Returns markdown; use formats: ["markdown"] for clean textfirecrawl_agent: Best for: "find all pricing info on this site" type tasksfirecrawl_map: Returns all URLs — combine with selective scraping for efficiency- For authenticated content: Use
firecrawl_browser_create → firecrawl_browser_execute
Autonomous Research Behavior
When given a research goal, proceed autonomously:
- Formulate 3-5 search queries covering different angles
- Scrape most relevant results
- Identify gaps and run follow-up searches
- Synthesize into structured output
- Flag what couldn't be verified and what sources to check manually
Do not ask for permission between steps. Deliver a complete research package.
Related Skills
firecrawl — web scrapingdeep-research — in-depth researchlead-research-assistant — lead research
GitNexus Index
This skill is indexed by GitNexus for knowledge graph traversal.
Index path: /Users/localuser/.claude/skills/web-researcher/.gitnexus
Last indexed: 2026-05-23
1---2name: web-researcher3description: Web research and content extraction — search the web with full page content, scrape any URL, autonomously extract structured data from complex sites, and synthesize findings into actionable intelligence.4---56# Web Researcher78Full web research and content extraction. Replaces: firecrawl-search, firecrawl-scrape, firecrawl-agent, firecrawl-browser, agent-fetch.910## Trigger11Any request to search the web, fetch content from a URL, scrape a site, extract information from web pages, research a company/topic/person, or gather structured data online.1213## Capabilities1415This skill uses Firecrawl MCP tools and web fetch to:16- **Search**: Find web content with full-page results, not just snippets17- **Scrape**: Extract clean markdown from any URL18- **Crawl**: Map and extract from entire websites or sections19- **Agent**: Autonomously browse and extract complex multi-step data20- **Browser**: Interact with JS-heavy sites that require execution2122## Tool Selection2324| Need | Tool | When |25|------|------|-------|26| Find pages on a topic | `firecrawl_search` | Research queries, competitive intel |27| Get content from 1 URL | `firecrawl_scrape` | Articles, product pages, docs |28| Explore a whole site | `firecrawl_map` + `firecrawl_scrape` | Full site extraction |29| Complex multi-page task | `firecrawl_agent` | Navigating paginated results, forms |30| JS-heavy / auth-required | `firecrawl_browser_*` | SPAs, login-required content |31| Simple public URL | `WebFetch` | Fast single-page, no JS needed |3233## Research Workflows3435### Company Research361. Search: `[Company name] overview site:crunchbase.com OR linkedin.com`372. Scrape: Company website → /about, /pricing, /blog383. Search: `[Company name] funding OR press OR review`394. Synthesize: Founded, team size, product, pricing, positioning, traction4041### Competitive Analysis421. Identify competitors: Search "[product category] alternatives" or "[our product] competitors"432. For each competitor: Scrape homepage, pricing page, features page443. Extract: positioning, key features, pricing tiers, target customer454. Produce: comparison table + positioning gaps4647### Market Research481. Search industry reports, analyst coverage, news492. Scrape relevant articles for data points503. Search Reddit/forums for unfiltered customer opinions514. Synthesize: market size, trends, key players, customer pain points5253### Person Research541. Search: "[Name] site:linkedin.com"552. Search: "[Name] interview OR podcast OR talk"563. Search: "[Name] company" to find current role574. Synthesize: background, expertise, recent work, contact info5859### Content Research601. Search: "[Topic] guide OR tutorial OR best practices"612. Scrape top 3-5 results for structure and depth623. Identify: what's covered, what's missing, best formats634. Produce: content brief with outline, key points, differentiation6465## Output Formats6667### Research Brief68```69## [Topic] Research Brief7071**Summary**: [2-3 sentence overview]7273**Key Findings**:74- [Finding 1 with source]75- [Finding 2 with source]76- [Finding 3 with source]7778**Data Points**:79| Metric | Value | Source |80|--------|-------|--------|81| ... | ... | ... |8283**Implications**: [So what? → Actionable takeaways]84```8586### Competitive Overview87```88## Competitive Landscape: [Space]8990| Company | Positioning | Key Features | Pricing | Weakness |91|---------|-------------|--------------|---------|---------|92| ... | ... | ... | ... | ... |9394**Market gaps**: [What nobody is doing well]95**Our edge**: [Where we win]96```9798## Synthesis Principles991001. **Primary sources over summaries**: Get the original page, not a cached summary1012. **Triangulate**: Cross-check findings across 2-3 sources before stating as fact1023. **Cite everything**: Every claim → source URL1034. **Flag uncertainty**: "Appears to be" vs "Confirmed:" for unverified data1045. **Actionable output**: End every research task with "So what?" implications105106## Firecrawl Usage Notes107108- `firecrawl_search`: Returns full page content, not just snippets — use for rich research109- `firecrawl_scrape`: Returns markdown; use `formats: ["markdown"]` for clean text110- `firecrawl_agent`: Best for: "find all pricing info on this site" type tasks111- `firecrawl_map`: Returns all URLs — combine with selective scraping for efficiency112- For authenticated content: Use `firecrawl_browser_create` → `firecrawl_browser_execute`113114## Autonomous Research Behavior115116When given a research goal, proceed autonomously:1171. Formulate 3-5 search queries covering different angles1182. Scrape most relevant results1193. Identify gaps and run follow-up searches1204. Synthesize into structured output1215. Flag what couldn't be verified and what sources to check manually122123Do not ask for permission between steps. Deliver a complete research package.124125## Related Skills126- `firecrawl` — web scraping127- `deep-research` — in-depth research128- `lead-research-assistant` — lead research129130## GitNexus Index131This skill is indexed by GitNexus for knowledge graph traversal.132Index path: /Users/localuser/.claude/skills/web-researcher/.gitnexus133Last indexed: 2026-05-23
UltronCore