Results for “web-crawling”
9 skillstavily-cli
Performs web search, content extraction, site crawling, URL discovery, and deep research via the Tavily CLI, returning JSON for LLM consumption.
2
tavily-web
Search the web, extract content from URLs, and crawl websites using the Tavily API.
42.4k
More results
parallel-web
Search the web, extract URL content, enrich datasets with web-sourced fields, and run deep research reports, prioritizing academic and scientific sources.
30.2k · bundle
web-research-assistant
Searches the internet via BrowserAct API when direct web access is restricted, extracting and structuring research data from multiple sources.
3.7k · bundle
web-search
Search the web and fetch content from URLs, returning LLM-friendly markdown.
1.5k · bundle
web-search
Search the web and extract content from URLs using Tavily and Exa APIs via the inference.sh CLI.
584
firecrawl-search
Searches the web and optionally extracts full page content, returning results as JSON files.
2
seo-audit
Runs a full website SEO audit by crawling up to 500 pages, detecting business type, delegating to specialist subagents, and producing a prioritized action plan with a health score.
39
tavily-map
Discovers and lists all URLs on a website without extracting content, using the Tavily CLI. Faster than crawling, with options for depth, filtering, and natural language instructions.
2