Results for “web-crawling”
13 skillsFirecrawl Automation
Automate web crawling and data extraction with Firecrawl: scrape pages, crawl sites, extract structured data, batch scrape URLs, and map website structures.
66.9k
Firecrawl
Search the web, scrape pages, crawl sites, and interact with dynamic content via the Firecrawl CLI, returning clean markdown for LLM contexts.
2 · bundle
More results
Extract
Crawl a live website, extract its design system, brand surface, and page inventory, and save the snapshot under stardust/current/ for downstream redesign or migration.
142 · bundle
Webcrawler Deep Crawl
Deep-crawl any website from start URLs, returning per-page LLM-ready text, markdown, or HTML with metadata and in-scope outbound links.
3.7k · bundle
Browser Use
Automates browser interactions for web testing, form filling, screenshots, and data extraction. Use when the user needs to navigate websites, interact with web pages, fill forms, take screenshots, or extract information from web pages.
1
Browser Automation
Automate browser tasks, scrape websites, fill forms, capture screenshots, and extract structured data from web pages using Playwright.
20.4k · bundle
Crawl4ai MCP Server
Self-hosted web crawling and content extraction exposed as MCP tools, with depth control and clean markdown output.
28
Web Access
Handles all networked operations through a real browser via CDP, including search, page scraping, login-required actions, and social media content extraction.
0 · bundle
Browser Use
Automates browser interactions for web testing, form filling, screenshots, and data extraction. Use when the user needs to navigate websites, interact with web pages, fill forms, take screenshots, or extract information from web pages.
2
Web Access
Handles all network operations including search, web scraping, login-required access, and social media content retrieval via a real browser CDP proxy.
2 · bundle
Web Scraping
Extrae datos de sitios web de forma ética usando requests, BeautifulSoup, Selenium o Playwright, respetando robots.txt y aplicando rate limiting.
0 · bundle
Web Scraping
Activates for web scraping and Actor development, discovering APIs via traffic interception, recommending optimal strategies, and implementing iteratively. For production, it guides TypeScript Actor creation via Apify CLI.
0 · bundle
Tavily Map
Discovers and lists all URLs on a website without extracting content, using the Tavily CLI. Faster than crawling, with options for depth, filtering, and natural language instructions.
2