Results for “scraping”

Control browsers via a CLI tool that runs sandboxed JavaScript scripts for automation, testing, and data extraction.

Create and deploy browser automation functions with the Stagehand CLI, from interactive site exploration to production deployment.

Guides Qdrant monitoring setup including Prometheus scraping, health probes, Hybrid Cloud metrics, alerting, and log centralization.

Automate Zenserp search engine results page (SERP) scraping and monitoring tasks through Composio's Zenserp toolkit via Rube MCP.

Self-hosted web crawling and content extraction exposed as MCP tools, with depth control and clean markdown output.

Turns websites into CLI commands, reusing an existing Chrome login session for browser-backed data extraction and structured output.

Discovers and lists all URLs on a website, with optional search filtering to find specific pages within large sites.

Extract content, metadata, and images from a webpage for import or migration to AEM Edge Delivery Services.

Automates Browserbase Tool operations through Composio's Rube MCP integration, including tool discovery, connection management, and execution.

Search, browse, and analyze content on Xiaohongshu (Little Red Book) including feeds, note details, comments, and user profiles.

Fetches any X/Twitter post as structured JSON, including full article content, author info, and engagement metrics, without scraping or a browser.

Automates Parsehub data extraction tasks through Composio's Parsehub toolkit via Rube MCP, with tool discovery and connection management.

Automate Zyte API operations through Composio's Rube MCP integration, including tool discovery, connection management, and execution.

Automates Scrapegraph AI operations through Composio's toolkit via Rube MCP, with tool discovery and connection management.

Automates browser tasks including navigation, data extraction, screenshots, form filling, and session management via a CLI tool.

Monitors Xianyu (goofish.com) for newly listed items matching keywords, price ranges, and filters, with automated scanning and Discord notifications.

Tracks RSS/Atom feeds and blogs using blogwatcher-cli, with feed discovery, HTML scraping fallback, OPML import, and read/unread article management.

Extracts clean markdown from web pages via the Defuddle CLI, removing navigation and clutter to reduce token usage for reading or analyzing URLs.

Analyze scraped webpage content to identify section boundaries and content sequences for AEM Edge Delivery Services import.

Extract complete product information from any e-commerce product page using a universal multi-layer extraction strategy.

Extract structured product launch data from Product Hunt leaderboards, enriched with maker profiles and website contact information.

Bulk extract content from an entire website or site section by crawling pages that follow links, with configurable depth, path filters, and concurrency.

Reposts external blog articles into StaticFlow with style-aware translation, source normalization, image ingestion, and verified publishing.

Automate browser tasks, scrape websites, fill forms, capture screenshots, and extract structured data from web pages using Playwright.

Guides monitoring and observability setup for Qdrant vector search deployments, including Prometheus scraping, health checks, and metric-based debugging of production issues.

Searches for Instagram locations by name and retrieves paginated posts tagged at those locations, including captions, engagement counts, and media URLs.

Fetches comments from an Instagram post including comment text, username, timestamp, like count, and reply count using cursor-based pagination.

Extracts structured data from YouTube search results, including videos, shorts, channels, and playlists, using the BrowserAct API.

Parses betting odds HTML tables with Java and Jsoup, extracting company names, odds values, and change timestamps using specific CSS selectors.

Search the web, scrape pages, crawl sites, and interact with dynamic content via the Firecrawl CLI, returning clean markdown for LLM contexts.

Extracts clean markdown or text from one or more URLs using the Tavily CLI, with support for JavaScript-rendered pages and query-focused chunking.

Extracts structured JSON data from complex multi-page websites using an AI agent that navigates pages and returns results matching a schema.

Acquires a single verified headshot per named leader from official sources, with identity checks and a provenance manifest, avoiding bulk scraping.

Automates Chrome/Chromium via CDP with accessibility-tree snapshots and element refs, covering web pages, Electron apps, Slack, and cloud browsers.

Automate real browsers from the terminal for navigation, form filling, screenshots, data extraction, and UI-flow debugging using a CLI wrapper around Playwright.

Search Taobao and Tmall product listings by keyword, returning paginated product cards with title, price, shop, image, sales, and tags.