Results for “web-scraping”

17 skills

Detects and removes disruptive overlays (cookie banners, modals, paywalls, login walls) from webpages before screenshots, scraping, or browser automation.

Extract content, metadata, and images from a webpage for import or migration to AEM Edge Delivery Services.

Extract structured resources (icons, metadata, text, forms, videos, social links) from any webpage using playwright-cli.

Test local web applications by writing native Python Playwright scripts, with helpers for server lifecycle management and a reconnaissance-then-action pattern for dynamic UIs.

identify-page-structure

Analyze scraped webpage content to identify section boundaries and content sequences for AEM Edge Delivery Services import.

Retrieve HTML or JSON from static pages, inspect status codes and headers, follow redirects, or get page source for simple scraping without a full browser session. Supports proxies and redirect control.

More results

Guided multi-page redesign of an existing website through a four-phase pipeline — extract, direct, prototype, and migrate. Tracks progress incrementally per page so redesigns are resumable.

Crawl a live website, extract its design system, brand surface, and page inventory, and save the snapshot under stardust/current/ for downstream redesign or migration.

Reduces a webpage to a structural skeleton by tokenizing content in the browser and applying LLM reasoning to collapse repeated patterns.

Automate web browser interactions using natural language via CLI commands. Supports local and remote Browserbase sessions with CAPTCHA solving, residential proxies, and session persistence.

browserbase-cli

Manage Browserbase platform resources, Functions, and API workflows through the `browse` CLI.

Automate real browsers from the terminal for navigation, form filling, screenshots, data extraction, and UI-flow debugging using a CLI wrapper around Playwright.

23.3k · bundle

Import a single webpage from any URL into canonical EDS block format — structured HTML that authors edit in DA. Scrapes the page, analyzes structure, maps to existing blocks, and generates HTML for immediate local preview.

Captures a spatial hierarchy of rendered DOM elements from any webpage via Playwright CLI, returning an LLM-friendly text tree, structured JSON tree, and a node map with CSS selectors and overlay metadata.

Builds reliable browser automation skills through iterative experimentation, running an inner agent to browse sites and improving navigation instructions until tasks pass consistently.

Exports cookies from a local Chrome browser and saves them into a Browserbase persistent context, enabling authenticated browsing sessions via the browse CLI.

competitor-analysis

Discovers competitors via search API, deeply researches each with a multi-lane pattern, and compiles an HTML report with overview, per-competitor deep dives, feature/pricing matrix, and mentions feed.