Results for “crawlability”

Crawl a live website, extract its design system, brand surface, and page inventory, and save the snapshot under stardust/current/ for downstream redesign or migration.

Handles all network operations including search, web scraping, login-required access, and social media content retrieval via a real browser CDP proxy.

Deep-crawl any website from start URLs, returning per-page LLM-ready text, markdown, or HTML with metadata and in-scope outbound links.

Search the web, scrape pages, crawl sites, and interact with dynamic content via the Firecrawl CLI, returning clean markdown for LLM contexts.

Handles all networked operations through a real browser via CDP, including search, page scraping, login-required actions, and social media content extraction.