Results for “batch-scraping”

Builds a configurable scraping agent that collects data from APIs, HTML, or RSS, enriches it with Gemini AI scoring, and stores results in Notion, Google Sheets, Supabase, or local files.

Builds a scheduled, AI-powered data collection agent that scrapes public sources, enriches results with Gemini Flash, and stores them in Notion, Sheets, or Supabase.

Bulk extract content from an entire website or site section by crawling pages that follow links, with configurable depth, path filters, and concurrency.

Extracts clean, LLM-optimized markdown from any URL, including JavaScript-rendered SPAs, with support for concurrent scraping of multiple URLs and options like main-content-only extraction and custom output formats.

Guides scaling Qdrant vector search with time-based data rotation using shard rotation, collection rotation, or filter-and-delete strategies.

抓取知乎收藏夹与文章正文为 Markdown，支持图片本地化、断点续传及写入 Obsidian 知识库。