Results for “scrapfly”

Build a fully automated AI-powered data collection agent for any public source — job boards, prices, news, GitHub, sports, anything. Scrapes on a schedule, enriches data with a free LLM (Gemini Flash), stores results in Notion/Sheets/Supabase, and learns from user feedback. Runs 100% free on GitHub Actions.

Builds a scheduled, AI-powered data collection agent that scrapes public sources, enriches results with Gemini Flash, and stores them in Notion, Sheets, or Supabase.

Run Apify web scraping Actors, manage datasets, create reusable tasks, and retrieve crawl results directly from the terminal.

Extract content, metadata, and images from a webpage for import or migration to AEM Edge Delivery Services.

Analyze single-cell RNA-seq data with Scanpy, covering quality control, normalization, clustering, marker gene identification, visualization, and trajectory analysis.

Discovers podcasts via the iTunes Search API, parses RSS feeds, downloads audio, transcribes with OpenAI Whisper, chunks transcripts, and upserts results into a database table.

Automate web crawling and data extraction with Firecrawl: scrape pages, crawl sites, extract structured data, batch scrape URLs, and map website structures.

Analyze single-cell RNA-seq data with Scanpy, covering quality control, normalization, clustering, marker gene identification, visualization, and trajectory analysis.

Scrapes posts from a Facebook group given a group URL, sort order, and desired count, returning structured post metadata including post_id, permalink, author, timestamp, body text, media, reactions, comments, and shares.

Build streaming data pipelines with Redpanda Connect using declarative YAML configs, Bloblang mappings, and component discovery. Covers running, linting, and dry-running pipelines.

Implements a complete observability stack with Prometheus metrics, Grafana dashboards, Jaeger distributed tracing, and structured logging, including heartbeat-based absence detection for scheduled jobs on Google Cloud.

Builds a configurable scraping agent that collects data from APIs, HTML, or RSS, enriches it with Gemini AI scoring, and stores results in Notion, Google Sheets, Supabase, or local files.