Apify Actor Web Crawler

Deploys custom Apify Actors via the Apify API v2 for large-scale web crawling using CrawleeJS. Leverages Apify dataset storage, RequestQueue, and proxy configuration for distributed scraping at scale.

agentskillexchange Updated 28 repo stars

File contents

Apify Actor Web Crawler

Deploys custom Apify Actors via the Apify API v2 for large-scale web crawling using CrawleeJS. Leverages Apify dataset storage, RequestQueue, and proxy configuration for distributed scraping at scale.

Installation

Use the upstream install or setup path that matches your environment:

  • npm install apify

Requirements and caveats from upstream:

  • Apify SDK requires Node.js 16 or later. Add Apify SDK to any Node.js project by running:

Basic usage or getting-started notes:

Source

agentskillexchange/skills/tree/main/skills/apify-actor-web-crawler commit 921b0f8dd3

Frequently asked questions

npx skillmds@latest add agentskillexchange/apify-actor-web-crawler