agentskillexchange ScrapyCloud Job Manager
Manages Scrapy spider deployments and job scheduling on ScrapyCloud via the Scrapinghub API. Handles spider argument injection, job prioritization, and item export to S3 or BigQuery.
Installation
Basic usage or getting-started notes:
Run, monitor, and control your Scrapy spiders however you want to.
Run, monitor, and control your crawlers with Scrapy Cloud's easy-to-use web interface.
Provides a simple way to run your crawls and browse results