Colly Golang Web Scraper and Crawler Framework

Colly is a fast open-source scraping and crawling framework for Go. It is built for everything from simple page extraction to asynchronous crawlers that process large collections of pages with request callbacks and structured parsing.

agentskillexchange Updated 28 repo stars

File contents

Colly Golang Web Scraper and Crawler Framework

Colly is a fast open-source scraping and crawling framework for Go. It is built for everything from simple page extraction to asynchronous crawlers that process large collections of pages with request callbacks and structured parsing.

Installation

Requirements and caveats from upstream:

Basic usage or getting-started notes:

Source

agentskillexchange/skills/tree/main/skills/colly-golang-web-scraper-crawler-framework commit 9ade642352

Frequently asked questions

npx skillmds@latest add agentskillexchange/colly-golang-web-scraper-and-crawler-framework