Colly Golang Web Scraper and Crawler Framework
Colly is a fast open-source scraping and crawling framework for Go. It is built for everything from simple page extraction to asynchronous crawlers that process large collections of pages with request callbacks and structured parsing.
Installation
Requirements and caveats from upstream:
- docker-slim/docker-slim Optimize your Docker containers to make them smaller and better.
Basic usage or getting-started notes:
Example
go get github.com/gocolly/colly/v2
Bugs
Source: https://github.com/gocolly/colly
Extracted from upstream docs: https://raw.githubusercontent.com/gocolly/colly/HEAD/README.md