agentskillexchange Katana Next-Generation Web Crawling and Spidering Framework
Katana by ProjectDiscovery is a fast, configurable web crawling and spidering framework written in Go. It supports standard and headless browser modes, JavaScript parsing, automatic form filling, and structured output for feeding into security and data pipelines.
Installation
Use the upstream install or setup path that matches your environment:
- docker pull projectdiscovery/katana:latest
- docker run projectdiscovery/katana:latest -u https://tesla.com
- docker run projectdiscovery/katana:latest -u https://tesla.com -system-chrome -headless
- go install github.com/projectdiscovery/katana/cmd/katana@latest
Requirements and caveats from upstream:
- katana requires Go 1.25+ to install successfully. If you encounter any installation issues, we recommend trying with the latest available version of Go, as the minimum required version may have changed. Run the comman...
- To install / update docker to latest tag -
Basic usage or getting-started notes:
Usage •
console
CGO_ENABLED=1 go install github.com/projectdiscovery/katana/cmd/katana@latest
Extracted from upstream docs: https://raw.githubusercontent.com/projectdiscovery/katana/HEAD/README.md