Crawley

Use this skill when the user wants to unix-way web crawler and scraping tool.

javimosch Updated 57 repo stars

File contents

Crawley Plugin

Unix-way web crawler and scraping tool.

Commands

Operations

  • crawley url crawl — crawl url via crawley

Usage Examples

  • "crawley --help"
  • "crawley "

Installation

go install github.com/s0rg/crawley/cmd/crawley@latest

Examples

crawley --version
crawley --help

Key Features

  • web\n- crawler\n- scraping

javimosch/supercli commit c589c7e1ea

Frequently asked questions

npx get-skill add javimosch/crawley