Crawl With Rate Limits And Backoff

Use when running a crawler or hitting an API in bulk. Applies polite pacing, bounded concurrency, and exponential backoff so the source stays healthy.

jiayaoqijia Updated 81 repo stars

File contents

jiayaoqijia/cryptoskill commit b12ce04c4c

Frequently asked questions

npx get-skill add jiayaoqijia/crawl-with-rate-limits-and-backoff