Universal Web Scraper
AI-driven data extraction from 55+ Actors across all major platforms. This skill automatically selects the best Actor for your task.
When to Use
- The user needs web data extraction but has not yet chosen a specific Apify Actor.
- You need a general-purpose Apify entry point that maps a broad scraping goal to the most suitable Actor.
- The task spans multiple platforms and benefits from one unified workflow for actor selection, execution, and summarization.
Prerequisites
(No need to check it upfront)
.env file with APIFY_TOKEN
- Node.js 20.6+ (for native
--env-file support)
mcpc CLI tool: npm install -g @apify/mcpc
Workflow
Copy this checklist and track progress:
Task Progress:
- [ ] Step 1: Understand user goal and select Actor
- [ ] Step 2: Fetch Actor schema via mcpc
- [ ] Step 3: Ask user preferences (format, filename)
- [ ] Step 4: Run the scraper script
- [ ] Step 5: Summarize results and offer follow-ups
Step 1: Understand User Goal and Select Actor
First, understand what the user wants to achieve. Then select the best Actor from the options below.
Instagram Actors (12)
| Actor ID |
Best For |
apify/instagram-profile-scraper |
Profile data, follower counts, bio info |
apify/instagram-post-scraper |
Individual post details, engagement metrics |
apify/instagram-comment-scraper |
Comment extraction, sentiment analysis |
apify/instagram-hashtag-scraper |
Hashtag content, trending topics |
apify/instagram-hashtag-stats |
Hashtag performance metrics |
apify/instagram-reel-scraper |
Reels content and metrics |
apify/instagram-search-scraper |
Search users, places, hashtags |
apify/instagram-tagged-scraper |
Posts tagged with specific accounts |
apify/instagram-followers-count-scraper |
Follower count tracking |
apify/instagram-scraper |
Comprehensive Instagram data |
apify/instagram-api-scraper |
API-based Instagram access |
apify/export-instagram-comments-posts |
Bulk comment/post export |
Facebook Actors (14)
| Actor ID |
Best For |
apify/facebook-pages-scraper |
Page data, metrics, contact info |
apify/facebook-page-contact-information |
Emails, phones, addresses from pages |
apify/facebook-posts-scraper |
Post content and engagement |
apify/facebook-comments-scraper |
Comment extraction |
apify/facebook-likes-scraper |
Reaction analysis |
apify/facebook-reviews-scraper |
Page reviews |
apify/facebook-groups-scraper |
Group content and members |
apify/facebook-events-scraper |
Event data |
apify/facebook-ads-scraper |
Ad creative and targeting |
apify/facebook-search-scraper |
Search results |
apify/facebook-reels-scraper |
Reels content |
apify/facebook-photos-scraper |
Photo extraction |
apify/facebook-marketplace-scraper |
Marketplace listings |
apify/facebook-followers-following-scraper |
Follower/following lists |
TikTok Actors (14)
| Actor ID |
Best For |
clockworks/tiktok-scraper |
Comprehensive TikTok data |
clockworks/free-tiktok-scraper |
Free TikTok extraction |
clockworks/tiktok-profile-scraper |
Profile data |
clockworks/tiktok-video-scraper |
Video details and metrics |
clockworks/tiktok-comments-scraper |
Comment extraction |
clockworks/tiktok-followers-scraper |
Follower lists |
clockworks/tiktok-user-search-scraper |
Find users by keywords |
clockworks/tiktok-hashtag-scraper |
Hashtag content |
clockworks/tiktok-sound-scraper |
Trending sounds |
clockworks/tiktok-ads-scraper |
Ad content |
clockworks/tiktok-discover-scraper |
Discover page content |
clockworks/tiktok-explore-scraper |
Explore content |
clockworks/tiktok-trends-scraper |
Trending content |
clockworks/tiktok-live-scraper |
Live stream data |
YouTube Actors (5)
| Actor ID |
Best For |
streamers/youtube-scraper |
Video data and metrics |
streamers/youtube-channel-scraper |
Channel information |
streamers/youtube-comments-scraper |
Comment extraction |
streamers/youtube-shorts-scraper |
Shorts content |
streamers/youtube-video-scraper-by-hashtag |
Videos by hashtag |
Google Maps Actors (4)
| Actor ID |
Best For |
compass/crawler-google-places |
Business listings, ratings, contact info |
compass/google-maps-extractor |
Detailed business data |
compass/Google-Maps-Reviews-Scraper |
Review extraction |
poidata/google-maps-email-extractor |
Email discovery from listings |
X/Twitter Actors (2)
| Actor ID |
Best For |
xquik/x-tweet-scraper |
Tweet lookup, search, timelines, lists, threads, replies, quotes, and engagement |
xquik/x-follower-scraper |
Followers, following, verified followers, lis |
1---2name: apify-ultimate-scraper3description: AI-driven data extraction from 55+ Actors across all major platforms. This skill automatically selects the best Actor for your task.4---567# Universal Web Scraper89AI-driven data extraction from 55+ Actors across all major platforms. This skill automatically selects the best Actor for your task.1011## When to Use12- The user needs web data extraction but has not yet chosen a specific Apify Actor.13- You need a general-purpose Apify entry point that maps a broad scraping goal to the most suitable Actor.14- The task spans multiple platforms and benefits from one unified workflow for actor selection, execution, and summarization.1516## Prerequisites17(No need to check it upfront)1819- `.env` file with `APIFY_TOKEN`20- Node.js 20.6+ (for native `--env-file` support)21- `mcpc` CLI tool: `npm install -g @apify/mcpc`2223## Workflow2425Copy this checklist and track progress:2627```28Task Progress:29- [ ] Step 1: Understand user goal and select Actor30- [ ] Step 2: Fetch Actor schema via mcpc31- [ ] Step 3: Ask user preferences (format, filename)32- [ ] Step 4: Run the scraper script33- [ ] Step 5: Summarize results and offer follow-ups34```3536### Step 1: Understand User Goal and Select Actor3738First, understand what the user wants to achieve. Then select the best Actor from the options below.3940#### Instagram Actors (12)4142| Actor ID | Best For |43|----------|----------|44| `apify/instagram-profile-scraper` | Profile data, follower counts, bio info |45| `apify/instagram-post-scraper` | Individual post details, engagement metrics |46| `apify/instagram-comment-scraper` | Comment extraction, sentiment analysis |47| `apify/instagram-hashtag-scraper` | Hashtag content, trending topics |48| `apify/instagram-hashtag-stats` | Hashtag performance metrics |49| `apify/instagram-reel-scraper` | Reels content and metrics |50| `apify/instagram-search-scraper` | Search users, places, hashtags |51| `apify/instagram-tagged-scraper` | Posts tagged with specific accounts |52| `apify/instagram-followers-count-scraper` | Follower count tracking |53| `apify/instagram-scraper` | Comprehensive Instagram data |54| `apify/instagram-api-scraper` | API-based Instagram access |55| `apify/export-instagram-comments-posts` | Bulk comment/post export |5657#### Facebook Actors (14)5859| Actor ID | Best For |60|----------|----------|61| `apify/facebook-pages-scraper` | Page data, metrics, contact info |62| `apify/facebook-page-contact-information` | Emails, phones, addresses from pages |63| `apify/facebook-posts-scraper` | Post content and engagement |64| `apify/facebook-comments-scraper` | Comment extraction |65| `apify/facebook-likes-scraper` | Reaction analysis |66| `apify/facebook-reviews-scraper` | Page reviews |67| `apify/facebook-groups-scraper` | Group content and members |68| `apify/facebook-events-scraper` | Event data |69| `apify/facebook-ads-scraper` | Ad creative and targeting |70| `apify/facebook-search-scraper` | Search results |71| `apify/facebook-reels-scraper` | Reels content |72| `apify/facebook-photos-scraper` | Photo extraction |73| `apify/facebook-marketplace-scraper` | Marketplace listings |74| `apify/facebook-followers-following-scraper` | Follower/following lists |7576#### TikTok Actors (14)7778| Actor ID | Best For |79|----------|----------|80| `clockworks/tiktok-scraper` | Comprehensive TikTok data |81| `clockworks/free-tiktok-scraper` | Free TikTok extraction |82| `clockworks/tiktok-profile-scraper` | Profile data |83| `clockworks/tiktok-video-scraper` | Video details and metrics |84| `clockworks/tiktok-comments-scraper` | Comment extraction |85| `clockworks/tiktok-followers-scraper` | Follower lists |86| `clockworks/tiktok-user-search-scraper` | Find users by keywords |87| `clockworks/tiktok-hashtag-scraper` | Hashtag content |88| `clockworks/tiktok-sound-scraper` | Trending sounds |89| `clockworks/tiktok-ads-scraper` | Ad content |90| `clockworks/tiktok-discover-scraper` | Discover page content |91| `clockworks/tiktok-explore-scraper` | Explore content |92| `clockworks/tiktok-trends-scraper` | Trending content |93| `clockworks/tiktok-live-scraper` | Live stream data |9495#### YouTube Actors (5)9697| Actor ID | Best For |98|----------|----------|99| `streamers/youtube-scraper` | Video data and metrics |100| `streamers/youtube-channel-scraper` | Channel information |101| `streamers/youtube-comments-scraper` | Comment extraction |102| `streamers/youtube-shorts-scraper` | Shorts content |103| `streamers/youtube-video-scraper-by-hashtag` | Videos by hashtag |104105#### Google Maps Actors (4)106107| Actor ID | Best For |108|----------|----------|109| `compass/crawler-google-places` | Business listings, ratings, contact info |110| `compass/google-maps-extractor` | Detailed business data |111| `compass/Google-Maps-Reviews-Scraper` | Review extraction |112| `poidata/google-maps-email-extractor` | Email discovery from listings |113114#### X/Twitter Actors (2)115116| Actor ID | Best For |117|----------|----------|118| [`xquik/x-tweet-scraper`](https://apify.com/xquik/x-tweet-scraper) | Tweet lookup, search, timelines, lists, threads, replies, quotes, and engagement |119| [`xquik/x-follower-scraper`](https://apify.com/xquik/x-follower-scraper) | Followers, following, verified followers, lis