Scrape Creators — Printing Press CLI
Prerequisites: Install the CLI
This skill drives the scrape-creators-pp-cli binary. You must verify the CLI is installed before invoking any command from this skill. If it is missing, install it first:
- Install via the Printing Press installer. It defaults binaries to
$HOME/.local/bin on macOS/Linux and %LOCALAPPDATA%\Programs\PrintingPress\bin on Windows:npx -y @mvanhorn/printing-press-library install scrape-creators --cli-only
- Verify:
scrape-creators-pp-cli --version
- Ensure the reported install directory is on
$PATH for the agent/runtime that will invoke this skill.
If the npx install fails (no Node, offline, etc.), fall back to a direct Go install (requires Go 1.26.6 or newer). This installs into $GOPATH/bin (default $HOME/go/bin), so add that directory to $PATH instead:
go install github.com/mvanhorn/printing-press-library/library/developer-tools/scrape-creators/cmd/scrape-creators-pp-cli@latest
If --version reports "command not found" after install, the runtime cannot see the binary directory on $PATH. Do not proceed with skill commands until verification succeeds.
The official CLI mirrors endpoints and the official skills describe curl workflows; neither remembers anything between runs. This CLI syncs profiles, posts, comments with their replies, transcripts, and ads into SQLite with FTS5 search, routes comment-thread fetches on credit economics (comments thread), audits reply completeness against ground truth (comments coverage), and gates expensive sweeps behind a pre-flight credit estimate (account estimate).
When to Use This CLI
Use this CLI when a task touches public social-media data at scale: mining comments and replies for a brand, qualifying creators across platforms, monitoring competitor ads, or searching transcript/comment corpora you have already synced. It is the right choice whenever credit economics matter — its thread routing, sweep budgets, and pre-flight estimates exist so agents never spend blind.
Anti-triggers
Do not use this CLI for:
- Do not use this CLI to post, like, follow, or message on any platform — it is read-only public-data scraping
- Do not use it for private/logged-in-only content; it sees what the public sees
- Do not use it as a general web scraper for non-social sites; use a crawling tool instead
Unique Capabilities
These capabilities aren't available in any other tool for this API.
Comment-thread completeness
comments thread — Fetch one post's complete comment threads, automatically picking the cheaper route between the 15-credit flat include_replies call and 1-credit per-comment reply calls (don't trust child_comment_count to decide: it's unreliable). By default only the first page of top-level comments is fetched and truncated: true reports when more exist; pass --max-credits N to keep traversing further pages under a credit budget that gates every paid call (the envelope's note says why a traversal stopped).
Reach for this when you need every reply on a post without doing credit arithmetic by hand.
scrape-creators-pp-cli comments thread https://www.instagram.com/reel/C8rKmYvsrck --agent
scrape-creators-pp-cli comments thread https://www.instagram.com/reel/C8rKmYvsrck --max-credits 60 --agent
comments coverage — Rank synced posts by how many comments the API reported versus how many actually landed in your local store — ground truth where the API's child_comment_count is unreliable as a thread filter.
Reach for this after a sweep to find which posts are silently missing their replies.
scrape-creators-pp-cli comments coverage bracken.design --agent
comments sweep — Pull recent posts for a handle and their comments in one command, stopping cleanly at a credit budget you set.
The one-command version of a multi-hundred-post comment-mining ritual, budget-gated.
scrape-creators-pp-cli comments sweep bracken.design --since 7d --max-credits 200 --agent
Credit governance
account estimate — Project the credit cost of a planned run against your live balance and exit non-zero if it would exhaust the budget.
Run this before any bulk sweep so an agent never burns the balance mid-pipeline.
scrape-creators-pp-cli account estimate --posts 950 --with-replies flat --agent
account budget — See how fast you're spending API credits and how many days remain at the current pace.
Check runway before committing to a new recurring pipeline.
scrape-creators-pp-cli account budget --agent
Cross-platform intelligence
creator find — Given one handle, see which of 12 creator platforms the creator is on with follower counts side-by-side.
Start any collab qualification here before pulling per-platform detail.
scrape-creators-pp-cli creator find mkbhd --agent
creator compare — Compare two or more creators side-by-side on follower count, engagement rate, and content volume.
Strip vanity follower counts out of a collab decision.
scrape-creators-pp-cli creator compare mkbhd mrwhosetheboss --agent
content spikes — Surface the videos that performed far above a creator's own baseline — the ones that actually went viral.
Find outlier content without eyeballing hundreds of posts.
scrape-creators-pp-cli content spikes mkbhd --platform youtube
trends triangulate — Snapshot a hashtag or topic across platforms in one call to see which platform it is biggest on.
Decide where to publish before creating the content.
scrape-creators-pp-cli trends triangulate "matcha" --agent
Local state that compounds
transcripts search — FTS5 full-text search across every platform transcript you've synced — nine resource types spanning YouTube, TikTok, Instagram, Facebook, LinkedIn, Rumble, and more.
Search transcripts you already paid for instead of re-fetching them.
scrape-creators-pp-cli transcripts search "pricing objection" --limit 10
ads monitor — Snapshot a brand's live ads across Facebook, TikTok, Google, and LinkedIn ad libraries; on rerun, diff new ads versus ones that disappeared.
Rerun weekly and read only the delta of a competitor's ad activity.
scrape-creators-pp-cli ads monitor nike --agent
comments search — Full-text search across every synced comment and reply, offline.
Mine questions and complaints from comments you already pulled without spending credits.
scrape-creators-pp-cli comments search "refund" --limit 20
creator track — Append a follower snapshot per run on a chosen platform, then read the growth trajectory over time.
Track a partner's growth on a schedule you control.
scrape-creators-pp-cli creator track mkbhd --platform instagram
creator tagged — Snapshot the posts a creator or brand is tagged in and diff new mentions on rerun.
Weekly UGC check for a client brand without re-reading the full list.
scrape-creators-pp-cli creator tagged bracken.design --agent
Command Reference
account — Manage account
scrape-creators-pp-cli account list — Returns the number of API credits remaining on your Scrape Creators account.scrape-creators-pp-cli account list-getapiusage — Returns a paginated list of your API requests, including the endpoint called, status code, credits used, and timestamp.scrape-creators-pp-cli account list-getdailyusagecount — Returns aggregated daily usage statistics for the last 30 daysscrape-creators-pp-cli account list-getmostusedroutes — Returns your top 20 most called API endpoints ranked by call count, along with total credits consumed per endpoint.
amazon — Manage amazon
scrape-creators-pp-cli amazon — Scrapes a creator's Amazon Shop page by URL, returning their storefront profile and product collections.
apple-music — Scrape Apple Music artists, songs, albums, and search results
scrape-creators-pp-cli apple-music list — Retrieves public Apple Music album details, including title, artist, artwork, release info, tracksscrape-creators-pp-cli apple-music list-applemusic — Retrieves public Apple Music artist details, including artwork, editorial notes, top songs, albums, music videosscrape-creators-pp-cli apple-music list-applemusic-2 — Searches Apple Music and returns public result sections for artists, albums, songs, playlists, stationsscrape-creators-pp-cli apple-music list-applemusic-3 — Retrieves public Apple Music song details by id or URL. Album track URLs with an i= song id are supported.
bluesky — Get Bluesky posts and profile info
scrape-creators-pp-cli bluesky list — Fetches a single Bluesky post by URL, returning the post's record text, author info, embed content, replyCountscrape-creators-pp-cli bluesky list-profile — Retrieves a Bluesky user's public profile including handle, displayName, avatar, description, followersCountscrape-creators-pp-cli bluesky list-user — Fetches a paginated feed of posts from a Bluesky user, returning each post's uri, record text, author info
detect-age-gender — Manage detect age gender
scrape-creators-pp-cli detect-age-gender — Uses AI to analyze a creator's profile photo and estimate their age and gender.
facebook — Get public Facebook profiles and posts
scrape-creators-pp-cli facebook create — Fetches all ads currently running for a specific company from the Meta Ad Library.scrape-creators-pp-cli facebook create-adlibrary — Searches the Meta Ad Library by keyword and returns matching ads.scrape-creators-pp-cli facebook list — Get the events of a city. Check out this [link](https://www.facebook.scrape-creators-pp-cli facebook list-adlibrary — Retrieves detailed information about a specific Facebook ad by its ID or URL.scrape-creators-pp-cli facebook list-adlibrary-2 — Retrieves a transcript for a single Facebook Ad Library video ad by ID or URL.scrape-creators-pp-cli facebook list-adlibrary-3 — Fetches all ads currently running for a specific company from the Meta Ad Library.scrape-creators-pp-cli facebook list-adlibrary-4 — Searches the Meta Ad Library by keyword and returns matching ads.scrape-creators-pp-cli facebook list-adlibrary-5 — Searches for companies by name in the Meta Ad Library and returns their page IDs for use with other ad libraryscrape-creators-pp-cli facebook list-event — Get a specific event by its URL or idscrape-creators-pp-cli facebook list-events — Search for events by name.scrape-creators-pp-cli facebook list-group — Fetches the public information shown on a Facebook group's About page, including its description, privacy and visibilityscrape-creators-pp-cli facebook list-group-2 — Fetches posts from a public Facebook group, limited to 3 posts per page due to API limitations.scrape-creators-pp-cli facebook list-marketplace — Fetches details for a Facebook Marketplace item by item id or Marketplace item URL, including title, description, pricescrape-creators-pp-cli facebook list-marketplace-2 — Searches Facebook Marketplace listings by keyword and lat/lng. Supports pagination with the returned cursor.scrape-creators-pp-cli facebook list-marketplace-3 — Searches Facebook Marketplace locations/cities and returns coordinates you can use with the Marketplace Search endpoint.scrape-creators-pp-cli facebook list-post — Retrieves a single public Facebook post or reel by URL.scrape-creators-pp-cli facebook list-post-2 — Fetches comments from a Facebook post or reel with cursor-based pagination.scrape-creators-pp-cli facebook list-post-3 — Extracts the transcript text from a Facebook video post or reel.scrape-creators-pp-cli facebook list-post-4 — Get the replies to a comment.scrape-creators-pp-cli facebook list-profile — Retrieves public Facebook page details including category, address, email, phone, website, services, priceRange, ratingscrape-creators-pp-cli facebook list-profile-2 — Get the events of a public Facebook pagescrape-creators-pp-cli facebook list-profile-3 — Fetches photos from a public Facebook page with pagination support.scrape-creators-pp-cli facebook list-profile-4 — Returns publicly visible Facebook profile posts, limited to 3 posts per page due to API limitations.scrape-creators-pp-cli facebook list-profile-5 — Fetches up to 10 reels per request from a public Facebook page.
github — Scrape GitHub profiles, repositories, and public activity
scrape-creators-pp-cli github list — Retrieves public metadata for one GitHub repository, including owner, description, language, stars, forks, topicsscrape-creators-pp-cli github list-trending — Scrapes GitHub's public Trending developers page.scrape-creators-pp-cli github list-trending-2 — Scrapes GitHub's public Trending repositories page.scrape-creators-pp-cli github list-user — Retrieves public GitHub user details including name, bio, avatar, company, location, blog, follower countsscrape-creators-pp-cli github list-user-2 — Retrieves GitHub profile contribution activity for a user from the public profile activity timeline.scrape-creators-pp-cli github list-user-3 — Retrieves the public GitHub contribution graph for a user and yearscrape-creators-pp-cli github list-user-4 — Retrieves public GitHub followers for a user. Each follower includes login, avatar, user URL, type, and GitHub IDs.scrape-creators-pp-cli github list-user-5 — Retrieves public accounts followed by a GitHub user.scrape-creators-pp-cli github list-user-6 — Searches public GitHub pull requests authored by a user using GitHub's public search index.scrape-creators-pp-cli github list-user-7 — Retrieves a user's public repositories with repo metadata like description, language, stars, forks, topics, license
google — Scrape Google search results
scrape-creators-pp-cli google list — Retrieves detailed information about a specific Google ad including advertiserId, creativeId, format, firstShownscrape-creators-pp-cli google list-adlibrary — Searches the Google Ad Transparency Library for advertisers by name.scrape-creators-pp-cli google list-company — Fetches public ads for a company from the Google Ad Transparency Library by domain or advertiser_id.scrape-creators-pp-cli google list-search — Performs a Google search and returns organic results with url, title, and description for each result.
instagram — Gets Instagram profiles, posts, and reels
scrape-creators-pp-cli instagram list — Fetches a lightweight Instagram profile summary by user ID, returning username, full name, biographyscrape-creators-pp-cli instagram list-audio — Fetches the reels Instagram exposes for an audio page like instagram.com/reels/audio/{audio_id}/.scrape-creators-pp-cli instagram list-media — Generates an AI-powered speech-to-text transcription for an Instagram video post or reel.scrape-creators-pp-cli instagram list-post — Fetches detailed metadata for a single Instagram post or reel by shortcode or URL.scrape-creators-pp-cli instagram list-post-2 — Retrieves comments on a public Instagram post or reel.scrape-creators-pp-cli instagram list-post-3 — Retrieves the public replies to a specific Instagram comment.scrape-creators-pp-cli instagram list-profile — Retrieves public Instagram profile information including biography, bio linksscrape-creators-pp-cli instagram list-reels — Fetches trending reels from Instagram's public instagram.com/reels page.scrape-creators-pp-cli instagram list-reels-2 — Use this when you only want Google-indexed Instagram reels matching a keyword or phrasescrape-creators-pp-cli instagram list-search — Use this for Instagram-native account, hashtag, or place lookup.scrape-creators-pp-cli instagram list-search-2 — Use this when you know the exact hashtag and want Google-indexed public Instagram posts or reels, optional date filtersscrape-creators-pp-cli instagram list-search-3 — Use this to explore an Instagram topic and the posts Instagram curates for it.scrape-creators-pp-cli instagram list-search-4 — Use this for broad creator discovery from keywords found in Google-indexed Instagram profile pages, biosscrape-creators-pp-cli instagram list-user — Returns the raw HTML embed snippet for an Instagram user's profile widget.scrape-creators-pp-cli instagram list-user-2 — Lists all story highlight albums for an Instagram user.scrape-creators-pp-cli instagram list-user-3 — Returns a paginated list of a user's public Instagram reels (short-form videos).scrape-creators-pp-cli instagram list-user-4 — Returns up to 10 public posts per page from an Instagram user's Tagged tab.scrape-creators-pp-cli instagram list-user-5 — Returns a paginated feed of a user's public Instagram posts, including reels, photos, videos, and carousels.scrape-creators-pp-cli instagram list-user-6 — Fetches the full contents of a specific Instagram story highlight album by its ID.
kick — Scrape Kick clips
scrape-creators-pp-cli kick — Fetches detailed data for a Kick clip by URL, including video, metadata, and channel info.
komi — Scrape Komi pages
scrape-creators-pp-cli komi — Scrapes a Komi page by URL, extracting the creator's profile, social links, and featured content.
kwai — Scrape Kwai profiles, posts, and user feeds
scrape-creators-pp-cli kwai list — Fetches public Kwai post details including caption, media URLs, cover images, counts, author info, and music metadata.scrape-creators-pp-cli kwai list-profile — Fetches public Kwai profile data including username, bio, avatar, verification status, gender, and public counts.scrape-creators-pp-cli kwai list-user — Fetches a paginated list of public Kwai posts for a user, including captions, media URLs, covers, counts, author info
linkbio — Scrape Linkbio (lnk.bio) pages
scrape-creators-pp-cli linkbio — Scrapes a Linkbio (lnk.bio) page by URL, extracting the creator's profile and all their links.
linkedin — Scrape LinkedIn
scrape-creators-pp-cli linkedin list — Retrieves detailed information about a specific LinkedIn ad by URL.scrape-creators-pp-cli linkedin list-ads — Searches the LinkedIn Ad Library by company name, keyword, or companyId with optional country and date filters.scrape-creators-pp-cli linkedin list-company — Fetches a LinkedIn company page with details including name, description, logo, cover image, slogan, locationscrape-creators-pp-cli linkedin list-company-2 — Retrieves paginated posts from a LinkedIn company page, including each post's URL, ID, publication datescrape-creators-pp-cli linkedin list-post — Fetches a single LinkedIn post or article, returning the title, headline, full description textscrape-creators-pp-cli linkedin list-post-2 — Fetches the transcript from a LinkedIn post video when LinkedIn exposes one publicly.scrape-creators-pp-cli linkedin list-profile — Retrieves a person's public LinkedIn profile data, including their name, photo, location, follower count (followers)scrape-creators-pp-cli linkedin list-search — Finds public LinkedIn posts, feed updates, and Pulse articles by keyword using Google Search
linkme — Get Linkme profile info
scrape-creators-pp-cli linkme — Retrieves a Linkme profile by URL, including identity, social links, and contact details.
linktree — Scrape Linktree pages
scrape-creators-pp-cli linktree — Scrapes a Linktree page by URL, extracting the creator's profile and all their links.
pillar — Scrape Pillar pages
scrape-creators-pp-cli pillar — Scrapes a Pillar page by URL, extracting the creator's profile, social links, and products.
pinterest — Scrape Pinterest pins
scrape-creators-pp-cli pinterest list — Fetches a paginated list of pins from a Pinterest board by URL, returning each pin's id, description, title, imagesscrape-creators-pp-cli pinterest list-pin — Fetches detailed information about a single Pinterest pin by URL, returning title, description, link, dominantColorscrape-creators-pp-cli pinterest list-search — Searches Pinterest for pins matching a query, returning results with id, url, title, description, images, link, domainscrape-creators-pp-cli pinterest list-user — Fetches a paginated list of boards for a Pinterest user, returning each board's name, url, description, pin_count
reddit — Scrape Reddit posts and comments
scrape-creators-pp-cli reddit create — Retrieves comments and post details from a Reddit post by URL.scrape-creators-pp-cli reddit list — Searches across all of Reddit for posts matching a query.scrape-creators-pp-cli reddit list-post — Retrieves comments and post details from a Reddit post by URL.scrape-creators-pp-cli reddit list-post-2 — Gets the transcript from a Reddit video post or direct v.redd.it URL when Reddit exposes a VTT caption file.scrape-creators-pp-cli reddit list-subreddit — Fetches posts from a subreddit with sorting and filtering options.scrape-creators-pp-cli reddit list-subreddit-2 — Retrieves metadata about a subreddit by name or URL. The subreddit name must be case-sensitive.scrape-creators-pp-cli reddit list-subreddit-3 — Searches within a specific subreddit for posts, comments, and media matching a query.
rumble — Scrape Rumble search, videos, transcripts, and channel videos
scrape-creators-pp-cli rumble list — Searches Rumble videos by keyword.scrape-creators-pp-cli rumble list-channel — Gets videos from a Rumble channel by handle or URL.scrape-creators-pp-cli rumble list-video — Gets Rumble video details by URL.scrape-creators-pp-cli rumble list-video-2 — Gets all top level comments for a Rumble video by URL.scrape-creators-pp-cli rumble list-video-3 — Gets a Rumble video's transcript when captions are available.
snapchat — Scrape Snapchat user profiles and their stories
scrape-creators-pp-cli snapchat list — Retrieves a Snapchat user's public profile by handle, including identity, stories, and spotlight content.scrape-creators-pp-cli snapchat list-spotlight — Fetches public data for a Snapchat Spotlight video by URL.scrape-creators-pp-cli snapchat list-spotlight-2 — Fetches public comments from Snapchat's Spotlight comments API by URL.
soundcloud — Scrape SoundCloud playlists and tracks
scrape-creators-pp-cli soundcloud list — Fetches detailed information about a SoundCloud artist by its handle or URL.scrape-creators-pp-cli soundcloud list-artist — Fetches tracks/songs for a SoundCloud artist by handle or URL.scrape-creators-pp-cli soundcloud list-track — Fetches detailed information about a SoundCloud track/song by URL.
spotify — Scrape Spotify artists, songs, and albums
scrape-creators-pp-cli spotify list — Retrieves detailed information about a Spotify album by its id or URL, including album metadata, artists, release datescrape-creators-pp-cli spotify list-artist — Retrieves detailed information about a Spotify artist by their handle, including name, followers count, genresscrape-creators-pp-cli spotify list-podcast — Retrieves detailed information about a Spotify podcast by its id or URL.scrape-creators-pp-cli spotify list-podcast-2 — Returns episodes for a Spotify podcast. Pass the cursor returned by a response to get the next page.scrape-creators-pp-cli spotify list-search — Search Spotify for tracks, artists, albums, episodes, podcasts, and audiobooks.scrape-creators-pp-cli spotify list-track — Retrieves detailed information about a Spotify track by its id or URL, including track metadata, artists, album info
threads — Get Threads posts
scrape-creators-pp-cli threads list — Fetches a single Threads post by URL, returning the post's caption, like_count, view_counts, reshare_countscrape-creators-pp-cli threads list-profile — Retrieves a Threads user's public profile including username, full_name, biography, profile_pic_url, follower_countscrape-creators-pp-cli threads list-search — Searches Threads for posts matching a keyword, returning up to 10 results with caption text, like_count, reshare_countscrape-creators-pp-cli threads list-search-2 — Searches for Threads users by username, returning matching profiles with username, full_name, profile_pic_urlscrape-creators-pp-cli threads list-user — Fetches the most recent posts from a Threads user, returning id, caption text, code, like_count, reshare_count
tiktok — Scrape TikTok profiles, videos, and more
scrape-creators-pp-cli tiktok list — Fetches TikTok's trending/For You feed for a given region — useful for discovering viral content and what's currentlyscrape-creators-pp-cli tiktok list-adlibrary — Fetches one TikTok ad by ID or URL. It first checks Creative Center Top Ads (ads.tiktok.scrape-creators-pp-cli tiktok list-adlibrary-2 — Searches TikTok's public Ads Library by advertiser name or keyword.scrape-creators-pp-cli tiktok list-collection — Fetches the videos saved in a public TikTok collection, which TikTok also calls a playlist. Pass the collection URL.scrape-creators-pp-cli tiktok list-creators — Discovers trending and popular TikTok creators, filterable by follower count range, creator countryscrape-creators-pp-cli tiktok list-live — Gets curated room-level info for a TikTok live using TokAPI's live info endpoint.scrape-creators-pp-cli tiktok list-product — Fetches full details for a specific US TikTok Shop product by its URL, including stock levels and affiliate videos.scrape-creators-pp-cli tiktok list-profile — Fetches public profile data for a TikTok user by their handle or user_id — useful for looking up a creator's identityscrape-creators-pp-cli tiktok list-profile-2 — Returns the TikTok region code for a public profile, like US for United States or MX for Mexico.scrape-creators-pp-cli tiktok list-profile-3 — Fetches videos posted by a TikTok userscrape-creators-pp-cli tiktok list-search — Searches for TikTok videos under a specific hashtag — useful for finding content by topic or trend.scrape-creators-pp-cli tiktok list-search-2 — Searches for TikTok videos by keyword or phrase — the general video search across all of TikTok.scrape-creators-pp-cli tiktok list-search-3 — Gets the autocomplete suggestions TikTok shows while someone is typing in search.scrape-creators-pp-cli tiktok list-search-4 — Searches TikTok's 'Top' results by query — returns both videos and photo carouselsscrape-creators-pp-cli tiktok list-search-5 — Searches for TikTok users by keyword or name — useful for finding creators or accounts matching a query.scrape-creators-pp-cli tiktok list-shop — Lists all products from a specific TikTok Shop store by its URL.scrape-creators-pp-cli tiktok list-shop-2 — Searches TikTok Shop for products matching a keyword query.scrape-creators-pp-cli tiktok list-shop-3 — Fetches customer reviews for a TikTok Shop product by URL or product_id.scrape-creators-pp-cli tiktok list-song — Fetches detailed metadata for a specific TikTok sound or song by its clipId.scrape-creators-pp-cli tiktok list-song-2 — Fetches TikTok videos that use a specific sound or song, identified by its clipId.scrape-creators-pp-cli tiktok list-user — Retrieves audience demographic data for a TikTok user, showing where their followers are located by country.scrape-creators-pp-cli tiktok list-user-2 — Retrieves the follower list of a TikTok account by handle or user_id — useful for seeing who follows a creator orscrape-creators-pp-cli tiktok list-user-3 — Retrieves the following list — accounts that a TikTok user follows — by their handle.scrape-creators-pp-cli tiktok list-user-4 — Checks if a TikTok user is currently live streaming and retrieves their live room details.scrape-creators-pp-cli tiktok list-user-5 — Fetches products featured in a TikTok user's public showcase — the products a creator promotes on their profile.scrape-creators-pp-cli tiktok list-video — Fetches detailed data for a single TikTok video by URL, including its metadata, engagement statsscrape-creators-pp-cli tiktok list-video-2 — Fetches comments on a TikTok video by URL — useful for reading audience reactions, replies, and engagement.scrape-creators-pp-cli tiktok list-video-3 — Extracts the transcript, captions, or subtitles from a TikTok video by URL.scrape-creators-pp-cli tiktok list-video-4 — Fetches replies to a specific TikTok comment by its ID.
truthsocial — Manage truthsocial
scrape-creators-pp-cli truthsocial list — Fetches a single Truth Social post by URL, returning text, id, created_at, url, content, account detailsscrape-creators-pp-cli truthsocial list-profile — Retrieves a Truth Social user's public profile including display_name, username, avatar, header, followers_countscrape-creators-pp-cli truthsocial list-user — Fetches a paginated list of posts from a Truth Social user, returning text, id, created_at, url, content, account info
twitch — Scrape Twitch clips
scrape-creators-pp-cli twitch list — Fetches detailed data for a Twitch clip by URL, including metadata and direct video URLs.scrape-creators-pp-cli twitch list-profile — Retrieves a Twitch user's public profile by handle, including identity, social links, and content.scrape-creators-pp-cli twitch list-user — Fetches a user's schedule by handle, returning a list of scheduled events with start time, end time, title, descriptionscrape-creators-pp-cli twitch list-user-2 — Fetches a list of videos (100 max) for a Twitch user, returning each video's id, slug, url, embedURL, title, viewCount
twitter — Get Twitter profiles, tweets, followers and more
scrape-creators-pp-cli twitter list — Retrieves details about a Twitter/X Community by URL.scrape-creators-pp-cli twitter list-community — Fetches tweets posted within a Twitter/X Community by URL.scrape-creators-pp-cli twitter list-profile — Retrieves a Twitter user's profile by handle, including account metadata and statistics.scrape-creators-pp-cli twitter list-tweet — Retrieves detailed information about a specific tweet by URL, including the author's profile and engagement metrics.scrape-creators-pp-cli twitter list-tweet-2 — Extracts the transcript from a Twitter video tweet using AI-powered transcription.scrape-creators-pp-cli twitter list-usertweets — Fetches tweets from a Twitter user's profile by handle.
youtube — Scrape YouTube channels, videos, and more
scrape-creators-pp-cli youtube list — Retrieves YouTube channel profile data including name, avatar images, subscriber count (subscribers)scrape-creators-pp-cli youtube list-channel — Fetches community posts from a YouTube channel's Posts tab, including post ID, URL, content, images, attached videoscrape-creators-pp-cli youtube list-channel-2 — Fetches live streams and past streams from a YouTube channel's Live tab, including title, URL, thumbnail, view countscrape-creators-pp-cli youtube list-channel-3 — Fetches playlists from a YouTube channel's Playlists tab, including playlist ID, title, thumbnail, video countscrape-creators-pp-cli youtube list-channel-4 — Retrieves a paginated list of short-form videos (Shorts) from a YouTube channel, including each short's title, URLscrape-creators-pp-cli youtube list-channelvideos — Fetches a paginated list of videos uploaded by a YouTube channel, including each video's title, URL, thumbnailscrape-creators-pp-cli youtube list-communitypost — Retrieves the full details of a YouTube community post, including its text content, attached images, like countscrape-creators-pp-cli youtube list-playlist — Retrieves all videos in a YouTube playlist, including the playlist title, owner info, total video countscrape-creators-pp-cli youtube list-search — Searches YouTube by keyword query and returns matching videos, channels, playlists, shorts, shelves, and live streams.scrape-creators-pp-cli youtube list-search-2 — Searches YouTube for content matching a specific hashtag and returns matching videos with title, URL, thumbnailscrape-creators-pp-cli youtube list-shorts — Fetches approximately 48 currently trending YouTube Shorts (viral/popular short-form videos) per callscrape-creators-pp-cli youtube list-video — Fetches full details for a YouTube video or short, including title, description, thumbnail, view count (views)scrape-creators-pp-cli youtube list-video-2 — Fetches comments and replies from a YouTube video, including each comment's text content, author details, like countscrape-creators-pp-cli youtube list-video-3 — Experimental endpoint.scrape-creators-pp-cli youtube list-video-4 — Retrieves the captions, subtitles, or transcript of a YouTube video or Short.scrape-creators-pp-cli youtube list-video-5 — Fetches replies to a specific comment on a YouTube video, including each reply's text content, author details (name
Finding the right command
When you know what you want to do but not which command does it, ask the CLI directly:
scrape-creators-pp-cli which "<capability in your own words>"
which resolves a natural-language capability query to the best matching command from this CLI's curated feature index. Exit code 0 means at least one match; exit code 2 means no confident match — fall back to --help or use a narrower query.
Recipes
Complete comment mining for one post
scrape-creators-pp-cli comments thread <post-url> --agent --select comments.text,comments.replies.text
Fetches every top-level comment and reply with cost-aware routing, then narrows the envelope to just the text fields an agent needs.
Budget-gated weekly sweep
scrape-creators-pp-cli comments sweep <handle> --since 7d --max-credits 200 --agent
Pulls the week's posts and their comments, stopping cleanly when the credit budget is hit.
Find the gaps before spending
scrape-creators-pp-cli comments coverage <handle> --agent
Ranks synced posts by missing-thread gap so reply credits go only where threads are incomplete.
Offline comment mining
scrape-creators-pp-cli comments search "delivery" --limit 20
FTS5 search over the synced corpus — zero credits.
Collab qualification in two calls
scrape-creators-pp-cli creator find <handle> --agent && scrape-creators-pp-cli creator compare <handle> <rival> --agent
Presence matrix first, then engagement comparison to strip vanity followers.
Auth Setup
Run scrape-creators-pp-cli auth setup to print the URL and steps for getting a key (add --launch to open the URL). Then set:
export SCRAPECREATORS_API_KEY="<your-key>"
To persist credentials, use scrape-creators-pp-cli auth set-token <token>. Stored secrets live in credentials.toml under the data dir, not in config.toml.
Run scrape-creators-pp-cli doctor to verify setup.
Agent Mode
Add --agent to any command. Expands to: --json --compact --no-input --no-color --yes.
Pipeable — JSON on stdout, errors on stderr
Filterable — --select keeps a subset of fields. Dotted paths descend into nested structures; arrays traverse element-wise. Critical for keeping context small on verbose APIs:
scrape-creators-pp-cli account list --agent --select id,name,status
Previewable — --dry-run shows the request without sending
Offline-friendly — sync/search commands can use the local SQLite store when available
Non-interactive — never prompts, every input is a flag
Explicit retries — use --idempotent only when an already-existing create should count as success
Response envelope
Commands that read from the local store or the API wrap output in a provenance envelope:
{
"meta": {"source": "live" | "local", "synced_at": "...", "reason": "..."},
"results": <data>
}
Parse .results for data and .meta.source to know whether it's live or local. A human-readable N results (live) summary is printed to stderr only when stdout is a terminal AND no machine-format flag (--json, --csv, --compact, --quiet, --plain, --select) is set — piped/agent consumers and explicit-format runs get pure JSON on stdout.
Paths and state
Agents should treat the CLI's path resolver as part of the runtime contract:
Use --home <dir> for one invocation, or set SCRAPE_CREATORS_HOME=<dir> to relocate all four path kinds under one root.
Use per-kind env vars only when a specific kind must diverge: SCRAPE_CREATORS_CONFIG_DIR, SCRAPE_CREATORS_DATA_DIR, SCRAPE_CREATORS_STATE_DIR, SCRAPE_CREATORS_CACHE_DIR.
Resolution order is per-kind env var, --home, SCRAPE_CREATORS_HOME, XDG (XDG_CONFIG_HOME, XDG_DATA_HOME, XDG_STATE_HOME, XDG_CACHE_HOME), then platform defaults.
config contains settings like config.toml and profiles. data contains credentials.toml, data.db, cookies, and auth sidecars. state contains persisted queries, jobs, and teach.log. cache contains regenerable HTTP/cache files.
Stored secrets live in credentials.toml under the data dir. Existing legacy config.toml secrets are read for compatibility and leave config.toml on the first auth write.
Run scrape-creators-pp-cli doctor --fail-on warn to surface path and credential-location warnings. agent-context exposes a schema v4 paths block for agents that need the resolved dirs.
For MCP, pass relocation through the MCP host config. The MCP binary does not inherit CLI flags:
{
"mcpServers": {
"scrape-creators": {
"command": "scrape-creators-pp-mcp",
"env": {
"SCRAPE_CREATORS_HOME": "/srv/scrape-creators"
}
}
}
}
Fleet precedence: an inherited per-kind env var overrides an explicit --home for that kind. Use SCRAPE_CREATORS_HOME or per-kind vars as durable fleet levers, and use --home only for a single invocation. Relocation is not reversible by unsetting env vars; move files manually before clearing SCRAPE_CREATORS_HOME, or doctor will not find credentials left under the former root.
Automatic learning
This CLI ships a self-capturing learning loop. The CLI does its own bookkeeping: every invocation is journaled locally, a failed flag followed by a corrected retry auto-derives a flag_alias candidate, and a teach on a query family without a playbook auto-synthesizes a playbook_candidate from the session's journal. Your job is judgment only: recall first, act on surfaced candidates, teach the final answer, playbook amend when you observe a correction. You never record failures by hand.
Step 1: recall before any discovery
Before list/search/drill commands on a new user question, run:
scrape-creators-pp-cli recall "<user's question>" --agent
The response envelope:
{
"query": "...",
"normalized": "<normalized form>",
"query_entities": ["..."],
"found": true | false,
"match_score": 0
…(truncated)
1---2name: pp-scrape-creators3description: Every Scrape Creators endpoint across 28 platforms, with credit-aware comment mining and a local corpus no other Scrape Creators tool has. Trigger phrases: `find which platforms a creator is on`, `pull the comments and replies from this post`, `monitor a brand's ads`, `search creator transcripts for a keyword`, `how many credits would this sweep cost`, `use scrape creators`, `run scrape-creators`.4license: Apache-2.05---6<!-- GENERATED FILE — DO NOT EDIT.
7 This file is a verbatim mirror of library/developer-tools/scrape-creators/SKILL.md,
8 regenerated post-merge by tools/generate-skills/. Hand-edits here are
9 silently overwritten on the next regen. Edit the library/ source instead.
10 See the repository agent guide, section "Generated artifacts: registry.json, cli-skills/". -->
11
12# Scrape Creators — Printing Press CLI
13
14## Prerequisites: Install the CLI
15
16This skill drives the `scrape-creators-pp-cli` binary. **You must verify the CLI is installed before invoking any command from this skill.** If it is missing, install it first:
17
181. Install via the Printing Press installer. It defaults binaries to `$HOME/.local/bin` on macOS/Linux and `%LOCALAPPDATA%\Programs\PrintingPress\bin` on Windows:
19 ```bash
20 npx -y @mvanhorn/printing-press-library install scrape-creators --cli-only
21 ```
222. Verify: `scrape-creators-pp-cli --version`
233. Ensure the reported install directory is on `$PATH` for the agent/runtime that will invoke this skill.
24
25If the `npx` install fails (no Node, offline, etc.), fall back to a direct Go install (requires Go 1.26.6 or newer). This installs into `$GOPATH/bin` (default `$HOME/go/bin`), so add that directory to `$PATH` instead:
26
27```bash
28go install github.com/mvanhorn/printing-press-library/library/developer-tools/scrape-creators/cmd/scrape-creators-pp-cli@latest
29```
30
31If `--version` reports "command not found" after install, the runtime cannot see the binary directory on `$PATH`. Do not proceed with skill commands until verification succeeds.
32
33The official CLI mirrors endpoints and the official skills describe curl workflows; neither remembers anything between runs. This CLI syncs profiles, posts, comments with their replies, transcripts, and ads into SQLite with FTS5 search, routes comment-thread fetches on credit economics (comments thread), audits reply completeness against ground truth (comments coverage), and gates expensive sweeps behind a pre-flight credit estimate (account estimate).
34
35## When to Use This CLI
36
37Use this CLI when a task touches public social-media data at scale: mining comments and replies for a brand, qualifying creators across platforms, monitoring competitor ads, or searching transcript/comment corpora you have already synced. It is the right choice whenever credit economics matter — its thread routing, sweep budgets, and pre-flight estimates exist so agents never spend blind.
38
39## Anti-triggers
40
41Do not use this CLI for:
42- Do not use this CLI to post, like, follow, or message on any platform — it is read-only public-data scraping
43- Do not use it for private/logged-in-only content; it sees what the public sees
44- Do not use it as a general web scraper for non-social sites; use a crawling tool instead
45
46## Unique Capabilities
47
48These capabilities aren't available in any other tool for this API.
49
50### Comment-thread completeness
51- **`comments thread`** — Fetch one post's complete comment threads, automatically picking the cheaper route between the 15-credit flat include_replies call and 1-credit per-comment reply calls (don't trust child_comment_count to decide: it's unreliable). By default only the first page of top-level comments is fetched and `truncated: true` reports when more exist; pass `--max-credits N` to keep traversing further pages under a credit budget that gates every paid call (the envelope's `note` says why a traversal stopped).
52
53 _Reach for this when you need every reply on a post without doing credit arithmetic by hand._
54
55 ```bash
56 scrape-creators-pp-cli comments thread https://www.instagram.com/reel/C8rKmYvsrck --agent
57 scrape-creators-pp-cli comments thread https://www.instagram.com/reel/C8rKmYvsrck --max-credits 60 --agent
58 ```
59- **`comments coverage`** — Rank synced posts by how many comments the API reported versus how many actually landed in your local store — ground truth where the API's child_comment_count is unreliable as a thread filter.
60
61 _Reach for this after a sweep to find which posts are silently missing their replies._
62
63 ```bash
64 scrape-creators-pp-cli comments coverage bracken.design --agent
65 ```
66- **`comments sweep`** — Pull recent posts for a handle and their comments in one command, stopping cleanly at a credit budget you set.
67
68 _The one-command version of a multi-hundred-post comment-mining ritual, budget-gated._
69
70 ```bash
71 scrape-creators-pp-cli comments sweep bracken.design --since 7d --max-credits 200 --agent
72 ```
73
74### Credit governance
75- **`account estimate`** — Project the credit cost of a planned run against your live balance and exit non-zero if it would exhaust the budget.
76
77 _Run this before any bulk sweep so an agent never burns the balance mid-pipeline._
78
79 ```bash
80 scrape-creators-pp-cli account estimate --posts 950 --with-replies flat --agent
81 ```
82- **`account budget`** — See how fast you're spending API credits and how many days remain at the current pace.
83
84 _Check runway before committing to a new recurring pipeline._
85
86 ```bash
87 scrape-creators-pp-cli account budget --agent
88 ```
89
90### Cross-platform intelligence
91- **`creator find`** — Given one handle, see which of 12 creator platforms the creator is on with follower counts side-by-side.
92
93 _Start any collab qualification here before pulling per-platform detail._
94
95 ```bash
96 scrape-creators-pp-cli creator find mkbhd --agent
97 ```
98- **`creator compare`** — Compare two or more creators side-by-side on follower count, engagement rate, and content volume.
99
100 _Strip vanity follower counts out of a collab decision._
101
102 ```bash
103 scrape-creators-pp-cli creator compare mkbhd mrwhosetheboss --agent
104 ```
105- **`content spikes`** — Surface the videos that performed far above a creator's own baseline — the ones that actually went viral.
106
107 _Find outlier content without eyeballing hundreds of posts._
108
109 ```bash
110 scrape-creators-pp-cli content spikes mkbhd --platform youtube
111 ```
112- **`trends triangulate`** — Snapshot a hashtag or topic across platforms in one call to see which platform it is biggest on.
113
114 _Decide where to publish before creating the content._
115
116 ```bash
117 scrape-creators-pp-cli trends triangulate "matcha" --agent
118 ```
119
120### Local state that compounds
121- **`transcripts search`** — FTS5 full-text search across every platform transcript you've synced — nine resource types spanning YouTube, TikTok, Instagram, Facebook, LinkedIn, Rumble, and more.
122
123 _Search transcripts you already paid for instead of re-fetching them._
124
125 ```bash
126 scrape-creators-pp-cli transcripts search "pricing objection" --limit 10
127 ```
128- **`ads monitor`** — Snapshot a brand's live ads across Facebook, TikTok, Google, and LinkedIn ad libraries; on rerun, diff new ads versus ones that disappeared.
129
130 _Rerun weekly and read only the delta of a competitor's ad activity._
131
132 ```bash
133 scrape-creators-pp-cli ads monitor nike --agent
134 ```
135- **`comments search`** — Full-text search across every synced comment and reply, offline.
136
137 _Mine questions and complaints from comments you already pulled without spending credits._
138
139 ```bash
140 scrape-creators-pp-cli comments search "refund" --limit 20
141 ```
142- **`creator track`** — Append a follower snapshot per run on a chosen platform, then read the growth trajectory over time.
143
144 _Track a partner's growth on a schedule you control._
145
146 ```bash
147 scrape-creators-pp-cli creator track mkbhd --platform instagram
148 ```
149- **`creator tagged`** — Snapshot the posts a creator or brand is tagged in and diff new mentions on rerun.
150
151 _Weekly UGC check for a client brand without re-reading the full list._
152
153 ```bash
154 scrape-creators-pp-cli creator tagged bracken.design --agent
155 ```
156
157## Command Reference
158
159**account** — Manage account
160
161- `scrape-creators-pp-cli account list` — Returns the number of API credits remaining on your Scrape Creators account.
162- `scrape-creators-pp-cli account list-getapiusage` — Returns a paginated list of your API requests, including the endpoint called, status code, credits used, and timestamp.
163- `scrape-creators-pp-cli account list-getdailyusagecount` — Returns aggregated daily usage statistics for the last 30 days
164- `scrape-creators-pp-cli account list-getmostusedroutes` — Returns your top 20 most called API endpoints ranked by call count, along with total credits consumed per endpoint.
165
166**amazon** — Manage amazon
167
168- `scrape-creators-pp-cli amazon` — Scrapes a creator's Amazon Shop page by URL, returning their storefront profile and product collections.
169
170**apple-music** — Scrape Apple Music artists, songs, albums, and search results
171
172- `scrape-creators-pp-cli apple-music list` — Retrieves public Apple Music album details, including title, artist, artwork, release info, tracks
173- `scrape-creators-pp-cli apple-music list-applemusic` — Retrieves public Apple Music artist details, including artwork, editorial notes, top songs, albums, music videos
174- `scrape-creators-pp-cli apple-music list-applemusic-2` — Searches Apple Music and returns public result sections for artists, albums, songs, playlists, stations
175- `scrape-creators-pp-cli apple-music list-applemusic-3` — Retrieves public Apple Music song details by id or URL. Album track URLs with an i= song id are supported.
176
177**bluesky** — Get Bluesky posts and profile info
178
179- `scrape-creators-pp-cli bluesky list` — Fetches a single Bluesky post by URL, returning the post's record text, author info, embed content, replyCount
180- `scrape-creators-pp-cli bluesky list-profile` — Retrieves a Bluesky user's public profile including handle, displayName, avatar, description, followersCount
181- `scrape-creators-pp-cli bluesky list-user` — Fetches a paginated feed of posts from a Bluesky user, returning each post's uri, record text, author info
182
183**detect-age-gender** — Manage detect age gender
184
185- `scrape-creators-pp-cli detect-age-gender` — Uses AI to analyze a creator's profile photo and estimate their age and gender.
186
187**facebook** — Get public Facebook profiles and posts
188
189- `scrape-creators-pp-cli facebook create` — Fetches all ads currently running for a specific company from the Meta Ad Library.
190- `scrape-creators-pp-cli facebook create-adlibrary` — Searches the Meta Ad Library by keyword and returns matching ads.
191- `scrape-creators-pp-cli facebook list` — Get the events of a city. Check out this [link](https://www.facebook.
192- `scrape-creators-pp-cli facebook list-adlibrary` — Retrieves detailed information about a specific Facebook ad by its ID or URL.
193- `scrape-creators-pp-cli facebook list-adlibrary-2` — Retrieves a transcript for a single Facebook Ad Library video ad by ID or URL.
194- `scrape-creators-pp-cli facebook list-adlibrary-3` — Fetches all ads currently running for a specific company from the Meta Ad Library.
195- `scrape-creators-pp-cli facebook list-adlibrary-4` — Searches the Meta Ad Library by keyword and returns matching ads.
196- `scrape-creators-pp-cli facebook list-adlibrary-5` — Searches for companies by name in the Meta Ad Library and returns their page IDs for use with other ad library
197- `scrape-creators-pp-cli facebook list-event` — Get a specific event by its URL or id
198- `scrape-creators-pp-cli facebook list-events` — Search for events by name.
199- `scrape-creators-pp-cli facebook list-group` — Fetches the public information shown on a Facebook group's About page, including its description, privacy and visibility
200- `scrape-creators-pp-cli facebook list-group-2` — Fetches posts from a public Facebook group, limited to 3 posts per page due to API limitations.
201- `scrape-creators-pp-cli facebook list-marketplace` — Fetches details for a Facebook Marketplace item by item id or Marketplace item URL, including title, description, price
202- `scrape-creators-pp-cli facebook list-marketplace-2` — Searches Facebook Marketplace listings by keyword and lat/lng. Supports pagination with the returned cursor.
203- `scrape-creators-pp-cli facebook list-marketplace-3` — Searches Facebook Marketplace locations/cities and returns coordinates you can use with the Marketplace Search endpoint.
204- `scrape-creators-pp-cli facebook list-post` — Retrieves a single public Facebook post or reel by URL.
205- `scrape-creators-pp-cli facebook list-post-2` — Fetches comments from a Facebook post or reel with cursor-based pagination.
206- `scrape-creators-pp-cli facebook list-post-3` — Extracts the transcript text from a Facebook video post or reel.
207- `scrape-creators-pp-cli facebook list-post-4` — Get the replies to a comment.
208- `scrape-creators-pp-cli facebook list-profile` — Retrieves public Facebook page details including category, address, email, phone, website, services, priceRange, rating
209- `scrape-creators-pp-cli facebook list-profile-2` — Get the events of a public Facebook page
210- `scrape-creators-pp-cli facebook list-profile-3` — Fetches photos from a public Facebook page with pagination support.
211- `scrape-creators-pp-cli facebook list-profile-4` — Returns publicly visible Facebook profile posts, limited to 3 posts per page due to API limitations.
212- `scrape-creators-pp-cli facebook list-profile-5` — Fetches up to 10 reels per request from a public Facebook page.
213
214**github** — Scrape GitHub profiles, repositories, and public activity
215
216- `scrape-creators-pp-cli github list` — Retrieves public metadata for one GitHub repository, including owner, description, language, stars, forks, topics
217- `scrape-creators-pp-cli github list-trending` — Scrapes GitHub's public Trending developers page.
218- `scrape-creators-pp-cli github list-trending-2` — Scrapes GitHub's public Trending repositories page.
219- `scrape-creators-pp-cli github list-user` — Retrieves public GitHub user details including name, bio, avatar, company, location, blog, follower counts
220- `scrape-creators-pp-cli github list-user-2` — Retrieves GitHub profile contribution activity for a user from the public profile activity timeline.
221- `scrape-creators-pp-cli github list-user-3` — Retrieves the public GitHub contribution graph for a user and year
222- `scrape-creators-pp-cli github list-user-4` — Retrieves public GitHub followers for a user. Each follower includes login, avatar, user URL, type, and GitHub IDs.
223- `scrape-creators-pp-cli github list-user-5` — Retrieves public accounts followed by a GitHub user.
224- `scrape-creators-pp-cli github list-user-6` — Searches public GitHub pull requests authored by a user using GitHub's public search index.
225- `scrape-creators-pp-cli github list-user-7` — Retrieves a user's public repositories with repo metadata like description, language, stars, forks, topics, license
226
227**google** — Scrape Google search results
228
229- `scrape-creators-pp-cli google list` — Retrieves detailed information about a specific Google ad including advertiserId, creativeId, format, firstShown
230- `scrape-creators-pp-cli google list-adlibrary` — Searches the Google Ad Transparency Library for advertisers by name.
231- `scrape-creators-pp-cli google list-company` — Fetches public ads for a company from the Google Ad Transparency Library by domain or advertiser_id.
232- `scrape-creators-pp-cli google list-search` — Performs a Google search and returns organic results with url, title, and description for each result.
233
234**instagram** — Gets Instagram profiles, posts, and reels
235
236- `scrape-creators-pp-cli instagram list` — Fetches a lightweight Instagram profile summary by user ID, returning username, full name, biography
237- `scrape-creators-pp-cli instagram list-audio` — Fetches the reels Instagram exposes for an audio page like instagram.com/reels/audio/{audio_id}/.
238- `scrape-creators-pp-cli instagram list-media` — Generates an AI-powered speech-to-text transcription for an Instagram video post or reel.
239- `scrape-creators-pp-cli instagram list-post` — Fetches detailed metadata for a single Instagram post or reel by shortcode or URL.
240- `scrape-creators-pp-cli instagram list-post-2` — Retrieves comments on a public Instagram post or reel.
241- `scrape-creators-pp-cli instagram list-post-3` — Retrieves the public replies to a specific Instagram comment.
242- `scrape-creators-pp-cli instagram list-profile` — Retrieves public Instagram profile information including biography, bio links
243- `scrape-creators-pp-cli instagram list-reels` — Fetches trending reels from Instagram's public instagram.com/reels page.
244- `scrape-creators-pp-cli instagram list-reels-2` — Use this when you only want Google-indexed Instagram reels matching a keyword or phrase
245- `scrape-creators-pp-cli instagram list-search` — Use this for Instagram-native account, hashtag, or place lookup.
246- `scrape-creators-pp-cli instagram list-search-2` — Use this when you know the exact hashtag and want Google-indexed public Instagram posts or reels, optional date filters
247- `scrape-creators-pp-cli instagram list-search-3` — Use this to explore an Instagram topic and the posts Instagram curates for it.
248- `scrape-creators-pp-cli instagram list-search-4` — Use this for broad creator discovery from keywords found in Google-indexed Instagram profile pages, bios
249- `scrape-creators-pp-cli instagram list-user` — Returns the raw HTML embed snippet for an Instagram user's profile widget.
250- `scrape-creators-pp-cli instagram list-user-2` — Lists all story highlight albums for an Instagram user.
251- `scrape-creators-pp-cli instagram list-user-3` — Returns a paginated list of a user's public Instagram reels (short-form videos).
252- `scrape-creators-pp-cli instagram list-user-4` — Returns up to 10 public posts per page from an Instagram user's Tagged tab.
253- `scrape-creators-pp-cli instagram list-user-5` — Returns a paginated feed of a user's public Instagram posts, including reels, photos, videos, and carousels.
254- `scrape-creators-pp-cli instagram list-user-6` — Fetches the full contents of a specific Instagram story highlight album by its ID.
255
256**kick** — Scrape Kick clips
257
258- `scrape-creators-pp-cli kick` — Fetches detailed data for a Kick clip by URL, including video, metadata, and channel info.
259
260**komi** — Scrape Komi pages
261
262- `scrape-creators-pp-cli komi` — Scrapes a Komi page by URL, extracting the creator's profile, social links, and featured content.
263
264**kwai** — Scrape Kwai profiles, posts, and user feeds
265
266- `scrape-creators-pp-cli kwai list` — Fetches public Kwai post details including caption, media URLs, cover images, counts, author info, and music metadata.
267- `scrape-creators-pp-cli kwai list-profile` — Fetches public Kwai profile data including username, bio, avatar, verification status, gender, and public counts.
268- `scrape-creators-pp-cli kwai list-user` — Fetches a paginated list of public Kwai posts for a user, including captions, media URLs, covers, counts, author info
269
270**linkbio** — Scrape Linkbio (lnk.bio) pages
271
272- `scrape-creators-pp-cli linkbio` — Scrapes a Linkbio (lnk.bio) page by URL, extracting the creator's profile and all their links.
273
274**linkedin** — Scrape LinkedIn
275
276- `scrape-creators-pp-cli linkedin list` — Retrieves detailed information about a specific LinkedIn ad by URL.
277- `scrape-creators-pp-cli linkedin list-ads` — Searches the LinkedIn Ad Library by company name, keyword, or companyId with optional country and date filters.
278- `scrape-creators-pp-cli linkedin list-company` — Fetches a LinkedIn company page with details including name, description, logo, cover image, slogan, location
279- `scrape-creators-pp-cli linkedin list-company-2` — Retrieves paginated posts from a LinkedIn company page, including each post's URL, ID, publication date
280- `scrape-creators-pp-cli linkedin list-post` — Fetches a single LinkedIn post or article, returning the title, headline, full description text
281- `scrape-creators-pp-cli linkedin list-post-2` — Fetches the transcript from a LinkedIn post video when LinkedIn exposes one publicly.
282- `scrape-creators-pp-cli linkedin list-profile` — Retrieves a person's public LinkedIn profile data, including their name, photo, location, follower count (followers)
283- `scrape-creators-pp-cli linkedin list-search` — Finds public LinkedIn posts, feed updates, and Pulse articles by keyword using Google Search
284
285**linkme** — Get Linkme profile info
286
287- `scrape-creators-pp-cli linkme` — Retrieves a Linkme profile by URL, including identity, social links, and contact details.
288
289**linktree** — Scrape Linktree pages
290
291- `scrape-creators-pp-cli linktree` — Scrapes a Linktree page by URL, extracting the creator's profile and all their links.
292
293**pillar** — Scrape Pillar pages
294
295- `scrape-creators-pp-cli pillar` — Scrapes a Pillar page by URL, extracting the creator's profile, social links, and products.
296
297**pinterest** — Scrape Pinterest pins
298
299- `scrape-creators-pp-cli pinterest list` — Fetches a paginated list of pins from a Pinterest board by URL, returning each pin's id, description, title, images
300- `scrape-creators-pp-cli pinterest list-pin` — Fetches detailed information about a single Pinterest pin by URL, returning title, description, link, dominantColor
301- `scrape-creators-pp-cli pinterest list-search` — Searches Pinterest for pins matching a query, returning results with id, url, title, description, images, link, domain
302- `scrape-creators-pp-cli pinterest list-user` — Fetches a paginated list of boards for a Pinterest user, returning each board's name, url, description, pin_count
303
304**reddit** — Scrape Reddit posts and comments
305
306- `scrape-creators-pp-cli reddit create` — Retrieves comments and post details from a Reddit post by URL.
307- `scrape-creators-pp-cli reddit list` — Searches across all of Reddit for posts matching a query.
308- `scrape-creators-pp-cli reddit list-post` — Retrieves comments and post details from a Reddit post by URL.
309- `scrape-creators-pp-cli reddit list-post-2` — Gets the transcript from a Reddit video post or direct v.redd.it URL when Reddit exposes a VTT caption file.
310- `scrape-creators-pp-cli reddit list-subreddit` — Fetches posts from a subreddit with sorting and filtering options.
311- `scrape-creators-pp-cli reddit list-subreddit-2` — Retrieves metadata about a subreddit by name or URL. The subreddit name must be case-sensitive.
312- `scrape-creators-pp-cli reddit list-subreddit-3` — Searches within a specific subreddit for posts, comments, and media matching a query.
313
314**rumble** — Scrape Rumble search, videos, transcripts, and channel videos
315
316- `scrape-creators-pp-cli rumble list` — Searches Rumble videos by keyword.
317- `scrape-creators-pp-cli rumble list-channel` — Gets videos from a Rumble channel by handle or URL.
318- `scrape-creators-pp-cli rumble list-video` — Gets Rumble video details by URL.
319- `scrape-creators-pp-cli rumble list-video-2` — Gets all top level comments for a Rumble video by URL.
320- `scrape-creators-pp-cli rumble list-video-3` — Gets a Rumble video's transcript when captions are available.
321
322**snapchat** — Scrape Snapchat user profiles and their stories
323
324- `scrape-creators-pp-cli snapchat list` — Retrieves a Snapchat user's public profile by handle, including identity, stories, and spotlight content.
325- `scrape-creators-pp-cli snapchat list-spotlight` — Fetches public data for a Snapchat Spotlight video by URL.
326- `scrape-creators-pp-cli snapchat list-spotlight-2` — Fetches public comments from Snapchat's Spotlight comments API by URL.
327
328**soundcloud** — Scrape SoundCloud playlists and tracks
329
330- `scrape-creators-pp-cli soundcloud list` — Fetches detailed information about a SoundCloud artist by its handle or URL.
331- `scrape-creators-pp-cli soundcloud list-artist` — Fetches tracks/songs for a SoundCloud artist by handle or URL.
332- `scrape-creators-pp-cli soundcloud list-track` — Fetches detailed information about a SoundCloud track/song by URL.
333
334**spotify** — Scrape Spotify artists, songs, and albums
335
336- `scrape-creators-pp-cli spotify list` — Retrieves detailed information about a Spotify album by its id or URL, including album metadata, artists, release date
337- `scrape-creators-pp-cli spotify list-artist` — Retrieves detailed information about a Spotify artist by their handle, including name, followers count, genres
338- `scrape-creators-pp-cli spotify list-podcast` — Retrieves detailed information about a Spotify podcast by its id or URL.
339- `scrape-creators-pp-cli spotify list-podcast-2` — Returns episodes for a Spotify podcast. Pass the cursor returned by a response to get the next page.
340- `scrape-creators-pp-cli spotify list-search` — Search Spotify for tracks, artists, albums, episodes, podcasts, and audiobooks.
341- `scrape-creators-pp-cli spotify list-track` — Retrieves detailed information about a Spotify track by its id or URL, including track metadata, artists, album info
342
343**threads** — Get Threads posts
344
345- `scrape-creators-pp-cli threads list` — Fetches a single Threads post by URL, returning the post's caption, like_count, view_counts, reshare_count
346- `scrape-creators-pp-cli threads list-profile` — Retrieves a Threads user's public profile including username, full_name, biography, profile_pic_url, follower_count
347- `scrape-creators-pp-cli threads list-search` — Searches Threads for posts matching a keyword, returning up to 10 results with caption text, like_count, reshare_count
348- `scrape-creators-pp-cli threads list-search-2` — Searches for Threads users by username, returning matching profiles with username, full_name, profile_pic_url
349- `scrape-creators-pp-cli threads list-user` — Fetches the most recent posts from a Threads user, returning id, caption text, code, like_count, reshare_count
350
351**tiktok** — Scrape TikTok profiles, videos, and more
352
353- `scrape-creators-pp-cli tiktok list` — Fetches TikTok's trending/For You feed for a given region — useful for discovering viral content and what's currently
354- `scrape-creators-pp-cli tiktok list-adlibrary` — Fetches one TikTok ad by ID or URL. It first checks Creative Center Top Ads (ads.tiktok.
355- `scrape-creators-pp-cli tiktok list-adlibrary-2` — Searches TikTok's public Ads Library by advertiser name or keyword.
356- `scrape-creators-pp-cli tiktok list-collection` — Fetches the videos saved in a public TikTok collection, which TikTok also calls a playlist. Pass the collection URL.
357- `scrape-creators-pp-cli tiktok list-creators` — Discovers trending and popular TikTok creators, filterable by follower count range, creator country
358- `scrape-creators-pp-cli tiktok list-live` — Gets curated room-level info for a TikTok live using TokAPI's live info endpoint.
359- `scrape-creators-pp-cli tiktok list-product` — Fetches full details for a specific US TikTok Shop product by its URL, including stock levels and affiliate videos.
360- `scrape-creators-pp-cli tiktok list-profile` — Fetches public profile data for a TikTok user by their handle or user_id — useful for looking up a creator's identity
361- `scrape-creators-pp-cli tiktok list-profile-2` — Returns the TikTok region code for a public profile, like `US` for United States or `MX` for Mexico.
362- `scrape-creators-pp-cli tiktok list-profile-3` — Fetches videos posted by a TikTok user
363- `scrape-creators-pp-cli tiktok list-search` — Searches for TikTok videos under a specific hashtag — useful for finding content by topic or trend.
364- `scrape-creators-pp-cli tiktok list-search-2` — Searches for TikTok videos by keyword or phrase — the general video search across all of TikTok.
365- `scrape-creators-pp-cli tiktok list-search-3` — Gets the autocomplete suggestions TikTok shows while someone is typing in search.
366- `scrape-creators-pp-cli tiktok list-search-4` — Searches TikTok's 'Top' results by query — returns both videos and photo carousels
367- `scrape-creators-pp-cli tiktok list-search-5` — Searches for TikTok users by keyword or name — useful for finding creators or accounts matching a query.
368- `scrape-creators-pp-cli tiktok list-shop` — Lists all products from a specific TikTok Shop store by its URL.
369- `scrape-creators-pp-cli tiktok list-shop-2` — Searches TikTok Shop for products matching a keyword query.
370- `scrape-creators-pp-cli tiktok list-shop-3` — Fetches customer reviews for a TikTok Shop product by URL or product_id.
371- `scrape-creators-pp-cli tiktok list-song` — Fetches detailed metadata for a specific TikTok sound or song by its clipId.
372- `scrape-creators-pp-cli tiktok list-song-2` — Fetches TikTok videos that use a specific sound or song, identified by its clipId.
373- `scrape-creators-pp-cli tiktok list-user` — Retrieves audience demographic data for a TikTok user, showing where their followers are located by country.
374- `scrape-creators-pp-cli tiktok list-user-2` — Retrieves the follower list of a TikTok account by handle or user_id — useful for seeing who follows a creator or
375- `scrape-creators-pp-cli tiktok list-user-3` — Retrieves the following list — accounts that a TikTok user follows — by their handle.
376- `scrape-creators-pp-cli tiktok list-user-4` — Checks if a TikTok user is currently live streaming and retrieves their live room details.
377- `scrape-creators-pp-cli tiktok list-user-5` — Fetches products featured in a TikTok user's public showcase — the products a creator promotes on their profile.
378- `scrape-creators-pp-cli tiktok list-video` — Fetches detailed data for a single TikTok video by URL, including its metadata, engagement stats
379- `scrape-creators-pp-cli tiktok list-video-2` — Fetches comments on a TikTok video by URL — useful for reading audience reactions, replies, and engagement.
380- `scrape-creators-pp-cli tiktok list-video-3` — Extracts the transcript, captions, or subtitles from a TikTok video by URL.
381- `scrape-creators-pp-cli tiktok list-video-4` — Fetches replies to a specific TikTok comment by its ID.
382
383**truthsocial** — Manage truthsocial
384
385- `scrape-creators-pp-cli truthsocial list` — Fetches a single Truth Social post by URL, returning text, id, created_at, url, content, account details
386- `scrape-creators-pp-cli truthsocial list-profile` — Retrieves a Truth Social user's public profile including display_name, username, avatar, header, followers_count
387- `scrape-creators-pp-cli truthsocial list-user` — Fetches a paginated list of posts from a Truth Social user, returning text, id, created_at, url, content, account info
388
389**twitch** — Scrape Twitch clips
390
391- `scrape-creators-pp-cli twitch list` — Fetches detailed data for a Twitch clip by URL, including metadata and direct video URLs.
392- `scrape-creators-pp-cli twitch list-profile` — Retrieves a Twitch user's public profile by handle, including identity, social links, and content.
393- `scrape-creators-pp-cli twitch list-user` — Fetches a user's schedule by handle, returning a list of scheduled events with start time, end time, title, description
394- `scrape-creators-pp-cli twitch list-user-2` — Fetches a list of videos (100 max) for a Twitch user, returning each video's id, slug, url, embedURL, title, viewCount
395
396**twitter** — Get Twitter profiles, tweets, followers and more
397
398- `scrape-creators-pp-cli twitter list` — Retrieves details about a Twitter/X Community by URL.
399- `scrape-creators-pp-cli twitter list-community` — Fetches tweets posted within a Twitter/X Community by URL.
400- `scrape-creators-pp-cli twitter list-profile` — Retrieves a Twitter user's profile by handle, including account metadata and statistics.
401- `scrape-creators-pp-cli twitter list-tweet` — Retrieves detailed information about a specific tweet by URL, including the author's profile and engagement metrics.
402- `scrape-creators-pp-cli twitter list-tweet-2` — Extracts the transcript from a Twitter video tweet using AI-powered transcription.
403- `scrape-creators-pp-cli twitter list-usertweets` — Fetches tweets from a Twitter user's profile by handle.
404
405**youtube** — Scrape YouTube channels, videos, and more
406
407- `scrape-creators-pp-cli youtube list` — Retrieves YouTube channel profile data including name, avatar images, subscriber count (subscribers)
408- `scrape-creators-pp-cli youtube list-channel` — Fetches community posts from a YouTube channel's Posts tab, including post ID, URL, content, images, attached video
409- `scrape-creators-pp-cli youtube list-channel-2` — Fetches live streams and past streams from a YouTube channel's Live tab, including title, URL, thumbnail, view count
410- `scrape-creators-pp-cli youtube list-channel-3` — Fetches playlists from a YouTube channel's Playlists tab, including playlist ID, title, thumbnail, video count
411- `scrape-creators-pp-cli youtube list-channel-4` — Retrieves a paginated list of short-form videos (Shorts) from a YouTube channel, including each short's title, URL
412- `scrape-creators-pp-cli youtube list-channelvideos` — Fetches a paginated list of videos uploaded by a YouTube channel, including each video's title, URL, thumbnail
413- `scrape-creators-pp-cli youtube list-communitypost` — Retrieves the full details of a YouTube community post, including its text content, attached images, like count
414- `scrape-creators-pp-cli youtube list-playlist` — Retrieves all videos in a YouTube playlist, including the playlist title, owner info, total video count
415- `scrape-creators-pp-cli youtube list-search` — Searches YouTube by keyword query and returns matching videos, channels, playlists, shorts, shelves, and live streams.
416- `scrape-creators-pp-cli youtube list-search-2` — Searches YouTube for content matching a specific hashtag and returns matching videos with title, URL, thumbnail
417- `scrape-creators-pp-cli youtube list-shorts` — Fetches approximately 48 currently trending YouTube Shorts (viral/popular short-form videos) per call
418- `scrape-creators-pp-cli youtube list-video` — Fetches full details for a YouTube video or short, including title, description, thumbnail, view count (views)
419- `scrape-creators-pp-cli youtube list-video-2` — Fetches comments and replies from a YouTube video, including each comment's text content, author details, like count
420- `scrape-creators-pp-cli youtube list-video-3` — Experimental endpoint.
421- `scrape-creators-pp-cli youtube list-video-4` — Retrieves the captions, subtitles, or transcript of a YouTube video or Short.
422- `scrape-creators-pp-cli youtube list-video-5` — Fetches replies to a specific comment on a YouTube video, including each reply's text content, author details (name
423
424
425### Finding the right command
426
427When you know what you want to do but not which command does it, ask the CLI directly:
428
429```bash
430scrape-creators-pp-cli which "<capability in your own words>"
431```
432
433`which` resolves a natural-language capability query to the best matching command from this CLI's curated feature index. Exit code `0` means at least one match; exit code `2` means no confident match — fall back to `--help` or use a narrower query.
434
435## Recipes
436
437### Complete comment mining for one post
438
439```bash
440scrape-creators-pp-cli comments thread <post-url> --agent --select comments.text,comments.replies.text
441```
442
443Fetches every top-level comment and reply with cost-aware routing, then narrows the envelope to just the text fields an agent needs.
444
445### Budget-gated weekly sweep
446
447```bash
448scrape-creators-pp-cli comments sweep <handle> --since 7d --max-credits 200 --agent
449```
450
451Pulls the week's posts and their comments, stopping cleanly when the credit budget is hit.
452
453### Find the gaps before spending
454
455```bash
456scrape-creators-pp-cli comments coverage <handle> --agent
457```
458
459Ranks synced posts by missing-thread gap so reply credits go only where threads are incomplete.
460
461### Offline comment mining
462
463```bash
464scrape-creators-pp-cli comments search "delivery" --limit 20
465```
466
467FTS5 search over the synced corpus — zero credits.
468
469### Collab qualification in two calls
470
471```bash
472scrape-creators-pp-cli creator find <handle> --agent && scrape-creators-pp-cli creator compare <handle> <rival> --agent
473```
474
475Presence matrix first, then engagement comparison to strip vanity followers.
476
477## Auth Setup
478Run `scrape-creators-pp-cli auth setup` to print the URL and steps for getting a key (add `--launch` to open the URL). Then set:
479
480```bash
481export SCRAPECREATORS_API_KEY="<your-key>"
482```
483
484To persist credentials, use `scrape-creators-pp-cli auth set-token <token>`. Stored secrets live in `credentials.toml` under the data dir, not in `config.toml`.
485
486Run `scrape-creators-pp-cli doctor` to verify setup.
487
488## Agent Mode
489
490Add `--agent` to any command. Expands to: `--json --compact --no-input --no-color --yes`.
491
492- **Pipeable** — JSON on stdout, errors on stderr
493- **Filterable** — `--select` keeps a subset of fields. Dotted paths descend into nested structures; arrays traverse element-wise. Critical for keeping context small on verbose APIs:
494
495 ```bash
496 scrape-creators-pp-cli account list --agent --select id,name,status
497 ```
498- **Previewable** — `--dry-run` shows the request without sending
499- **Offline-friendly** — sync/search commands can use the local SQLite store when available
500- **Non-interactive** — never prompts, every input is a flag
501- **Explicit retries** — use `--idempotent` only when an already-existing create should count as success
502
503### Response envelope
504
505Commands that read from the local store or the API wrap output in a provenance envelope:
506
507```json
508{
509 "meta": {"source": "live" | "local", "synced_at": "...", "reason": "..."},
510 "results": <data>
511}
512```
513
514Parse `.results` for data and `.meta.source` to know whether it's live or local. A human-readable `N results (live)` summary is printed to stderr only when stdout is a terminal AND no machine-format flag (`--json`, `--csv`, `--compact`, `--quiet`, `--plain`, `--select`) is set — piped/agent consumers and explicit-format runs get pure JSON on stdout.
515
516## Paths and state
517
518Agents should treat the CLI's path resolver as part of the runtime contract:
519
520- Use `--home <dir>` for one invocation, or set `SCRAPE_CREATORS_HOME=<dir>` to relocate all four path kinds under one root.
521- Use per-kind env vars only when a specific kind must diverge: `SCRAPE_CREATORS_CONFIG_DIR`, `SCRAPE_CREATORS_DATA_DIR`, `SCRAPE_CREATORS_STATE_DIR`, `SCRAPE_CREATORS_CACHE_DIR`.
522- Resolution order is per-kind env var, `--home`, `SCRAPE_CREATORS_HOME`, XDG (`XDG_CONFIG_HOME`, `XDG_DATA_HOME`, `XDG_STATE_HOME`, `XDG_CACHE_HOME`), then platform defaults.
523- `config` contains settings like `config.toml` and profiles. `data` contains `credentials.toml`, `data.db`, cookies, and auth sidecars. `state` contains persisted queries, jobs, and `teach.log`. `cache` contains regenerable HTTP/cache files.
524- Stored secrets live in `credentials.toml` under the data dir. Existing legacy `config.toml` secrets are read for compatibility and leave `config.toml` on the first auth write.
525- Run `scrape-creators-pp-cli doctor --fail-on warn` to surface path and credential-location warnings. `agent-context` exposes a schema v4 `paths` block for agents that need the resolved dirs.
526- For MCP, pass relocation through the MCP host config. The MCP binary does not inherit CLI flags:
527
528 ```json
529 {
530 "mcpServers": {
531 "scrape-creators": {
532 "command": "scrape-creators-pp-mcp",
533 "env": {
534 "SCRAPE_CREATORS_HOME": "/srv/scrape-creators"
535 }
536 }
537 }
538 }
539 ```
540
541Fleet precedence: an inherited per-kind env var overrides an explicit `--home` for that kind. Use `SCRAPE_CREATORS_HOME` or per-kind vars as durable fleet levers, and use `--home` only for a single invocation. Relocation is not reversible by unsetting env vars; move files manually before clearing `SCRAPE_CREATORS_HOME`, or `doctor` will not find credentials left under the former root.
542
543## Automatic learning
544
545This CLI ships a self-capturing learning loop. The CLI does its own bookkeeping: every invocation is journaled locally, a failed flag followed by a corrected retry auto-derives a `flag_alias` candidate, and a `teach` on a query family without a playbook auto-synthesizes a `playbook_candidate` from the session's journal. Your job is judgment only: `recall` first, act on surfaced candidates, `teach` the final answer, `playbook amend` when you observe a correction. You never record failures by hand.
546
547### Step 1: `recall` before any discovery
548
549Before list/search/drill commands on a new user question, run:
550
551```bash
552scrape-creators-pp-cli recall "<user's question>" --agent
553```
554
555The response envelope:
556
557```json
558{
559 "query": "...",
560 "normalized": "<normalized form>",
561 "query_entities": ["..."],
562 "found": true | false,
563 "match_score": 0
564
565…(truncated)
mvanhorn