Scrape

Scrape

Pull content from social platforms via ScrapeCreators API.

Invocation

/scrape [type] [target]

Types

Supported Platforms

• transcript: TikTok, Instagram, YouTube
• posts/profile: TikTok, Instagram, Twitter/X (profile + tweets; no followers/following list)
• ads: Meta Ad Library (Facebook/Instagram ads)

Arguments

Output Routing

By default, output is saved to ./scrape-output/ in the current working directory. Use --output [path] to override. The caller decides the final destination; this skill does not assume any particular project structure.

Workflow

1. Load API Key

source .env

Verify SCRAPECREATORS_API_KEY is set before proceeding.

2. Make API Request

All requests use curl with the x-api-key header:

curl -s "https://api.scrapecreators.com/[version]/[endpoint]" \
  -H "x-api-key: $SCRAPECREATORS_API_KEY"

The version prefix (v1, v2, v3) varies by endpoint. Always use the exact path from references/scrapecreators-endpoints.md rather than assuming v1.

3. Parse Response

Extract relevant fields from JSON response based on content type.

4. Format Output

Unless --raw is specified, format as markdown with frontmatter.

5. Save to Location

Save to appropriate directory based on routing rules (or --output override).

6. Optional Analysis

If --analyze flag is present:

• Posts → run through hook analysis
• Ads → summarize creative patterns; the analysis output can be fed to any downstream creative skill
• Transcripts → summarize key points

Output Formats

Transcript Output

---
source: youtube
video_url: https://youtube.com/watch?v=abc123
title: "Video Title Here"
channel: Channel Name
scraped: 2025-01-15
---

# Transcript: Video Title Here

[00:00] First segment of transcript text here...

[00:15] Next segment continues...

[01:30] And so on with timestamps...

Posts Output

---
platform: tiktok
handle: @username
post_id: 1234567890
scraped: 2025-01-15
views: 1.2M
likes: 150K
comments: 3.2K
---

# Post by @username

[Post caption/content here]

## Media
![Video Thumbnail](thumbnail_url)

## Hook Analysis
- Opening line: "..."
- Hook type: curiosity/controversy/value/etc

Ads Output

---
brand: lululemon
platform: meta
ad_id: 123456789
status: active
start_date: 2025-01-01
scraped: 2025-01-15
---

# Ad: lululemon

## Copy
[Primary ad text/body copy]

## Headline
[Ad headline if present]

## Creative
![Ad Creative](image_url)

## CTA
Shop Now → https://lululemon.com/landing

## Targeting Notes
- Country: US
- Category: [if available]

Profile Output

---
platform: instagram
handle: @alexhormozi
user_id: 123456789
scraped: 2025-01-15
---

# Profile: @alexhormozi

## Bio
[Bio text here]

## Stats
- Followers: 2.5M
- Following: 150
- Posts: 1,200

## Links
- Website: https://...

## Recent Content Themes
[If --analyze: brief analysis of content patterns]

Examples

Get YouTube Transcript

/scrape transcript https://www.youtube.com/watch?v=dQw4w9WgXcQ

Get TikTok Posts with Analysis

/scrape posts @garyvee tiktok --limit 20 --analyze

Pull Competitor Ads

/scrape ads "gymshark" --limit 50

Research Creator Profile

/scrape profile @alexhormozi instagram --analyze

Setup

Getting Your API Key

1. Go to app.scrapecreators.com
2. Sign up for an account (100 free credits to start)
3. Copy your API key from the dashboard

Configure Environment

1. Copy the example config:

   cp .env.example .env
   

2. Add your API key:

   SCRAPECREATORS_API_KEY=your_actual_key_here
   

3. Verify setup:

   source .env && echo "Key loaded: ${SCRAPECREATORS_API_KEY:0:10}..."
   

API Reference

Load references/scrapecreators-endpoints.md for complete endpoint documentation including:

• All available endpoints
• Request parameters
• Response schemas
• Credit costs
• Pagination handling

Error Handling

Credits & Costs

Most ScrapeCreators endpoints cost 1 credit per request. Notable exceptions:

• Audience demographics: 26 credits
• Some bulk endpoints may vary

Check your balance at app.scrapecreators.com.

Integration with Other Skills

The scrape skill produces structured output (transcripts, posts, ad copy, profiles) that can feed any downstream creative or analysis skill. If you have a broader marketing-skills install, integrations like ad teardown, image breakdown, positioning analysis, content repurposing, and swipe file tools are all valid consumers of this skill's output.