Xiaohongshu Search and Summarize
This skill automates the process of extracting high-quality multi-modal content (text + images) from Xiaohongshu (小红书) and actively assists you in generating a deeply integrated, analytical final report for the user. Due to Xiaohongshu's aggressive anti-scraping mechanisms, direct HTTP requests or naive scraping often result in 404s or blocks. This skill natively bypasses these by simulating a real user through the playwright-cli in a headed browser window.
It operates in two distinct phases:
Phase 1: Subagent Data Collection
- Simulate a search for the keyword on Xiaohongshu in a headed browser.
- Advance through image sliders to fully load all lazy pictures from the top N posts.
- Extract titles, descriptions, top comments, and all high-resolution images.
- Download those images to a local directory and generate a raw data document (
[keyword]_raw_data.md).
Phase 2: AI Multi-Modal Synthesis (Your Job)
- You MUST use your file reading capabilities to read the
[keyword]_raw_data.md file.
- Inside the raw data markdown, you will find paths to image files. You MUST use your file reading / vision capabilities on these image file paths to actually ingest and "see" their visual content. If you skip this step, you are only reading file names, not the images themselves!
- You analyze the texts, summarize the genuinely useful comments (discarding noise like "pm me"), and interpret the semantic content of the images you just viewed (e.g. diagrams, guidelines, step-by-step UI flows).
- You compile everything into a beautifully synthesized, single comprehensive report rather than just a linear list of posts.
Dependencies
playwright-cli (Must be available on the path)python3 (Required to download images and stitch the raw data markdown)requests Python package (pip install requests) — used by parse.py to download images
Usage Instructions
Step 1: Run the Extraction Script
Execute the wrapper script in scripts/run.sh. It accepts the following arguments:
/bin/bash <skill_dir>/scripts/run.sh "YOUR KEYWORD" <MAX_POSTS> <OUTPUT_DIRECTORY>
YOUR KEYWORD: The search term to look up on Xiaohongshu.<MAX_POSTS>: (Optional, default = 10) The number of top posts to scan.<OUTPUT_DIRECTORY>: (Optional, default = ./) Directory where the raw data and images will be saved.
Example execution:
/bin/bash ~/.claude/skills/xiaohongshu-search-summarizer/scripts/run.sh "openclaw使用场景" 10 "./xhs_report_openclaw_scenarios"
Step 2: Read Raw Data & Images
Once the bash script finishes successfully, navigate to the OUTPUT_DIRECTORY and use your file reading capabilities to ingest the generated [keyword]_raw_data.md file.
Inside this file, you will find descriptions, comments, and file paths pointing to post_X_img_Y.webp or post_X_img_Y.jpg.
Step 3: Synthesis & Summarization
This is the most critical step. Do not just return the raw markdown file to the user. Instead, write a polished comprehensive markdown report that reorganizes the information logically, while retaining a high level of detail.
Follow these strict compilation rules:
- Do not list posts individually (e.g. avoid "Post 1: ... Post 2: ...").
- Read the Images: You MUST use your file reading and vision capabilities on the
.webp or .jpg image files found in the raw data directory to interpret their contents.
- Detailed & Comprehensive Synthesis: Provide a highly detailed summary that includes diverse viewpoints, nuances, and specific examples found across different posts. Avoid over-summarizing or losing important context; preserve the richness and diversity of the information.
- Extract and merge themes: Group ideas by concepts, steps, recurring themes, or pros/cons.
- Evaluate comments: Merge insights from valuable comments directly into the core narrative. Skip useless or repetitive comments, but preserve diverse opinions or helpful counter-arguments from the comments section.
- Integrate images contextually: Embed the most relevant and high-quality images directly into the flow of your final report to support the analytical points being made. Describe their visual meaning based on what you saw with your vision capabilities.
- Save to OUTPUT_DIRECTORY: Save your beautifully compiled final Markdown report using your file writing capabilities directly into the same
<OUTPUT_DIRECTORY> as the raw data (e.g., <OUTPUT_DIRECTORY>/[keyword]_synthesis.md), and give the user the path to it.
Error Handling
If you encounter 404 Not Found or "element not visible" errors during the browser invocation:
- Keep in mind that Xiaohongshu may demand a login challenge. If the site pauses waiting for a login, instruct the user to verify the
playwright-cli browser window and perform necessary authentication manually, then try the script again.
1---2name: xiaohongshu-search-summarizer3description: Searches Xiaohongshu(小红书) for a given keyword, extracts the top N posts (including texts, images, and user comments), and then synthesizes a comprehensive final analytical report. Use this skill whenever the user wants to search Xiaohongshu for a specific topic, compile research seamlessly combining text and images, or needs an aggregated thematic summary of social media posts, comments, and visual data on a given subject.4---56# Xiaohongshu Search and Summarize78This skill automates the process of extracting high-quality multi-modal content (text + images) from Xiaohongshu (小红书) and actively assists you in generating a deeply integrated, analytical final report for the user. Due to Xiaohongshu's aggressive anti-scraping mechanisms, direct HTTP requests or naive scraping often result in 404s or blocks. This skill natively bypasses these by simulating a real user through the `playwright-cli` in a headed browser window.910It operates in two distinct phases:1112### Phase 1: Subagent Data Collection131. Simulate a search for the keyword on Xiaohongshu in a headed browser.142. Advance through image sliders to fully load all lazy pictures from the top N posts.153. Extract titles, descriptions, top comments, and all high-resolution images.164. Download those images to a local directory and generate a raw data document (`[keyword]_raw_data.md`).1718### Phase 2: AI Multi-Modal Synthesis (Your Job)195. **You** MUST use your file reading capabilities to read the `[keyword]_raw_data.md` file.206. Inside the raw data markdown, you will find paths to image files. **You MUST use your file reading / vision capabilities on these image file paths** to actually ingest and "see" their visual content. If you skip this step, you are only reading file names, not the images themselves!217. **You** analyze the texts, summarize the genuinely useful comments (discarding noise like "pm me"), and interpret the semantic content of the images you just viewed (e.g. diagrams, guidelines, step-by-step UI flows).228. **You** compile everything into a beautifully synthesized, single comprehensive report rather than just a linear list of posts. 2324### Dependencies25- `playwright-cli` (Must be available on the path)26- `python3` (Required to download images and stitch the raw data markdown)27- `requests` Python package (`pip install requests`) — used by `parse.py` to download images2829---3031## Usage Instructions3233### Step 1: Run the Extraction Script3435Execute the wrapper script in `scripts/run.sh`. It accepts the following arguments:3637```bash38/bin/bash <skill_dir>/scripts/run.sh "YOUR KEYWORD" <MAX_POSTS> <OUTPUT_DIRECTORY>39```4041- **`YOUR KEYWORD`**: The search term to look up on Xiaohongshu.42- **`<MAX_POSTS>`**: (Optional, default = 10) The number of top posts to scan.43- **`<OUTPUT_DIRECTORY>`**: (Optional, default = `./`) Directory where the raw data and images will be saved.4445**Example execution**:4647```bash48/bin/bash ~/.claude/skills/xiaohongshu-search-summarizer/scripts/run.sh "openclaw使用场景" 10 "./xhs_report_openclaw_scenarios"49```5051### Step 2: Read Raw Data & Images5253Once the bash script finishes successfully, navigate to the `OUTPUT_DIRECTORY` and use your file reading capabilities to ingest the generated `[keyword]_raw_data.md` file.5455Inside this file, you will find descriptions, comments, and file paths pointing to `post_X_img_Y.webp` or `post_X_img_Y.jpg`. 5657### Step 3: Synthesis & Summarization5859**This is the most critical step.** Do not just return the raw markdown file to the user. Instead, write a polished comprehensive markdown report that reorganizes the information logically, while retaining a high level of detail.6061Follow these strict compilation rules:62- **Do not list posts individually** (e.g. avoid "Post 1: ... Post 2: ..."). 63- **Read the Images:** You MUST use your file reading and vision capabilities on the `.webp` or `.jpg` image files found in the raw data directory to interpret their contents.64- **Detailed & Comprehensive Synthesis:** Provide a highly detailed summary that includes diverse viewpoints, nuances, and specific examples found across different posts. Avoid over-summarizing or losing important context; preserve the richness and diversity of the information.65- **Extract and merge themes:** Group ideas by concepts, steps, recurring themes, or pros/cons. 66- **Evaluate comments:** Merge insights from valuable comments directly into the core narrative. Skip useless or repetitive comments, but preserve diverse opinions or helpful counter-arguments from the comments section.67- **Integrate images contextually:** Embed the most relevant and high-quality images directly into the flow of your final report to support the analytical points being made. Describe their visual meaning based on what you saw with your vision capabilities.68- **Save to OUTPUT_DIRECTORY:** Save your beautifully compiled final Markdown report using your file writing capabilities directly into the same `<OUTPUT_DIRECTORY>` as the raw data (e.g., `<OUTPUT_DIRECTORY>/[keyword]_synthesis.md`), and give the user the path to it. 6970### Error Handling7172If you encounter `404 Not Found` or "element not visible" errors during the browser invocation:73- Keep in mind that Xiaohongshu may demand a login challenge. If the site pauses waiting for a login, instruct the user to verify the `playwright-cli` browser window and perform necessary authentication manually, then try the script again.
piekill