majiayu000 Deduplicate Articles (DEPRECATED)
⚠️ DEPRECATED: This skill has been deprecated as of v2.0.0.
Deduplication is now handled automatically by collection skills using the Memory MCP server's
check_seenandmark_seentools.
Migration Guide
Before (v1.0)
Collection and deduplication were separate skills:
fetch-rss-feeds- Collect articlesdeduplicate-articles- Remove duplicates
After (v2.0)
Deduplication is built into collection skills:
fetch-rss-feeds- Collects AND deduplicates using memory/check_seen
How to Migrate
If you were using deduplicate-articles, update your workflow to use the v2.0 collection skills which handle deduplication automatically.
The new approach:
- Before storing an article, call
memory/check_seenwith the article URL as key - If not seen, store the article with
memory/add - Mark as seen with
memory/mark_seen
This is now handled automatically by all collection skills.
Replacement Tools
| Old Approach | New Approach |
|---|---|
deduplicate-articles skill |
memory/check_seen + memory/mark_seen |
| In-memory URL set | Redis-backed deduplication with TTL |
| Per-run dedup only | Cross-run persistent deduplication |
Why Deprecated
- Redundant: Deduplication is now built into collection skills
- Better persistence: Memory MCP provides persistent deduplication with TTL
- Simpler workflows: One fewer skill to coordinate
- Consistency: All collection skills use the same deduplication mechanism
See Also
- fetch-rss-feeds - v2.0 with built-in dedup
- fetch-arxiv-papers - v2.0 with built-in dedup
- fetch-github-trending - v2.0 with built-in dedup