Results for “deduplication”
7 skills
orchestra-research nemo-curator
GPU-accelerated data curation for LLM training, supporting text, image, video, and audio with fuzzy deduplication, quality filtering, semantic deduplication, PII redaction, and NSFW detection.
10.4k · bundle
pranavnagrecha salesforce-data
Routes to the right Salesforce data skill package for data model, migration, bulk loads, query optimization, deduplication, and archival tasks.
15 · bundle
agricidaniel ads-server-side-tracking
Audit server-side paid-media measurement, including tag management, conversion APIs, event taxonomy, deduplication, consent, hashing, data quality, and observability.
More results
tradermonty skill-idea-miner
Extract, score, and backlog skill idea candidates from Claude Code session logs for a weekly skill generation pipeline.
2.3k · bundle
albedo-tabai lets-go-rss
Aggregate RSS feeds from YouTube, Vimeo, Behance, Twitter/X, Bilibili, Weibo, Douyin, Xiaohongshu, and Zhihu with incremental updates, deduplication, and AI classification.
99 · bundle
sakamoto-family-smile knowledge-ops
Manages a multi-layered knowledge system for ingesting, organizing, syncing, and retrieving knowledge across local files, MCP memory, vector stores, and Git repos.
0
schattenspiegel xxhash-python
Provides guidance for using python-xxhash to implement fast non-cryptographic hashing, including algorithm selection, byte encoding, streaming updates, digest representation, and collision-aware identity for checksums, bucketing, and sampling.
0 · bundle