Results for “dedup”
10 skills
orchestra-research Nemo Curator
GPU-accelerated data curation for LLM training, supporting text, image, video, and audio with fuzzy deduplication, quality filtering, semantic deduplication, PII redaction, and NSFW detection.
10.4k · bundle
pranavnagrecha Salesforce Data
Routes to the right Salesforce data skill package for data model, migration, bulk loads, query optimization, deduplication, and archival tasks.
15 · bundle
agricidaniel Ads Server Side Tracking
Audit server-side paid-media measurement, including tag management, conversion APIs, event taxonomy, deduplication, consent, hashing, data quality, and observability.
tradermonty Skill Idea Miner
Extract, score, and backlog skill idea candidates from Claude Code session logs for a weekly skill generation pipeline.
2.3k · bundle
More results
albedo-tabai Lets Go Rss
Aggregate RSS feeds from YouTube, Vimeo, Behance, Twitter/X, Bilibili, Weibo, Douyin, Xiaohongshu, and Zhihu with incremental updates, deduplication, and AI classification.
99 · bundle
k-dense-ai Umap Learn
Perform nonlinear dimensionality reduction, 2D/3D embeddings, clustering preprocessing, supervised or semi-supervised UMAP, DensMAP, AlignedUMAP, and Parametric UMAP workflows using the umap-learn library.
30.2k · bundle
sakamoto-family-smile Knowledge Ops
Manages a multi-layered knowledge system for ingesting, organizing, syncing, and retrieving knowledge across local files, MCP memory, vector stores, and Git repos.
0
schattenspiegel Xxhash Python
Provides guidance for using python-xxhash to implement fast non-cryptographic hashing, including algorithm selection, byte encoding, streaming updates, digest representation, and collision-aware identity for checksums, bucketing, and sampling.
0 · bundle
mukul975 Analyzing Threat Intelligence Feeds
Ingests, normalizes, and enriches structured and unstructured threat intelligence feeds into STIX 2.1 format, evaluating feed quality and deduplicating indicators for distribution to SIEM, firewall, and EDR platforms.
24.6k · bundle
matlab Matlab Use Duckdb
Use DuckDB from MATLAB via Database Toolbox (R2026a+) as a non-math operations engine on large tabular files (CSV/Parquet/JSON) and as a zero-config embedded database. Use when connecting to DuckDB, querying CSV, Parquet, and JSON files directly with SQL, reducing or profiling large data before MATLAB analysis, creating portable development databases, or installing DuckDB extensions. Triggers on: DuckDB, duckdb(), large CSV/Parquet/JSON, file too large for readtable, filter/aggregate at source, deduplicate, reduce before analysis, profile large file, persistent file import, analytical engine, SQL on CSV, SQL on Parquet, SQL on JSON, query CSV with SQL, query Parquet with SQL, run SQL on files, SQL queries on files, query files directly, SQL without database, in-process SQL.
920 · bundle