Results for “dedup”
84 skillsDeduplicating Training Data Makes Language Models Better Arx
Deduplicating Training Data Makes Language Models Better
6
Nemo Curator
GPU-accelerated data curation for LLM training, supporting text, image, video, and audio with fuzzy deduplication, quality filtering, semantic deduplication, PII redaction, and NSFW detection.
10.4k · bundle
Nemo Curator
GPU-accelerated data curation for LLM training. Supports text/image/video/audio. Features fuzzy deduplication (16× faster), quality filtering (30+ heuristics), semantic deduplication, PII redaction, NSFW detection. Scales across GPUs with RAPIDS. Use for preparing high-quality training datasets, cleaning web data, or deduplicating large corpora.
1 · bundle
Nemo Curator
GPU-accelerated data curation for LLM training. Supports text/image/video/audio. Features fuzzy deduplication (16× faster), quality filtering (30+ heuristics), semantic deduplication, PII redaction, NSFW detection. Scales across GPUs with RAPIDS. Use for preparing high-quality training datasets, cleaning web data, or deduplicating large corpora.
0 · bundle
Merge
Combines multiple pipe-format blocks from conversation context into one unified output, handling deduplication, source attribution, and confidence upgrades.
54 · bundle
Watchers
Poll RSS, JSON APIs, and GitHub with watermark dedup.
28 · bundle
More results
Salesforce Data
Routes to the right Salesforce data skill package for data model, migration, bulk loads, query optimization, deduplication, and archival tasks.
15 · bundle
Ads Server Side Tracking
Audit server-side paid-media measurement, including tag management, conversion APIs, event taxonomy, deduplication, consent, hashing, data quality, and observability.
Edge Signal Aggregator
Aggregate and rank signals from multiple edge-finding skills into a prioritized conviction dashboard with weighted scoring, deduplication, and contradiction detection.
2.3k · bundle
Aeon Rss Digest
Aggregates multiple RSS, Atom, or JSON feeds into a single daily digest with cross-feed deduplication, themed clustering, weighted ranking, and source-status reporting.
1.2k · bundle
Rollout
Deploy an entire redesigned site to AEM Edge Delivery Services by inventorying migrated pages, deduplicating blocks, and driving per-page deployment with tracking and verification.
142 · bundle
Rsr Synthesis
Merge many sources into one cited, deduplicated answer with per-claim confidence.
0
Subagent Result Merge
Merges agent or review outputs into one deduplicated, evidence-linked, severity-ranked actionable report.
0 · bundle
Agent Data Quality
Data Quality Specialist IA — Expert en qualité des données (profiling, cleaning, déduplication, validation de schéma, Great Expectations)
6
Es Search
Fan one question out across every connected source and return a single ranked, deduplicated, attributed result set.
0
Windagszip
This skill should be used when a SKILL.md file needs compression, deduplication, or token reduction. It provides an embedding-based compression pipeline that detects and removes redundant chunks within SKILL.md files using local embeddings (all-MiniLM-L6-v2). Two-pass approach: (1) free intra-skill deduplication via cosine similarity clustering, (2) optional LLM-judged graded eval to detect pretraining overlap. Typical result: 25-46% token reduction with zero quality loss. This skill is not intended for editing skill content, creating new skills, routing optimization, or cross-skill deduplication.
10 · bundle
Apollo Lead Prospector
Daily B2B prospect search via Apollo against the brand's ICP, with deduplication, scoring, and Notion CRM dropoff. Runs daily on cron schedule.
0
Dream
Consolidates auto-memory files in ~/.claude/projects by auditing, planning, and executing a 4-phase cleanup with user approval.
0
Issue Triage
Triage Linear or Jira backlogs and run bug sweeps via the Composio CLI. Bulk-fetch issues, deduplicate, relabel, reassign, and post summaries all from the shell.
16
Job Scraper
Scrapes Danish job sites for new positions matching your profile. Deduplicates across runs. Triggers on: job scrape, find jobs, search jobs, new jobs, job search, scrape jobs, /scrape
0 · bundle
Python Debugpy
Debug Python: pdb REPL + debugpy remote (DAP).
0
Ata Aed Ddavp Monitoring
This skill recommends monitoring desmopressin (DDAVP) doses and adjusting them as needed in patients who have recently started antiepileptic drugs (AEDs). It is triggered when a patient initiates AED therapy and requires DDAVP management for diabetes insipidus.
10
Building Vulnerability Dashboard With Defectdojo
Deploy DefectDojo as a centralized vulnerability management dashboard with scanner integrations, deduplication, metrics tracking, and Jira ticketing workflows.
24.6k · bundle
Desk Flip
Autopsy a stuck project, extract salvageable artifacts, and route to a fresh start via $bootstrap-repo reset or new-repo bootstrap
1 · bundle
Ata Ddavp Di Management
Manage diabetes insipidus with desmopressin
10
Skill Idea Miner
Extract, score, and backlog skill idea candidates from Claude Code session logs for a weekly skill generation pipeline.
2.3k · bundle
Python Debugpy
Debug Python code interactively with pdb and debugpy, covering local breakpoints, post-mortem analysis, and remote attachment to running processes.
2
Python Debugpy
Debug Python with pdb, breakpoint(), post-mortem inspection, and debugpy remote attach.
0
Cdp Connect
Connect to an existing Chrome browser via Chrome DevTools Protocol to navigate, click, type, screenshot, evaluate JavaScript, read the accessibility tree, and monitor console or network events.
142 · bundle
Dep
Handles containerization, CI/CD pipelines, and deployment setup.
6
Issue Triage
Triage Linear or Jira backlogs and run bug sweeps via the Composio CLI. Bulk-fetch issues, dedupe, relabel, reassign, and post summaries — all from the shell without clicking through the UI.
3
Devup UI
[devup-ui] Routing-first front door for Devup UI — a zero-runtime CSS-in-JS library whose Rust + WebAssembly preprocessor extracts every style at build time, so no styling JavaScript ships at runtime. Use to adopt/integrate Devup UI, wire the build-time plugin into Next.js/Vite/Rsbuild/Webpack/Bun, write styles with Box/css props or the styled-components-compatible styled() API, set up type-safe theming with devup.json, or migrate off styled-components/Emotion/Tailwind/Panda/vanilla-extract to zero runtime.
42 · bundle
Implementing Endpoint Dlp Controls
Deploys endpoint Data Loss Prevention (DLP) controls to detect and prevent sensitive data exfiltration through email, USB, cloud storage, and printing using Microsoft Purview or Symantec DLP.
24.6k · bundle
Defuddle
Extract clean markdown content from web pages by removing clutter, navigation, and ads to save tokens.
39.8k
Defuddle
Extract clean markdown content from web pages using Defuddle CLI, removing clutter and navigation to save tokens. Use instead of WebFetch when the user provides a URL to read or analyze, for online documentation, articles, blog posts, or any standard web page.
1
Defuddle
Extract clean markdown content from web pages using Defuddle CLI, removing clutter and navigation to save tokens. Use instead of WebFetch when the user provides a URL to read or analyze, for online documentation, articles, blog posts, or any standard web page.
1