# Multi Format CSV Detection And Deduplication

> Detect and handle multiple CSV format versions from the same data source; deduplicate records across format variants

- Skill: `vamseeachanta/multi-format-csv-detection-and-deduplication` (Agent Skill)
- Install (CLI): `npx skillmds@latest add vamseeachanta/multi-format-csv-detection-and-deduplication`
- Raw SKILL.md: https://api.skillmd.com/api/skills/vamseeachanta/multi-format-csv-detection-and-deduplication/raw
- Safety review: PASS (external: skill-scanner PASS, skillspector PASS)
- Works with: Claude Code, Claude.ai, OpenAI Codex
- Category: Data & Analytics
- Author: vamseeachanta (https://skillmd.com/u/vamseeachanta)
- Updated: 2026-09-17
- Page: https://skillmd.com/skills/vamseeachanta/multi-format-csv-detection-and-deduplication

---


# Multi-Format CSV Detection and Deduplication

When ingesting CSVs from sources that evolve formats over time (e.g., Fidelity exports with old vs. new column orders), detect format from header structure rather than filename. The same year/period can exist in both formats with identical transactions. Use column position and presence of distinguishing headers (e.g., 'Account Number' only in new format) as discriminators. Build a unified parser that normalizes both formats to a canonical schema, then deduplicate by transaction fingerprint (date, ticker, quantity, price) across all input files.