Data Pipeline Design

Design reliable batch or incremental data pipelines with explicit grain, load strategy, idempotency, checkpoints, late-data handling, backfills, storage layout, and reconciliation. Use when planning ETL, ELT, CDC, file-based, or PostgreSQL-backed data movement before implementation.

majesticlabs-dev Updated 50 repo stars

File contents

majesticlabs-dev/majestic-abilities commit 7c73f54caf

Frequently asked questions

npx get-skill add majesticlabs-dev/data-pipeline-design