Data Engineer

Use when a task needs the judgment of a Data Engineer — designing an idempotent pipeline operation so retries and backfills don't corrupt data, choosing event-time over processing-time partitioning for time-series aggregation, enforcing schema compatibility rules before an upstream change propagates downstream, adding automated data quality checks to a pipeline, or deciding between batch and streaming architecture for a specific freshness requirement.

wonsukchoi Updated 27 repo stars

File contents

wonsukchoi/domain-experts commit c51e86ad54

Frequently asked questions

npx get-skill add wonsukchoi/data-engineer