Snowflake Data Engineering Pipelines

Use this skill to review Snowflake batch and ELT pipelines for data correctness: COPY and load semantics, Streams offset behaviour, Tasks and task graphs, Dynamic Tables and achieved versus configured target lag, Snowpark transformations, schema evolution from the consumer's position, idempotency and replay, and reconciliation design. Trigger when data is late, duplicated, incomplete, or suspected wrong, or when a pipeline is being designed. Static review only: it never runs, resumes, or backfills a pipeline, and it never accepts job success as proof the data is right.

VincentChuWaiChow Updated 24 repo stars

File contents

VincentChuWaiChow/vanguard-frontier-agentic commit 6f92ecacb0

Frequently asked questions

npx get-skill add vincentchuwaichow/snowflake-data-engineering-pipelines