Python Data Pipeline Reliability

Use this skill to statically review Python data-pipeline reliability (Airflow, Dagster, Prefect, PySpark): task idempotency and safe backfills, partitioning and late-data handling, schema evolution and data contracts, checkpointing, retry policy, and data-quality gates. Reads DAG/pipeline source and configuration only; it never runs a pipeline, triggers a backfill, or connects to a warehouse.

VincentChuWaiChow Updated 24 repo stars

File contents

VincentChuWaiChow/vanguard-frontier-agentic commit 8a890e7e02

Frequently asked questions

npx get-skill add vincentchuwaichow/python-data-pipeline-reliability