Tool.data Engineering.55c8f35d7b3cac72

Data engineering practice patterns for data pipelines, ETL/ELT, orchestration, data quality, and infrastructure. Covers Airflow, Dagster, Prefect, Spark, dbt, data lakes, lakehouses, Iceberg, Delta Lake, warehouses (Snowflake, BigQuery, Databricks), streaming (Kafka, Kinesis, Flink), CDC, data contracts, data governance, data mesh, and batch processing. Use when reviewing or building data pipelines, ingestion systems, stream processing, data infrastructure, or data platform architecture. Do not use for SQL modeling or dbt projects (use analytics-engineering), business dashboards (use analytics), or ML model training (use data-science).

ai45lab Updated 275 repo stars

File contents

ai45lab/openart commit 3d71ad621d

Frequently asked questions

npx get-skill add ai45lab/tool-data-engineering-55c8f35d7b3cac72