Dataops Airflow Production Readiness

Airflow production readiness — idempotent tasks (UPSERT/partition overwrite), no top-level code at DAG parse time (Variable.get inside tasks), KubernetesExecutor configuration, connection/variable management (no hardcoded secrets), SLA callbacks, retry with exponential backoff, pool management, max_active_runs, dag_concurrency, celery vs kubernetes executor trade-offs, metadata DB maintenance (airflow db clean), health check endpoints, structured logging

ivanshamaev Updated 24 repo stars

File contents

ivanshamaev/de-agent-skills commit dffd400b3d

Frequently asked questions

npx get-skill add ivanshamaev/dataops-airflow-production-readiness