Apache Airflow is a platform to programmatically author, schedule, and monitor workflows. It enables defining complex data pipelines as code with rich scheduling and monitoring.
Key Concepts
DAGs (Directed Acyclic Graphs)
Operators and hooks
Task dependencies
XCom for communication
Sensors for waiting
Common Use Cases
ETL pipelines
ML pipelines
Data orchestration
Batch processing
Workflow automation
Best Practices
Keep DAGs simple and flat
Use proper task grouping
Implement retry strategies
Use connections properly
Monitor with Airflow UI
Resources
Airflow.apache.org: airflow.apache.org/docs
Related Skills: data-engineering, python, kubernetes
1---2name: airflow-23description: Apache Airflow4metadata:5 source: https://skillmd.com/skills/neuralblitz/airflow-26---7# Apache Airflow89Apache Airflow is a platform to programmatically author, schedule, and monitor workflows. It enables defining complex data pipelines as code with rich scheduling and monitoring.1011## Key Concepts1213- DAGs (Directed Acyclic Graphs)14- Operators and hooks15- Task dependencies16- XCom for communication17- Sensors for waiting1819## Common Use Cases2021- ETL pipelines22- ML pipelines23- Data orchestration24- Batch processing25- Workflow automation2627## Best Practices2829- Keep DAGs simple and flat30- Use proper task grouping31- Implement retry strategies32- Use connections properly33- Monitor with Airflow UI3435## Resources3637- Airflow.apache.org: airflow.apache.org/docs38- Related Skills: data-engineering, python, kubernetes
Run npx get-skill add neuralblitz/airflow-2 in your terminal (requires Node.js), paste this page's agent-chat prompt into Claude, Cursor, or any MCP-connected agent, or download the SKILL.md file and copy it into your agent's skills directory.
Apache Airflow It is listed under AI & ML on SkillMD.
This skill has not completed SkillMD's automated safety review yet. Independent scanners report: SkillSpector: PASS, Skill Scanner: PASS. Capability flags: docs only. SkillMD never runs a skill's scripts for you; review the SKILL.md before installing.
This skill is tagged as working with Claude Code, Claude.ai, OpenAI Codex. SKILL.md is an open format, so most agents that read a skills directory can load it too.
Yes. Installing skills from SkillMD is free, and the skill stays under its author's original license.
NeuralBlitz (@neuralblitz) published this skill. Their other Agent Skills are listed on their SkillMD profile.