Prefect Python Workflow Orchestration Framework for Data Pipelines
Prefect is a Python workflow orchestration framework for building resilient data pipelines. Add scheduling, retries, caching, and observability to any Python script with simple decorators. Monitor workflows through the self-hosted Prefect server or managed Prefect Cloud dashboard.
Installation
Use the upstream install or setup path that matches your environment:
- pip install -U prefect
- uv add prefect
Requirements and caveats from upstream:
- Prefect is a workflow orchestration framework for building data pipelines in Python.
- Prefect requires Python 3.10+. To install the latest version of Prefect, run one of the following commands:
- Then create and run a Python file that uses Prefect flow and task decorators to orchestrate and observe your workflow - in this case, a simple script that fetches the number of GitHub stars from a repository:
Basic usage or getting-started notes:
·
Extracted from upstream docs: https://raw.githubusercontent.com/PrefectHQ/prefect/HEAD/README.md