agentskillexchange dlt Python Data Load Tool
An open-source Python library that makes loading data from APIs, databases, and files into structured datasets simple and Pythonic. dlt automates schema inference, incremental loading, and normalization, supporting destinations like DuckDB, BigQuery, Snowflake, and Postgres.
Installation
Use the upstream install or setup path that matches your environment:
- pip install dlt
Requirements and caveats from upstream:
- data load tool (dlt) — the open-source Python library that automates all your tedious data loading tasks
- dlt supports Python 3.9 through Python 3.14. Note that some optional extras are not yet available for Python 3.14, so support for this version is considered experimental.
- python
Basic usage or getting-started notes:
sh
Load chess game data from chess.com API and save it in DuckDB:
import dlt
Source: https://github.com/dlt-hub/dlt
Extracted from upstream docs: https://raw.githubusercontent.com/dlt-hub/dlt/HEAD/README.md