Docker Data Environments

Docker for data engineering environments — multi-stage Dockerfiles for dbt/Spark/Airflow images, BuildKit layer caching (--mount=type=cache), private registries (ghcr.io/Harbor), docker buildx multi-platform builds, Docker Compose local data stacks (Spark+Airflow+Kafka+MinIO+Postgres), BuildKit secrets for private PyPI, security hardening (non-root user, slim base images, read-only FS), CI/CD with GitHub Actions build-push-action

ivanshamaev Updated 24 repo stars

File contents

ivanshamaev/de-agent-skills commit 8ba2bb6f58

Frequently asked questions

npx get-skill add ivanshamaev/docker-data-environments