Docker, Compose, BuildKit and Podman
Agent Workflow (MANDATORY)
Before ANY container change, spawn in parallel, one spawn_agent call each:
- explore-codebase - find
Dockerfile*, compose*.yaml, docker-bake.hcl, daemon.json, Quadlet units
- research-expert - re-check the versions in the Versions section at docs.docker.com and the GitHub releases
- mcp__context7__query-docs (
/docker/docs, /docker/compose) - confirm every flag or key you are about to write
On a live host, inspect read-only first (docker version, docker info, docker compose ls, docker system df). After changes, run sniper.
Overview
| Area |
What matters in 2026 |
| Engine 29 |
containerd image store is the default on fresh installs only; cgroup v1 deprecated; Docker Content Trust removed from the CLI |
| Compose v5 |
internal builder removed, builds go through Bake; top-level version: is obsolete |
| BuildKit / Buildx |
min-mode provenance added by default; SBOM is opt-in; Bake files drive multi-target builds |
| Firewall |
iptables is the default backend; nftables backend (firewall-backend) is experimental, no DOCKER-USER chain, not usable in Swarm |
| Supply chain |
cosign v3 stores signatures as OCI 1.1 referrers and uses the bundle format by default |
| Podman 6 / Quadlet |
.container/.network/.volume units generated into systemd services |
Critical Rules
- Never invent a flag or key -
dockerd --validate --config-file=... and docker compose config -q prove syntax before any restart or up.
- Published ports bypass ufw - Docker's
nat rules divert traffic before ufw's INPUT chain; bind to 127.0.0.1 or filter in DOCKER-USER (iptables) or your own nftables table.
- Do not edit Docker's own firewall tables or chains - Docker owns them and rewrites them.
- Destructive commands are proposed, never run on your own - prune,
volume rm, compose down -v, podman system reset: list what goes, state the effect, wait for the user's explicit go (safe-ops.md).
- Secrets never in
ENV, ARG or image layers - use build secret mounts and Compose secrets:; mode=max provenance exposes build args.
- Sign and deploy by digest, not tag - tags move; cosign signs
image@sha256:....
- Read the release notes before a minor upgrade - live-restore only survives patch upgrades, not
YY.MM jumps.
Architecture
/etc/docker/daemon.json # engine config (validate before restart)
project/{Dockerfile,.dockerignore,docker-bake.hcl,compose.yaml,secrets/} # secrets/ never committed
~/.config/containers/systemd/ # rootless Quadlet units (Podman)
Versions
Pinned versions:
docker-engine: "29.9.3"
docker-compose: "5.7.0"
buildkit: "0.34.2"
buildx: "0.38.2"
podman: "6.1.4"
cosign: "3.1.4"
distribution-registry: "3.1.2"
Reference Guide
Concepts
| Topic |
Reference |
When to Consult |
| Daemon config |
engine-daemon-config.md |
daemon.json, logging, storage, live-restore, rootless |
| Compose v5 |
compose-v5.md |
healthchecks, depends_on, profiles, secrets, limits |
| BuildKit |
buildkit-dockerfile.md |
multi-stage, cache mounts, multi-platform, SBOM, Bake |
| Networking |
networking-firewall.md |
bridge/macvlan, published ports, ufw, nftables backend |
| Registries |
registries-supply-chain.md |
registry:3, mirrors, cosign sign/verify, digests |
| Podman |
podman-quadlet.md |
rootless, Quadlet units, auto-update |
| Troubleshooting |
runtime-troubleshooting.md |
OOM, unhealthy loops, disk usage, events |
| Safe ops |
safe-ops.md |
any prune/rm/down -v/reset |
Templates
| Template |
When to Use |
| daemon-json.md |
Baseline /etc/docker/daemon.json for a server |
| dockerfile-hardened.md |
Multi-stage, non-root, cache-mounted Dockerfile |
| compose-production.md |
Compose app with healthchecks, limits, secrets |
| bake-and-sign.md |
Multi-arch Bake build + attestations + cosign sign/verify |
| quadlet-units.md |
Rootless Podman service as systemd units |
Quick Reference
docker version && docker info -f '{{ .DriverStatus }}' # engine + storage backend
dockerd --validate --config-file=/etc/docker/daemon.json # before any restart
docker compose config -q && docker compose up -d --wait # validate, then start until healthy
docker buildx bake --print # resolved build plan, builds nothing
docker system df -v # what uses the disk (read-only)
Best Practices
DO
- Pin base images by digest in production and rebuild on a schedule for patched layers
- Set
log-driver: local (rotated by default) or max-size/max-file on json-file
- Give every long-running service a healthcheck and memory/pids limits
- Prefer named volumes or explicit bind mounts for data; anonymous volumes are not reattached by a new
up
DON'T
- Expose the Docker socket or add users to the
docker group casually - it grants root-level privileges
- Set
"iptables": false to "fix" ufw - it breaks masquerading and exposes container ports to the LAN
- Run
docker system prune -a --volumes on a host that holds data
- Assume Compose
depends_on waits for readiness without condition: service_healthy
Related skills
- devops-kubernetes
- devops-cicd
- devops-linux
- devops-networking
- devops-secrets
- devops-observability
- devops-storage-backup
- devops-sre-ops
- dependency-audit
1---2name: devops-docker-23description: Use when configuring Docker Engine (daemon.json, logging, storage, live-restore), writing Compose files, building images with BuildKit/Buildx (multi-stage, cache mounts, multi-platform, SBOM/provenance, Bake), publishing ports safely next to a host firewall (iptables, experimental nftables backend, ufw/firewalld), running a private registry, signing images with cosign, running daemonless containers with Podman/Quadlet, or troubleshooting/cleaning a container host. Not for Kubernetes (devops-kubernetes), CI pipelines (devops-cicd), dependency vulnerability audits (dependency-audit) or Swarm.4metadata:5 source: https://skillmd.com/skills/fusengine/devops-docker-26---78<objective>9Covers a container host end to end: Engine daemon config, Compose v5, BuildKit/Buildx10builds (multi-stage, multi-platform, attestations, Bake), networking versus the host11firewall, registries, cosign signing, Podman/Quadlet, troubleshooting and safe cleanup.12Not covered: Kubernetes (devops-kubernetes), CI pipelines (devops-cicd), host nftables13design (devops-networking), secret stores (devops-secrets), CVE audits14(dependency-audit), Swarm.15</objective>1617# Docker, Compose, BuildKit and Podman1819## Agent Workflow (MANDATORY)2021Before ANY container change, spawn in parallel, one `spawn_agent` call each:22231. **explore-codebase** - find `Dockerfile*`, `compose*.yaml`, `docker-bake.hcl`, `daemon.json`, Quadlet units242. **research-expert** - re-check the versions in the Versions section at docs.docker.com and the GitHub releases253. **mcp__context7__query-docs** (`/docker/docs`, `/docker/compose`) - confirm every flag or key you are about to write2627On a live host, inspect read-only first (`docker version`, `docker info`, `docker compose ls`, `docker system df`). After changes, run **sniper**.2829---3031## Overview3233| Area | What matters in 2026 |34|------|----------------------|35| **Engine 29** | containerd image store is the default on fresh installs only; cgroup v1 deprecated; Docker Content Trust removed from the CLI |36| **Compose v5** | internal builder removed, builds go through Bake; top-level `version:` is obsolete |37| **BuildKit / Buildx** | min-mode provenance added by default; SBOM is opt-in; Bake files drive multi-target builds |38| **Firewall** | iptables is the default backend; nftables backend (`firewall-backend`) is experimental, no `DOCKER-USER` chain, not usable in Swarm |39| **Supply chain** | cosign v3 stores signatures as OCI 1.1 referrers and uses the bundle format by default |40| **Podman 6 / Quadlet** | `.container`/`.network`/`.volume` units generated into systemd services |4142---4344## Critical Rules45461. **Never invent a flag or key** - `dockerd --validate --config-file=...` and `docker compose config -q` prove syntax before any restart or `up`.472. **Published ports bypass ufw** - Docker's `nat` rules divert traffic before ufw's `INPUT` chain; bind to `127.0.0.1` or filter in `DOCKER-USER` (iptables) or your own nftables table.483. **Do not edit Docker's own firewall tables or chains** - Docker owns them and rewrites them.494. **Destructive commands are proposed, never run on your own** - prune, `volume rm`, `compose down -v`, `podman system reset`: list what goes, state the effect, wait for the user's explicit go ([safe-ops.md](references/safe-ops.md)).505. **Secrets never in `ENV`, `ARG` or image layers** - use build secret mounts and Compose `secrets:`; `mode=max` provenance exposes build args.516. **Sign and deploy by digest, not tag** - tags move; cosign signs `image@sha256:...`.527. **Read the release notes before a minor upgrade** - live-restore only survives patch upgrades, not `YY.MM` jumps.5354---5556## Architecture5758```59/etc/docker/daemon.json # engine config (validate before restart)60project/{Dockerfile,.dockerignore,docker-bake.hcl,compose.yaml,secrets/} # secrets/ never committed61~/.config/containers/systemd/ # rootless Quadlet units (Podman)62```6364---6566## Versions6768Pinned versions:6970```yaml71docker-engine: "29.9.3"72docker-compose: "5.7.0"73buildkit: "0.34.2"74buildx: "0.38.2"75podman: "6.1.4"76cosign: "3.1.4"77distribution-registry: "3.1.2"78```7980---8182## Reference Guide8384### Concepts8586| Topic | Reference | When to Consult |87|-------|-----------|-----------------|88| **Daemon config** | [engine-daemon-config.md](references/engine-daemon-config.md) | daemon.json, logging, storage, live-restore, rootless |89| **Compose v5** | [compose-v5.md](references/compose-v5.md) | healthchecks, depends_on, profiles, secrets, limits |90| **BuildKit** | [buildkit-dockerfile.md](references/buildkit-dockerfile.md) | multi-stage, cache mounts, multi-platform, SBOM, Bake |91| **Networking** | [networking-firewall.md](references/networking-firewall.md) | bridge/macvlan, published ports, ufw, nftables backend |92| **Registries** | [registries-supply-chain.md](references/registries-supply-chain.md) | registry:3, mirrors, cosign sign/verify, digests |93| **Podman** | [podman-quadlet.md](references/podman-quadlet.md) | rootless, Quadlet units, auto-update |94| **Troubleshooting** | [runtime-troubleshooting.md](references/runtime-troubleshooting.md) | OOM, unhealthy loops, disk usage, events |95| **Safe ops** | [safe-ops.md](references/safe-ops.md) | any prune/rm/down -v/reset |9697### Templates9899| Template | When to Use |100|----------|-------------|101| [daemon-json.md](references/templates/daemon-json.md) | Baseline `/etc/docker/daemon.json` for a server |102| [dockerfile-hardened.md](references/templates/dockerfile-hardened.md) | Multi-stage, non-root, cache-mounted Dockerfile |103| [compose-production.md](references/templates/compose-production.md) | Compose app with healthchecks, limits, secrets |104| [bake-and-sign.md](references/templates/bake-and-sign.md) | Multi-arch Bake build + attestations + cosign sign/verify |105| [quadlet-units.md](references/templates/quadlet-units.md) | Rootless Podman service as systemd units |106107---108109## Quick Reference110111```bash112docker version && docker info -f '{{ .DriverStatus }}' # engine + storage backend113dockerd --validate --config-file=/etc/docker/daemon.json # before any restart114docker compose config -q && docker compose up -d --wait # validate, then start until healthy115docker buildx bake --print # resolved build plan, builds nothing116docker system df -v # what uses the disk (read-only)117```118119---120121## Best Practices122123### DO124- Pin base images by digest in production and rebuild on a schedule for patched layers125- Set `log-driver: local` (rotated by default) or `max-size`/`max-file` on `json-file`126- Give every long-running service a healthcheck and memory/pids limits127- Prefer named volumes or explicit bind mounts for data; anonymous volumes are not reattached by a new `up`128129### DON'T130- Expose the Docker socket or add users to the `docker` group casually - it grants root-level privileges131- Set `"iptables": false` to "fix" ufw - it breaks masquerading and exposes container ports to the LAN132- Run `docker system prune -a --volumes` on a host that holds data133- Assume Compose `depends_on` waits for readiness without `condition: service_healthy`134135---136137## Related skills138139- devops-kubernetes140- devops-cicd141- devops-linux142- devops-networking143- devops-secrets144- devops-observability145- devops-storage-backup146- devops-sre-ops147- dependency-audit