OpenShift Application Packaging
Package, build, secure, and deploy applications on OpenShift Container Platform
4.14-4.22. Covers container images, deployment manifests, CI/CD pipelines, security
hardening, operational patterns, and disconnected environments.
Quick Decision Guide
| Task |
Go to |
| Build a container image for OpenShift |
Container Images below |
| Choose Helm vs Kustomize vs Operator |
Packaging Decision Matrix below |
| Fix SCC / permission errors |
references/security.md (Restricted-v2 section) |
| Set up CI/CD pipeline |
references/cicd-gitops.md |
| Harden supply chain (sign, attest, scan) |
references/security.md (Supply Chain section) |
| Configure Routes, probes, scaling |
references/operations.md |
| Deploy in air-gapped / disconnected env |
references/disconnected.md |
| Migrate from DeploymentConfig |
references/gotchas.md (DeploymentConfig section) |
| Understand OCP version breaking changes |
references/gotchas.md (Version Timeline section) |
Critical Gotchas (Read First)
1. Arbitrary UID -- The #1 "Works on K8s, Fails on OpenShift" Issue
OpenShift assigns a random UID from a namespace-specific range but always
sets GID 0 (root group). Hardcoded USER 1000 in Dockerfiles will fail
under restricted-v2 SCC.
# OpenShift-compatible Dockerfile pattern
FROM registry.access.redhat.com/ubi9/ubi-minimal:latest
COPY --chown=1001:0 app /app
RUN chmod -R g=u /app && \
chgrp -R 0 /app
# Use 1001 as conventional non-root UID
# OpenShift ignores this and assigns its own UID, but vanilla K8s respects it
USER 1001
EXPOSE 8080
ENTRYPOINT ["/app/server"]
Key rules:
- Files:
chgrp -R 0 && chmod -R g=u (mirror owner perms to root group)
- Ports: must be > 1023 (no privileged ports under restricted SCC)
- USER: set to 1001 for portability, but leave
runAsUser empty in pod spec
- ENTRYPOINT: always use exec form
["binary"] (not shell form) for signal propagation
/etc/passwd: if app needs username lookup, make it group-writable and use entrypoint to append dynamic entry
/tmp: mount emptyDir if using readOnlyRootFilesystem: true
2. restricted-v2 SCC (Default Since OCP 4.11)
All authenticated users get restricted-v2. It is stricter than vanilla K8s PSS restricted:
| Field |
restricted-v2 |
K8s PSS restricted |
| Capabilities |
Drop ALL |
Drop some |
| allowPrivilegeEscalation |
false (enforced) |
false |
| seccompProfile |
RuntimeDefault required |
RuntimeDefault required |
| runAsUser |
MustRunAsRange (namespace range) |
MustRunAsNonRoot |
| Volume types |
configMap, downwardAPI, emptyDir, PVC, projected, secret |
Same + ephemeral |
Minimum compliant pod securityContext:
securityContext:
runAsNonRoot: true
# Do NOT set runAsUser -- let OpenShift assign from namespace range
seccompProfile:
type: RuntimeDefault
allowPrivilegeEscalation: false
capabilities:
drop: ["ALL"]
PSA runs in parallel with SCCs. A pod must pass both. OpenShift auto-labels
namespaces with PSA levels matching the most privileged SCC available.
3. Helm 4 Is NOT Usable with ArgoCD on OpenShift (2026)
- Helm 4.0.0 released November 2025 with Server-Side Apply as default
- OpenShift 4.19-4.21 still ships Helm 3 (web terminal bundles v3.17.1); 4.22's bundled version was not verified this pass
- ArgoCD (through v3.3 / GitOps 1.20) only supports Helm 3
- Helm 3 EOL: no published date could be confirmed (2026-07-21). Helm's version-skew and release-policy pages state only that the most recent minor gets fixes, with no Helm 3 sunset date — and Helm 3 is still shipping patches (v3.21.4 on 2026-08-14, alongside the 4.x line). Treat "Helm 3 is dead" as unsupported; plan on ArgoCD support, not on a calendar
- Recommendation: use Helm 3 now, plan Helm 4 migration after ArgoCD adds support
4. DeploymentConfig Is Deprecated (OCP 4.14)
Use Deployment for all new work. For ImageStream triggers on Deployments:
metadata:
annotations:
image.openshift.io/triggers: >-
[{"from":{"kind":"ImageStreamTag","name":"myapp:latest"},
"fieldPath":"spec.template.spec.containers[?(@.name==\"myapp\")].image"}]
Also set lookupPolicy.local: true on the ImageStream.
5. OpenShift SDN Removed in OCP 4.17
Must migrate to OVN-Kubernetes before upgrading. Key impacts:
- OVN reserves
100.64.0.0/16 and 100.88.0.0/16 (check for conflicts)
- MTU decreases by 50 bytes (OVN overlay overhead)
- Migration requires 2 node reboots (~double upgrade time)
- Egress policies that couldn't be enforced before now CAN be -- audit existing NetworkPolicies
6. cgroup v1 Removed in OCP 4.19
All nodes must run cgroup v2 before upgrading. cgroup v2 was the default for
new installs since 4.14, deprecated in 4.16.
7. Logging 6.0 Removes EFK Stack Entirely
Elasticsearch, Fluentd, and Kibana are gone. Replaced by LokiStack + Vector +
console UI plugin. Migration is NOT in-place -- deploy Loki/Vector in parallel,
run both stacks during retention window, then retire Elasticsearch.
Container Image Essentials
UBI Base Image Selection
| Variant |
Size (~compressed) |
Package Manager |
Use Case |
ubi9/ubi |
~80 MB |
dnf/yum |
Builder stages, development |
ubi9/ubi-minimal |
~36 MB |
microdnf |
Light runtime, need to install packages |
ubi9/ubi-micro |
~12 MB |
None |
Production runtime (multi-stage required) |
ubi9/ubi-init |
~80 MB |
dnf/yum |
systemd services (StopSignal: SIGRTMIN+3) |
Recommendation: UBI Micro for production runtime via multi-stage build.
UBI Minimal as builder stage. UBI Micro is preferred over scratch because
compliance scanners classify scratch images as unrecognizable.
UBI is freely redistributable without a Red Hat subscription.
Multi-Stage Build Pattern
# Stage 1: Build
FROM registry.access.redhat.com/ubi9/ubi-minimal:latest AS builder
RUN microdnf install -y --setopt=tsflags=nodocs --setopt=install_weak_deps=0 \
golang && microdnf clean all
COPY . /src
WORKDIR /src
RUN CGO_ENABLED=0 go build -o /app/server ./cmd/server
# Stage 2: Runtime
FROM registry.access.redhat.com/ubi9/ubi-micro:latest
COPY --from=builder --chown=1001:0 /app/server /app/server
RUN chmod g=u /app/server
USER 1001
EXPOSE 8080
ENTRYPOINT ["/app/server"]
Red Hat Container Certification Requirements
If certifying for the Red Hat Ecosystem Catalog:
- Base image: must use UBI or RHEL base
- Required labels:
name, vendor, version, release, summary, description
- Required directory:
/licenses with software terms
- Layers: max 40 (recommended 5-20)
- Security: no critical/important CVEs in Red Hat components (
dnf update-minimal --security --sec-severity=Important --sec-severity=Critical)
- Non-root: recommended (required for restricted-v2 SCC)
- Preflight checks: RunAsNonRoot, BasedOnUBI, HasLicense, HasRequiredLabel, LayerCountAcceptable, HasNoProhibitedPackages, etc.
- Recertification: every 12 months or when critical CVE > 3 months old
See references/container-images.md for full details.
Packaging Decision Matrix
| Format |
When to Use |
Limitations |
| Helm |
Distribute to other teams/customers; values-driven config; OperatorHub Helm operators |
Helm 3 only on OCP today; chart-verifier for certification |
| Kustomize |
Same-team env overlays (dev/staging/prod); GitOps prerequisite |
No templating logic; oc apply -k does NOT support --enable-helm |
| Helm + Kustomize |
Dominant hybrid: Helm for packaging, Kustomize for env patches |
Requires --enable-helm flag (only works in kustomize build or ArgoCD) |
| Operator (Go) |
Stateful apps needing Day-2 ops (backup/restore/scaling); L3-L5 maturity |
Complex to develop; Operator SDK CLI deprecation announced at OCP 4.16, 4.18 was the last OpenShift to ship it — on 4.19+ install it yourself from upstream, which continues |
| Operator (Helm) |
Simple operators for OperatorHub distribution |
Limited to L1-L2 capability maturity |
| OLM v1 ClusterExtension |
Install operators on OCP 4.18+ |
Requires user-provided ServiceAccount + RBAC; AllNamespaces only |
| OpenShift Templates |
Legacy only (NOT recommended for new work) |
Not portable to vanilla K8s; Template Service Broker removed in 4.4 |
Helm on OpenShift -- Key Patterns
Detect OpenShift at template time:
{{- define "mychart.isOpenshift" -}}
{{- if .Capabilities.APIVersions.Has "security.openshift.io/v1" -}}true{{- end -}}
{{- end -}}
Conditional Route vs Ingress:
{{- if .Capabilities.APIVersions.Has "route.openshift.io/v1" }}
apiVersion: route.openshift.io/v1
kind: Route
{{- else }}
apiVersion: networking.k8s.io/v1
kind: Ingress
{{- end }}
SCC-compatible values (let OpenShift assign UIDs):
securityContext:
runAsUser: null # Do NOT hardcode
fsGroup: null # Do NOT hardcode
runAsNonRoot: true
See references/packaging-formats.md for OLM v1, Kustomize patterns, and
certified chart requirements.
Additional References
| Reference |
Contents |
references/container-images.md |
UBI variants, multi-stage builds, arbitrary UID, certification, Podman, ImageStreams |
references/packaging-formats.md |
Helm on OCP, OLM v1 RBAC, Kustomize overlays, certified operators/charts |
references/security.md |
SCC/PSA, supply chain (Sigstore/RHTAS/Conforma), secrets (ESO/Vault), FIPS, compliance, NetworkPolicy |
references/cicd-gitops.md |
Tekton Pipelines, Chains, Pipelines-as-Code, ArgoCD Agent, Shipwright, image promotion |
references/operations.md |
Routes/TLS, probes, HPA/KEDA/VPA, monitoring, logging, storage, sidecars, serverless, multi-arch |
references/gotchas.md |
Version timeline (4.14-4.22), DeploymentConfig migration, SDN removal, networking changes |
references/disconnected.md |
oc-mirror v2, registry mirroring, OCI GitOps, Tekton bundles, OSUS upgrades, air-gap patterns |
1---2name: openshift-app3description: Package applications for OpenShift deployment: container images (UBI, arbitrary UID, multi-stage builds), packaging formats (Helm, Kustomize, Operators, OLM v1), CI/CD (Tekton, ArgoCD, Shipwright, Conforma), security (SCC, PSA, supply chain, image signing, secrets), operations (Routes, probes, scaling, monitoring, storage), disconnected/air-gapped patterns, and critical gotchas. Also when an app "works on Kubernetes but fails on OpenShift" (SCC denied, random/arbitrary UID, permission errors). Covers OCP 4.14-4.22. NOT for cluster installation or infrastructure management.4---56# OpenShift Application Packaging78Package, build, secure, and deploy applications on OpenShift Container Platform94.14-4.22. Covers container images, deployment manifests, CI/CD pipelines, security10hardening, operational patterns, and disconnected environments.1112## Quick Decision Guide1314| Task | Go to |15|------|-------|16| Build a container image for OpenShift | [Container Images](#container-image-essentials) below |17| Choose Helm vs Kustomize vs Operator | [Packaging Decision Matrix](#packaging-decision-matrix) below |18| Fix SCC / permission errors | `references/security.md` (Restricted-v2 section) |19| Set up CI/CD pipeline | `references/cicd-gitops.md` |20| Harden supply chain (sign, attest, scan) | `references/security.md` (Supply Chain section) |21| Configure Routes, probes, scaling | `references/operations.md` |22| Deploy in air-gapped / disconnected env | `references/disconnected.md` |23| Migrate from DeploymentConfig | `references/gotchas.md` (DeploymentConfig section) |24| Understand OCP version breaking changes | `references/gotchas.md` (Version Timeline section) |2526## Critical Gotchas (Read First)2728### 1. Arbitrary UID -- The #1 "Works on K8s, Fails on OpenShift" Issue2930OpenShift assigns a **random UID** from a namespace-specific range but always31sets **GID 0** (root group). Hardcoded `USER 1000` in Dockerfiles will fail32under `restricted-v2` SCC.3334```dockerfile35# OpenShift-compatible Dockerfile pattern36FROM registry.access.redhat.com/ubi9/ubi-minimal:latest3738COPY --chown=1001:0 app /app39RUN chmod -R g=u /app && \40 chgrp -R 0 /app4142# Use 1001 as conventional non-root UID43# OpenShift ignores this and assigns its own UID, but vanilla K8s respects it44USER 100145EXPOSE 808046ENTRYPOINT ["/app/server"]47```4849Key rules:50- **Files**: `chgrp -R 0 && chmod -R g=u` (mirror owner perms to root group)51- **Ports**: must be > 1023 (no privileged ports under restricted SCC)52- **USER**: set to 1001 for portability, but leave `runAsUser` empty in pod spec53- **ENTRYPOINT**: always use exec form `["binary"]` (not shell form) for signal propagation54- **`/etc/passwd`**: if app needs username lookup, make it group-writable and use entrypoint to append dynamic entry55- **`/tmp`**: mount emptyDir if using `readOnlyRootFilesystem: true`5657### 2. restricted-v2 SCC (Default Since OCP 4.11)5859All authenticated users get `restricted-v2`. It is stricter than vanilla K8s PSS restricted:6061| Field | restricted-v2 | K8s PSS restricted |62|-------|--------------|-------------------|63| Capabilities | Drop ALL | Drop some |64| allowPrivilegeEscalation | false (enforced) | false |65| seccompProfile | RuntimeDefault required | RuntimeDefault required |66| runAsUser | MustRunAsRange (namespace range) | MustRunAsNonRoot |67| Volume types | configMap, downwardAPI, emptyDir, PVC, projected, secret | Same + ephemeral |6869Minimum compliant pod securityContext:70```yaml71securityContext:72 runAsNonRoot: true73 # Do NOT set runAsUser -- let OpenShift assign from namespace range74 seccompProfile:75 type: RuntimeDefault76 allowPrivilegeEscalation: false77 capabilities:78 drop: ["ALL"]79```8081PSA runs **in parallel** with SCCs. A pod must pass both. OpenShift auto-labels82namespaces with PSA levels matching the most privileged SCC available.8384### 3. Helm 4 Is NOT Usable with ArgoCD on OpenShift (2026)8586- Helm 4.0.0 released November 2025 with Server-Side Apply as default87- **OpenShift 4.19-4.21 still ships Helm 3** (web terminal bundles v3.17.1); 4.22's bundled version was not verified this pass88- **ArgoCD (through v3.3 / GitOps 1.20) only supports Helm 3**89- Helm 3 EOL: **no published date could be confirmed** (2026-07-21). Helm's version-skew and release-policy pages state only that the most recent minor gets fixes, with no Helm 3 sunset date — and Helm 3 is still shipping patches (**v3.21.4 on 2026-08-14**, alongside the 4.x line). Treat "Helm 3 is dead" as unsupported; plan on ArgoCD support, not on a calendar90- **Recommendation**: use Helm 3 now, plan Helm 4 migration after ArgoCD adds support9192### 4. DeploymentConfig Is Deprecated (OCP 4.14)9394Use `Deployment` for all new work. For ImageStream triggers on Deployments:95```yaml96metadata:97 annotations:98 image.openshift.io/triggers: >-99 [{"from":{"kind":"ImageStreamTag","name":"myapp:latest"},100 "fieldPath":"spec.template.spec.containers[?(@.name==\"myapp\")].image"}]101```102Also set `lookupPolicy.local: true` on the ImageStream.103104### 5. OpenShift SDN Removed in OCP 4.17105106Must migrate to OVN-Kubernetes before upgrading. Key impacts:107- OVN reserves `100.64.0.0/16` and `100.88.0.0/16` (check for conflicts)108- MTU decreases by 50 bytes (OVN overlay overhead)109- Migration requires 2 node reboots (~double upgrade time)110- Egress policies that couldn't be enforced before now CAN be -- audit existing NetworkPolicies111112### 6. cgroup v1 Removed in OCP 4.19113114All nodes must run cgroup v2 before upgrading. cgroup v2 was the default for115new installs since 4.14, deprecated in 4.16.116117### 7. Logging 6.0 Removes EFK Stack Entirely118119Elasticsearch, Fluentd, and Kibana are gone. Replaced by LokiStack + Vector +120console UI plugin. Migration is NOT in-place -- deploy Loki/Vector in parallel,121run both stacks during retention window, then retire Elasticsearch.122123## Container Image Essentials124125### UBI Base Image Selection126127| Variant | Size (~compressed) | Package Manager | Use Case |128|---------|-------------------|----------------|----------|129| `ubi9/ubi` | ~80 MB | dnf/yum | Builder stages, development |130| `ubi9/ubi-minimal` | ~36 MB | microdnf | Light runtime, need to install packages |131| `ubi9/ubi-micro` | ~12 MB | None | Production runtime (multi-stage required) |132| `ubi9/ubi-init` | ~80 MB | dnf/yum | systemd services (StopSignal: SIGRTMIN+3) |133134**Recommendation**: UBI Micro for production runtime via multi-stage build.135UBI Minimal as builder stage. UBI Micro is preferred over `scratch` because136compliance scanners classify `scratch` images as unrecognizable.137138UBI is freely redistributable without a Red Hat subscription.139140### Multi-Stage Build Pattern141142```dockerfile143# Stage 1: Build144FROM registry.access.redhat.com/ubi9/ubi-minimal:latest AS builder145RUN microdnf install -y --setopt=tsflags=nodocs --setopt=install_weak_deps=0 \146 golang && microdnf clean all147COPY . /src148WORKDIR /src149RUN CGO_ENABLED=0 go build -o /app/server ./cmd/server150151# Stage 2: Runtime152FROM registry.access.redhat.com/ubi9/ubi-micro:latest153COPY --from=builder --chown=1001:0 /app/server /app/server154RUN chmod g=u /app/server155USER 1001156EXPOSE 8080157ENTRYPOINT ["/app/server"]158```159160### Red Hat Container Certification Requirements161162If certifying for the Red Hat Ecosystem Catalog:163- **Base image**: must use UBI or RHEL base164- **Required labels**: `name`, `vendor`, `version`, `release`, `summary`, `description`165- **Required directory**: `/licenses` with software terms166- **Layers**: max 40 (recommended 5-20)167- **Security**: no critical/important CVEs in Red Hat components (`dnf update-minimal --security --sec-severity=Important --sec-severity=Critical`)168- **Non-root**: recommended (required for restricted-v2 SCC)169- **Preflight checks**: RunAsNonRoot, BasedOnUBI, HasLicense, HasRequiredLabel, LayerCountAcceptable, HasNoProhibitedPackages, etc.170- **Recertification**: every 12 months or when critical CVE > 3 months old171172See `references/container-images.md` for full details.173174## Packaging Decision Matrix175176| Format | When to Use | Limitations |177|--------|------------|-------------|178| **Helm** | Distribute to other teams/customers; values-driven config; OperatorHub Helm operators | Helm 3 only on OCP today; chart-verifier for certification |179| **Kustomize** | Same-team env overlays (dev/staging/prod); GitOps prerequisite | No templating logic; `oc apply -k` does NOT support `--enable-helm` |180| **Helm + Kustomize** | Dominant hybrid: Helm for packaging, Kustomize for env patches | Requires `--enable-helm` flag (only works in `kustomize build` or ArgoCD) |181| **Operator (Go)** | Stateful apps needing Day-2 ops (backup/restore/scaling); L3-L5 maturity | Complex to develop; Operator SDK CLI deprecation announced at OCP 4.16, **4.18 was the last OpenShift to ship it** — on 4.19+ install it yourself from upstream, which continues |182| **Operator (Helm)** | Simple operators for OperatorHub distribution | Limited to L1-L2 capability maturity |183| **OLM v1 ClusterExtension** | Install operators on OCP 4.18+ | Requires user-provided ServiceAccount + RBAC; AllNamespaces only |184| **OpenShift Templates** | Legacy only (NOT recommended for new work) | Not portable to vanilla K8s; Template Service Broker removed in 4.4 |185186### Helm on OpenShift -- Key Patterns187188Detect OpenShift at template time:189```yaml190{{- define "mychart.isOpenshift" -}}191{{- if .Capabilities.APIVersions.Has "security.openshift.io/v1" -}}true{{- end -}}192{{- end -}}193```194195Conditional Route vs Ingress:196```yaml197{{- if .Capabilities.APIVersions.Has "route.openshift.io/v1" }}198apiVersion: route.openshift.io/v1199kind: Route200{{- else }}201apiVersion: networking.k8s.io/v1202kind: Ingress203{{- end }}204```205206SCC-compatible values (let OpenShift assign UIDs):207```yaml208securityContext:209 runAsUser: null # Do NOT hardcode210 fsGroup: null # Do NOT hardcode211 runAsNonRoot: true212```213214See `references/packaging-formats.md` for OLM v1, Kustomize patterns, and215certified chart requirements.216217## Additional References218219| Reference | Contents |220|-----------|----------|221| `references/container-images.md` | UBI variants, multi-stage builds, arbitrary UID, certification, Podman, ImageStreams |222| `references/packaging-formats.md` | Helm on OCP, OLM v1 RBAC, Kustomize overlays, certified operators/charts |223| `references/security.md` | SCC/PSA, supply chain (Sigstore/RHTAS/Conforma), secrets (ESO/Vault), FIPS, compliance, NetworkPolicy |224| `references/cicd-gitops.md` | Tekton Pipelines, Chains, Pipelines-as-Code, ArgoCD Agent, Shipwright, image promotion |225| `references/operations.md` | Routes/TLS, probes, HPA/KEDA/VPA, monitoring, logging, storage, sidecars, serverless, multi-arch |226| `references/gotchas.md` | Version timeline (4.14-4.22), DeploymentConfig migration, SDN removal, networking changes |227| `references/disconnected.md` | oc-mirror v2, registry mirroring, OCI GitOps, Tekton bundles, OSUS upgrades, air-gap patterns |