1---2name: devops-proxmox3description: Use when installing, operating or automating Proxmox VE 9.x - repositories, clusters and quorum (corosync, QDevice), HA and the Cluster Resource Scheduler, storage.cfg (LVM-thin, ZFS, Ceph, NFS, PBS), VLAN-aware bridges and SDN, the PVE firewall, VMs (qm) and containers (pct), cloud-init templates, pvesh/pveum and API tokens, backup jobs to Proxmox Backup Server, 8 to 9 upgrades (pve8to9), or importing VMs from ESXi. Not for ZFS/Ceph/PBS internals or restore drills (devops-storage-backup), plain KVM/libvirt/Incus/Packer (devops-virtualization), Terraform/OpenTofu providers (devops-iac) or generic nftables/DNS/TLS (devops-networking).4versions:5 proxmox-ve: "9.2"6 proxmox-ve-docs: "9.2.13"7 proxmox-backup-server: "4.2"8 ceph-on-pve: "20.2 Tentacle (default), 19.2 Squid"9user-invocable: true10references:11 - references/install-repositories.md12 - references/cluster-quorum.md13 - references/ha-crs.md14 - references/storage-model.md15 - references/networking-sdn.md16 - references/firewall.md17 - references/guests-qm-pct.md18 - references/api-access.md19 - references/backup-pbs.md20 - references/upgrade-migration.md21 - references/safe-change-protocol.md22 - references/templates/cloud-init-template.md23 - references/templates/vlan-aware-bridge.md24 - references/templates/api-token-least-privilege.md25 - references/templates/backup-job-pbs.md26 - references/templates/pre-upgrade-checklist.md27related-skills:28 - devops-storage-backup29 - devops-virtualization30 - devops-networking31 - devops-linux32 - devops-iac33 - devops-ansible34 - devops-observability35 - devops-secrets36 - devops-sre-ops37metadata:38 source: https://skillmd.com/skills/fusengine/devops-proxmox39---4041<objective>42Covers Proxmox VE 9.x as a platform - repositories, clusters, HA/CRS, the storage43model as PVE sees it, networking and SDN, the firewall, VM/CT lifecycle with44cloud-init, API automation and least-privilege access, backup jobs to PBS, major45upgrades and imports - always via read-only discovery, dry run, one go, safety46net, verification and a ready rollback. Does not cover ZFS/Ceph/PBS internals47(devops-storage-backup), generic KVM/libvirt (devops-virtualization), IaC48providers (devops-iac) or general nftables/DNS/TLS (devops-networking).49</objective>5051# Proxmox VE5253## Agent Workflow (MANDATORY)5455Before ANY Proxmox change, spawn in parallel, one `Agent` call each with a `name`:56571. **fuse-ai-pilot:explore-codebase** - find local IaC/Ansible/scripts touching PVE (`pvesh`, `qm`, `/etc/pve`, provider configs)582. **fuse-ai-pilot:research-expert** - re-read https://pve.proxmox.com/wiki/Roadmap (newer release? its known issues) and the man page of every command you will run593. **mcp__context7__query-docs** (`/websites/pve_proxmox_pve-docs`, `/proxmox/pve-docs`) - confirm each option you are about to write6061On a live host, Phase A discovery is read-only ([safe-change-protocol.md](references/safe-change-protocol.md)). After file changes in a repo, run **fuse-ai-pilot:sniper**.6263---6465## Overview6667| Area | What matters on 2026-11-10 |68|------|----------------------------|69| **Release** | PVE 9.2 (2026-05-21, Debian 13.5, kernel 7.0, QEMU 11.0); PVE 8 is EOL since 2026-08; PBS 4.2 |70| **Cluster/HA** | QDevice for even node counts only; HA groups -> affinity rules; CRS `dynamic` + auto-rebalance (HA guests only); `disarm-ha`/`arm-ha` |71| **Storage** | GlusterFS dropped in 9.0; snapshots as volume chains are tech preview; Ceph Tentacle is the default for new installs |72| **Network/Firewall** | Core SDN supported, IPAM/DHCP and FRR tech preview; pin NIC names; nftables `proxmox-firewall` tech preview |73| **Guests** | OCI-image containers tech preview; privileged CTs need `Sys.Modify`; cgroup v1 gone |7475---7677## Critical Rules78791. **Read-only first** - `pveversion`, `pvecm status`, `ha-manager status`, `pvesm status`, `qm list`, `pct list` before any write; stop on lost quorum, fenced HA services or inactive storage.802. **Never invent a command, option or API path** - every one used here is from the man pages, the admin guide or the API viewer (docs 9.2.13); anything else goes under "Not verified".813. **Destructive and cluster-breaking commands are proposed, never run on your own** - `qm destroy`, `pct destroy`, `pvecm delnode`, `pvecm expected`, `pvesm remove`/`free`, `zfs destroy`, `pveceph osd destroy`, edits to `/etc/pve/corosync.conf`, `disarm-ha`: state the exact effect and quorum impact, then wait for the user's go naming the object.824. **A verified backup precedes every irreversible step** - snapshot for reversible guest changes, `vzdump --protected 1` before destroy/upgrade; a backup counts once a restore was tested.835. **One node at a time, always with a way back** - upgrades, reboots, network and firewall changes; console access or a timed revert; quorum and HA checked between nodes.846. **Tech preview is said out loud** - nftables firewall, SDN IPAM/DHCP/FRR, OCI app containers, volume-chain snapshots, BTRFS.8586---8788## Architecture8990```91/etc/pve/ # pmxcfs, replicated cluster-wide, read-only without quorum92├── corosync.conf # membership + links (edit a copy, bump config_version)93├── storage.cfg # every storage definition94├── datacenter.cfg # crs:, migration, defaults95├── jobs.cfg # backup jobs (pvescheduler)96├── qemu-server/ lxc/ # <vmid>.conf of this node's VMs / CTs97├── firewall/ nodes/<node>/host.fw # cluster.fw, <vmid>.fw, host rules98├── sdn/ # zones, vnets, subnets, fabrics (+ .running-config)99└── priv/ # keys, storage passwords (root only)100/etc/network/interfaces(.new) # node networking (ifupdown2, ifreload -a)101/etc/apt/sources.list.d/*.sources # deb822 repositories102```103104---105106## Reference Guide107108### Concepts109110| Topic | Reference | When to Consult |111|-------|-----------|-----------------|112| **Install & repos** | [install-repositories.md](references/install-repositories.md) | Versions/EOL, enterprise vs no-subscription, deb822, apt 401 |113| **Cluster & quorum** | [cluster-quorum.md](references/cluster-quorum.md) | create/join, QDevice, delnode, expected votes, corosync.conf |114| **HA & CRS** | [ha-crs.md](references/ha-crs.md) | HA resources, affinity rules, fencing, rebalancing, maintenance |115| **Storage** | [storage-model.md](references/storage-model.md) | storage.cfg, type choice, pvesm, removal semantics |116| **Network & SDN** | [networking-sdn.md](references/networking-sdn.md) | bridges, VLANs, NIC pinning, zones/VNets |117| **Firewall** | [firewall.md](references/firewall.md) | enabling without lockout, guest rules, nftables preview |118| **VMs & CTs** | [guests-qm-pct.md](references/guests-qm-pct.md) | qm/pct lifecycle, cloud-init, destroy semantics |119| **API & access** | [api-access.md](references/api-access.md) | pvesh, pveum, roles, ACLs, API tokens |120| **Backups** | [backup-pbs.md](references/backup-pbs.md) | vzdump modes, jobs, retention, PBS storage, encryption |121| **Upgrade & import** | [upgrade-migration.md](references/upgrade-migration.md) | pve8to9, minor updates, ESXi/OVF/disk import |122| **Safe change** | [safe-change-protocol.md](references/safe-change-protocol.md) | any write on a live node; destructive command catalogue |123124### Templates125126| Template | When to Use |127|----------|-------------|128| [cloud-init-template.md](references/templates/cloud-init-template.md) | Build a cloud-init VM template and deploy clones |129| [vlan-aware-bridge.md](references/templates/vlan-aware-bridge.md) | Bond + VLAN-aware `vmbr0` + corosync NIC, with timed revert |130| [api-token-least-privilege.md](references/templates/api-token-least-privilege.md) | Automation user, role, pool, privsep token with expiry |131| [backup-job-pbs.md](references/templates/backup-job-pbs.md) | Attach PBS with encryption, scheduled job with retention |132| [pre-upgrade-checklist.md](references/templates/pre-upgrade-checklist.md) | 8.4 to 9.x upgrade, cluster and per-node evidence |133134---135136## Quick Reference137138```bash139pveversion; pvecm status; ha-manager status; pvesm status; qm list; pct list # read-only state140pvesh get /cluster/resources --output-format json-pretty # whole cluster inventory141qm snapshot <vmid> pre-change && qm config <vmid> # reversible safety net142vzdump <vmid> --storage <pbs-id> --mode snapshot --protected 1 # irreversible-step safety net143pve8to9 --full; pve-firewall status # upgrade checklist; firewall compile check144```145146---147148## Best Practices149150### DO151- Enterprise repository in production, same subscription level on every node152- Corosync on its own NIC plus a second link on another physical network153- Groups, pools and privilege-separated, expiring API tokens for access154- `protection 1` on critical guests; pin NIC names before kernel or major upgrades155156### DON'T157- Power a deleted node back on with its old config; enable a `DROP` input policy before the `management` IP set holds your admin addresses158- Treat `pvesm remove` as data deletion, or `pvesm free`/`qm destroy` as reversible159- Run Docker directly on the PVE host - use a VM