{"id":67178,"date":"2025-09-16T09:00:30","date_gmt":"2025-09-16T07:00:30","guid":{"rendered":"https:\/\/nolabnoparty.com\/?p=67178"},"modified":"2025-09-14T17:56:38","modified_gmt":"2025-09-14T15:56:38","slug":"proxmox-upgrade-ceph-reef-to-squid","status":"publish","type":"post","link":"https:\/\/nolabnoparty.com\/en\/proxmox-upgrade-ceph-reef-to-squid\/","title":{"rendered":"Proxmox upgrade Ceph Reef to Squid"},"content":{"rendered":"

\"upgrade-ceph-reef-to-squid-in-proxmox-01\"<\/p>\n

If you are running Ceph Reef in your Proxmox infrastructure<\/a> and plan to upgrade to Proxmox 9, you must first upgrade Ceph Reef to Squid to meet the prerequisites<\/strong>.<\/p>\n

As a best practice, before proceeding with the upgrade make sure to have a working backup<\/a> of your VMs and Containers<\/strong>.<\/p>\n

 <\/p>\n

Prerequisites<\/h2>\n

To upgrade Ceph Reef to Squid, make sure all nodes are running Proxmox VE 8.2<\/a> (or higher) and Ceph is on version Reef (18.2.4-pve3 or higher).<\/p>\n

Verify the installed Proxmox version.<\/p>\n

# pveversion<\/span><\/p>\n

\"\"<\/p>\n

Check the installed Ceph cluster version.<\/p>\n

# ceph --version<\/span><\/p>\n

\"\"<\/p>\n

Confirm the Ceph cluster<\/a> is in a healthy state.<\/p>\n

# ceph -s<\/span><\/p>\n

\"\"<\/p>\n

 <\/p>\n

Prepare the system<\/h2>\n

On all nodes<\/strong>, change the Ceph repositories<\/strong> from Reef to Squid.<\/p>\n

# sed -i 's\/reef\/squid\/' \/etc\/apt\/sources.list.d\/ceph.list<\/span><\/p>\n

\"\"<\/p>\n

Verify the \/etc\/apt\/sources.list.d\/ceph.list<\/em> file contains the correct entry. For users with a valid subscription<\/strong>, the entry should be:<\/p>\n

deb https:\/\/enterprise.proxmox.com\/debian\/ceph-squid bookworm enterprise<\/p><\/blockquote>\n

# cat \/etc\/apt\/sources.list.d\/ceph.list<\/span><\/p>\n

\"\"<\/p>\n

If you don't have a valid subscription, use the publicly available no-subscription repository<\/strong>.<\/p>\n

deb http:\/\/download.proxmox.com\/debian\/ceph-squid bookworm no-subscription<\/p><\/blockquote>\n

# cat \/etc\/apt\/sources.list.d\/ceph.list<\/span><\/p>\n

\"\"<\/p>\n

To prevent the Ceph cluster from rebalancing<\/strong> during the upgrade, set the\u00a0noout<\/em> flag.<\/p>\n

# ceph osd set noout<\/span><\/p>\n

\"\"<\/p>\n

 <\/p>\n

Upgrade Ceph Reef to Squid cluster<\/h2>\n

Once the system is prepared to upgrade Ceph Reef to Squid, you can begin the upgrade process. Perform these steps on each node, one at a time<\/strong>.<\/p>\n

Place the first node in Maintenance Mode<\/strong> to stop HA services<\/strong>. Optional but suggested.<\/p>\n

# ha-manager crm-command node-maintenance enable proxmox01<\/span><\/p>\n

\"\"<\/p>\n

Verify the node is in Maintenance Mode.<\/p>\n

\"\"<\/p>\n

Refresh the repositories package<\/b>.<\/p>\n

# apt update<\/span><\/p>\n

\"\"<\/p>\n

Install the latest updates.<\/p>\n

# apt full-upgrade<\/span><\/p>\n

\"\"<\/p>\n

Exit the node from Maintenance Mode<\/b>.<\/p>\n

# ha-manager crm-command node-maintenance disable proxmox01<\/span><\/p>\n

\"\"<\/p>\n

Check the Ceph version. Ceph Squid 19.2.2<\/strong>\u00a0should be displayed.<\/p>\n

# ceph --version<\/span><\/p>\n

\"\"<\/p>\n

Repeat this process for all remaining nodes<\/strong>, keeping the noout<\/em> flag set<\/strong> throughout the entire procedure.<\/p>\n

 <\/p>\n

Post upgrade<\/h2>\n

After upgrading all nodes, verify that the Ceph cluster is in a healthy state<\/strong>. A \"noout flag(s) set<\/em>\" health warning<\/strong> is normal at this stage.<\/p>\n

# ceph -s<\/span><\/p>\n

\"\"<\/p>\n

From the Proxmox GUI, select a node and go to Ceph > Monitor<\/strong>. The reported Version<\/strong> should be the old value that needs to be updated.<\/p>\n

\"\"<\/p>\n

Check the monitor version on one node. It should report \"min_mon_release 18 (reef)<\/em>\".<\/p>\n

# ceph mon dump | grep min_mon_release<\/span><\/p>\n

\"\"<\/p>\n

Restart the monitor<\/strong> on each node where a monitor runs.<\/p>\n

# systemctl restart ceph-mon.target<\/span><\/p>\n

\"\"<\/p>\n

After restarting all monitors, ensure the upgrade is complete<\/strong>. It should now report \"min_mon_release 19 (squid)<\/em>\".<\/p>\n

# ceph mon dump | grep min_mon_release<\/span><\/p>\n

\"\"<\/p>\n

If the daemon manager<\/strong> doesn't restart automatically, manually restart it on the nodes where it is enabled.<\/p>\n

# systemctl restart ceph-mgr.target<\/span><\/p>\n

\"\"<\/p>\n

Verify that both the monitor and manager versions are 19.2.2<\/strong> within the Proxmox UI under Ceph > Monitor<\/b>.<\/p>\n

\"\"<\/p>\n

Now go to Ceph > OSD<\/strong> and check the OSDs Version<\/strong>. Some disks need to be updated.<\/p>\n

\"\"<\/p>\n

Restart all OSDs<\/strong> on each node. To avoid data loss, run the command one node at time<\/strong>.<\/p>\n

# systemctl restart ceph-osd.target<\/span><\/p>\n

\"\"<\/p>\n

After restarting all OSDs<\/strong> on all nodes, verify the OSD Version<\/strong> is 19.2.2 in the Proxmox UI under Ceph > OSD<\/strong>.<\/p>\n

\"\"<\/p>\n

After all OSDs are running the latest version, you may see a health warning<\/strong> \"all OSDs are running squid or later but require_osd_release < squid<\/em>\".<\/p>\n

# ceph -s<\/span><\/p>\n

\"\"<\/p>\n

To fix this, disallow pre-Reef OSDs<\/strong> and enable all new Squid-only functionality<\/strong>.<\/p>\n

# ceph osd require-osd-release squid<\/span><\/p>\n

\"\"<\/p>\n

# ceph -s<\/span><\/p>\n

\"\"<\/p>\n

The last step is to unset<\/b> the noout<\/i> flag.<\/p>\n

# ceph osd unset noout<\/span><\/p>\n

\"\"<\/p>\n

The Ceph Squid cluster is now in a healthy state.<\/p>\n

# ceph -s<\/span><\/p>\n

\"\"<\/p>\n

Your Ceph cluster has now been successfully upgraded from Reef to Squid<\/a>. This completes the prerequisite for the Proxmox 8 to 9 upgrade<\/strong>.<\/p>\n

\"signature\"<\/p>\n","protected":false},"excerpt":{"rendered":"

If you are running Ceph Reef in your Proxmox infrastructure and plan to upgrade to Proxmox 9, you must first upgrade Ceph Reef to Squid to meet the prerequisites. As a best practice, before proceeding with the upgrade make sure to have a working backup of your VMs and Containers.<\/p>\n","protected":false},"author":3,"featured_media":67435,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"rop_custom_images_group":[],"rop_custom_messages_group":[],"rop_publish_now":"no","rop_publish_now_accounts":{"linkedin_93tdZWzMZc_93tdZWzMZc":"","facebook_2879994398731222_17841400390232720":"","twitter_113568041_113568041":"","mastodon_115463926174894442_115463926174894442":""},"rop_publish_now_history":[{"account":"facebook_2879994398731222_234218296615646","service":"facebook","timestamp":1758006031,"status":"queued"},{"account":"twitter_113568041_113568041","service":"twitter","timestamp":1770806954,"status":"success"},{"account":"linkedin_93tdZWzMZc_93tdZWzMZc","service":"linkedin","timestamp":1770806969,"status":"error"}],"rop_publish_now_status":"queued","footnotes":""},"categories":[2798],"tags":[2890,2795,3011,3012,876],"class_list":["post-67178","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-proxmox-en","tag-ceph","tag-proxmox","tag-reef","tag-squid","tag-upgrade-en","has_thumb"],"_links":{"self":[{"href":"https:\/\/nolabnoparty.com\/en\/wp-json\/wp\/v2\/posts\/67178","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/nolabnoparty.com\/en\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/nolabnoparty.com\/en\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/nolabnoparty.com\/en\/wp-json\/wp\/v2\/users\/3"}],"replies":[{"embeddable":true,"href":"https:\/\/nolabnoparty.com\/en\/wp-json\/wp\/v2\/comments?post=67178"}],"version-history":[{"count":0,"href":"https:\/\/nolabnoparty.com\/en\/wp-json\/wp\/v2\/posts\/67178\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/nolabnoparty.com\/en\/wp-json\/wp\/v2\/media\/67435"}],"wp:attachment":[{"href":"https:\/\/nolabnoparty.com\/en\/wp-json\/wp\/v2\/media?parent=67178"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/nolabnoparty.com\/en\/wp-json\/wp\/v2\/categories?post=67178"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/nolabnoparty.com\/en\/wp-json\/wp\/v2\/tags?post=67178"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}

Checking the Ceph cluster<\/a>, it is now in a healthy state with the noout<\/em> flag set.<\/p>\n