Known Critical Issue in Releases v1.25.0, v1.25.1, and v1.25.3

Important Notice: Releases v1.25.0, v1.25.1, and v1.25.3 have a known critical issue. We strongly recommend using Kublr 1.25.4 or a later version instead.

Migration to v1.25.4

Important notice: Kublr v1.25.4 should only be upgraded from v1.24.0 or higher.

Upgrading to Kublr v1.24.0 should be done by upgrading first to v1.24.2. Skipping upgrades (from v1.23, v1.22, v1.21, etc.) is not supported and may not work as intended.

It is highly recommended to use at least Kublr v1.25.4 as it includes several critical patches and fixes.

Before upgrading, it is advisable to backup your KCP data using the instructions found on the support portal:

Other useful links:

Migration to Kubernetes v1.25 (v1.25.9 by default)

Before beginning to upgrade your Kublr managed clusters to Kubernetes v1.25 (v1.25.9 by default), please note that PSP support has been deprecated. You will need to remove PSP from your applications, and the Kublr team recommends upgrading all Kublr components before beginning any Kubernetes upgrades.

  • Upgrade the Kublr operator to the latest version 1.25.4.
  • Upgrade all Kublr components to the latest version 1.25.4.
  • Ensure that your application is ready to remove PSP.

Multiarchitecture platform support in Kublr agent

Starting from v1.25.0, Kublr deprecates kublrAgentTgzUrl agent definition and moves to structured annotation.

For example, use:

    kublrAgentRef: 1.22.17-11
    kublrAgentRef: 1.25.9-13

instead of:

  kublrAgentTgzUrl: https://repo.kublr.com/repository/gobinaries/kublr/1.22.17-11/kublr-1.22.17-11-linux.tar.gz
  kublrSeederTgzUrl: https://repo.kublr.com/repository/gobinaries/kublr/1.25.9-13/kublr-1.25.9-13-linux.tar.gz

When you start the upgrade, you will be notified about these changes. You can either ignore this warning or remove old annotations from the cluster specification after migrating to agents released with v1.25.0 or above (1.21.14-22, 1.22.17-4, 1.23.15-4, 1.24.9-4, 1.25.6-4).

Important notice regarding CertManager migration

Kublr v1.25.0 uses CertManager v1.10.0.

Before upgrading, make sure that all CertManager CRs are ready for migration or migrate them manually. For more information about the CRD deprecation and migration procedure, refer to the CertManager documentation at https://cert-manager.io/docs/installation/upgrading/remove-deprecated-apis/.

Important known issue with migrating Kublr Control Plane running in HA mode

If your Kublr Control Plane cluster runs in High Availability (HA) mode:

        version: 1.24.2
      highAvailability: true

you will need to take the following steps before upgrading:

  • Scale down the PostgreSQL replica count to 1
        version: 1.24.2
      highAvailability: true
            replicaCount: 1

And don’t forget to remove this value from the cluster specification once the upgrade is completed!

Important known Issue with migrating Azure Clusters to Kublr v1.23.0 or Higher

Kublr Kubernetes clusters deployed on Azure with earlier versions of Kublr may experience an Azure deployment error during an upgrade or update. To fix this issue, please refer to the Kublr Support Portal article on Azure: Fixing the Zoned Resources Error on Migration to Kublr 1.23.0 or Higher.

Important known Issue with migrating vSphere Clusters to Kublr v1.25.0 or Higher

If you have Kubernetes clusters deployed on vSphere using cloud-init based VM images, you may encounter an error from terraform processes during an upgrade to Kublr 1.25.0 or higher:

Error running command 'govc datastore.mv -f=true -ds=<Shared-Data-Store-NAME> <Kublr-Cluser-Name>-vsp1-master-0-cloud-init.iso <Kublr-Cluser-Name>-vsp1-master-0-cloud-init.iso.<SHA-SUM>.old`: exit status 1.
govc: File [Shared-Data-Store-NAME] <Kublr-Cluser-Name>-vsp1-master-0-cloud-init.iso.<SHA-SUM>.old was not found

To resolve this issue, please unmount CD/DVD drive 1 from each virtual machine manually using the vCenter console and try upgrading again.

Memry leak in the Kublr Agent

If you use Kublr Agents from releases v1.25.0, v1.25.1 or 1.25.3, Kublr team strongly recommends migrate to use agents from v1.25.4

Simultaneous Update of Kublr Control Plane

When upgrading to Kublr Control Plane v1.25.4, make sure to use the following component versions:

  • kublrOperator: 1.25.4
  • ControlPlane: 1.25.4