Kublr Release 1.28.0 (2024-04-01)

Kublr Quick Start

To quickly get started with Kublr, run the following command in your terminal:

sudo docker run --name kublr -d --restart=unless-stopped -p 9080:9080 kublr/kublr:1.28.0

The Kublr Demo/Installer docker container can be run on ARM-based machines, such as MacBook M1.

Follow the full instructions in Quick start for Kublr Demo/Installer.

Overview

The Kublr 1.28.0 release introduces several new features and improvements, including:

  • Support for Kubernetes 1.28
  • Cluster specification Go template
  • Helm Operator based on Addon manager strategy, running before cluster nodes are ready, providing the possibility to install infrastructure helm packages (e.g., CNI/CSI/CPI)
  • New BackUp controller (based on Velero), available as a technical preview

All Kublr components are checked for vulnerabilities using Aquasecurity trivy scaner. In addition to these major features, the release also includes various other improvements and fixes.

Supported Kubernetes Versions

VersionKublr AgentNotes
1.281.28.8-1Default version: v1.28.8
1.271.27.12-1
1.261.26.15-1
1.251.25.16-1Deprecated in 1.29.0
1.241.24.13-6End of support in 1.29.0

Important Changes

  • New versions of Kubernetes:

  • Deprecations:

    • Kubernetes v1.23 (v1.23.17/agent 1.23.17-6) has reached End of Support.
    • Kubernetes v1.24 (v1.24.13 by default) has been deprecated and will be removed in Kublr v1.29.0
    • The old Kublr BackUp controller has been deprecated and will be fully removed in Kublr v1.29.0. A new BackUp controller is available in Kublr v1.28.0 as a technical preview.
    • Elasticsearch 7.10.2 has reached End of Support. Starting from Kublr v1.29.0, OpenSearch will be used as the default log collection system.
    • The VMWare Cloud Director based environment has been deprecated and will be moved to Extra Features support in Kublr v1.29.0.
    • Wave CNI has reached End of Support and will be removed in Kublr v1.29.0
  • Kublr now supports cluster specification templating. You can utilize Go template functionality in the cluster specification.

  • The Kublr Helm Manager enables helm package installation on the infrastructure layer before Kubernetes nodes reach the Ready state. The Manager utilizes Kubernetes secrets as CR definitions and operates as a Kubernetes operator, functioning similarly to the native Kubernetes Addon Manager.

  • Kublr Operator contains values.yaml templating logic in the helm packages. You can specify templates/kublr/values-template.yaml file in the helm chart for values.yaml calculating before install/upgrade begins

  • The Kublr Operator incorporates values.yaml templating logic in the helm packages. You can specify the templates/kublr/values-template.yaml file in the helm chart to calculate values.yaml before the install/upgrade process begins.

  • Kublr Helm packages now utilize the Kublr Common package. Helm development standards have been implemented.

  • The Cluster Controller has undergone a complete refactor of its node update/reconcile logic. As a result, you now have access to comprehensive node status information on the UI.

  • A Velero-based BackUp controller has been implemented for AWS (technical preview). Please refer to our support portal for usage examples.

Improvements

  • Kublr Agents:

    • Upgraded patch versions of supported Kubernetes versions.
    • Cilium CNI added
    • Improved out of tree CPI/CSI drivers support logic
    • Updated Cloud CSI/CPI drivers
  • Kublr Control Plane:

    • MongoDB migrates to v6.0.10
    • PostgreSQL migrates to v15.4.0
    • Improved works with Helm/Docker/Agent repo secrets
    • UI improvements:
      • Fixed nodes report state on cluster upgrade/install in progress
      • Improved performance
      • LogRocket removed
  • Azure:

    • Customize global scope tag for each kind in the Deployments
  • AWS:

    • The issue where ALB prevented Kublr clusters from being deleted has been fixed.
  • vSphere:

    • The issue with CSI drivers in topology-aware DRS/ESXi clusters has been fixed.
  • Centralized Log Collection:

    • OpenSearch v2.8.0. Official HELM chart v2.13.3 included
    • SearchGuard plugins updated
    • FluentBit updated to v2.1.8
  • Centralized Monitoring:

    • VictoriaMetrics stack updated (vmcluser 0.11.13, vmagent 0.10.3, vmalert 0.9.3)
    • Grafana 10.0 suppport. Official HELM chart v7.3.5 included
    • KubeStateMetrics upgraded to v5.16.4
  • Kublr NGINX Ingress:

    • NGINX Ingress controller helm chart v4.8.0, default controller version: v1.8.2
    • Cert manger helm chart v1.13.2
  • Stability, Reliability, and Security:

    • UI bug fixes
    • Upgrade controller improvements, ready for UI implementation
    • Cluster autoscaler version updated
    • Default Helm client updated to 3.13.2
    • SwaggerUI has been removed and is ready to be implemented as Embed Swagger UI in Kublr v1.29.0.

Components versions

Kublr Control Plane

ComponentVersion
Kublr Operator1.28.0
Kublr Control Plane1.28.0

Kublr Platform Features

ComponentVersion
Kubernetes
Dashboardv2.7.0
Kublr System1.28.0
LocalPath Provisioner (helm chart version)0.0.24
Ingress1.28.0
nginx ingress controller (helm chart version)4.8.0
cert-manager (helm chart version)1.13.2
Centralized Logging1.28.0
ElasticSearch7.10.2
SearchGuard53.6.0
Kibana7.10.2
SearchGuard Kibana plugin53.0.0
SearchGuard Admin7.10.2-53.6.0
OpenSearch (helm chart version)2.13.3
OpenSearch Dashboards(helm chart version)
RabbitMQ3.9.5
Curator5.8.1
Logstash7.10.2
Fluentd1.16.3
Fluentbit2.1.8
Centralized Monitoring1.28.0
Prometheus2.45.0 LTS
Kube State Metrics (helm chart version)5.16.4
AlertManager0.27.0
Grafana (helm chart version)7.3.5
Victoria Metrics
Cluster0.11.13
Agent0.10.3
Alert0.9.3

AirGap Artifacts List

To use Kublr in an airgap environment, you will need to download the following BASH scripts from the repository at https://repo.kublr.com:

You will also need to download the following Helm package archive and Docker images lists:

Supported Kubernetes Versions

v1.28

v1.27

v1.26

v1.25 (Deprecated in 1.29.0)

v1.24 (Deprecated in 1.28.0, End of support in 1.29.0)

Known Issues and Limitations

  • Kublr Helm manager have not Proxy server support