Revision 205

This release upgrades workload versions for Apache Kafka to 3.9.0 and for Apache ZooKeeper to 3.9.2, as well as adds support for: Cruise Control partition rebalancing, KRaft consensus protocol, Karapace, and backup/restore using S3.

Charmhub | Deploy guide | Upgrade instructions | System requirements

Charmed Apache Kafka

New features and bug fixes in the Charmed Apache Kafka bundle:

Features

• [DPE-2872] - feat: partition rebalancing with Cruise Control (#219)

  • See the tutorial on partition rebalancing and reassignment using Cruise Control

• [DPE-4328] - feat: support KRaft (#232)

  • See the How-to guide on setting up a KRaft cluster

• [DPE-6574] - feat: support cross-model K8s relations with juju expose (#309)

• [DPE-6260] - feat: trust multi-certificate ca-chains (#297)

• [DPE-6636] - feat: support non-unit/port extra_listeners (#315)

Bug fixes

• [DPE-4703] - chore: sync vm + k8s w. nodeport feature (#226)

• [DPE-4951] - fix: re-enable prefixed topic names during relations (#227)

• [DPE-5208] - fix: secure written znodes (#231)

• [DPE-5218] - chore: enable compatibility with ZK restore feature (#243)

• [DPE-5686] - test: fix flaky CI

• [DPE-5611] - fix: remove cruise-control metrics reporter if no balancer (#250)

• [DPE-5826] - fix: remove lost+found from new storages (#275)

• [DPE-6261] - fix: remove ‘/’ character from generated SANs for Digicert (#297)

• [DPE-6498] - fix: gracefully handle rebalance action when role not set (#313)

• [DPE-6547] - fix: KRaft multi-mode scaling bug on broker side (#319)

Other improvements

• [DPE-4956] - test: stabilise integration tests (#229)

• [DPE-5226] - refactor: make ‘broker’ the central relation (#244)

• [DPE-5591] - refactor: rework status handling (#254)

• [DPE-5945] - chore: rename expose_external configuration option (#274)

• [DPE-5553] - feat: don’t restart server on keystore/truststore updates (#272)

• [DPE-5349] - feat: add internal user and SASL/SCRAM authentication (#284)

• [DPE-6138] - chore: update zookeeper client lib (#282)

• [DPE-6266] - chore: prepare charm for Charmcraft 3 (#293)

• [DPE-5232];[DPE-5233] - chore: support for scaling operations in KRaft mode (single & multi-app) (#281)

• [DPE-6247] - test/cicd: stabilise int-test CI (#320)

Charmed Apache ZooKeeper

New features and bug fixes in the Charmed Apache Kafka bundle:

Features

• [DPE-5216] - feat: S3 integration (#151)

• [DPE-5987] - feat: add expose-external configuration option (#172)

• [DPE-5438] - feat: enable digest auth (#173)

• [DPE-6262] - feat: support TLS certificate chains (#181)

Bug fixes

• [DPE-5208] - fix: enforce client auth (#150)

• [DPE-5463];[DPE-5462] - fix: quote SERVER_JVMFLAGS, safe rm tls files (#160)

• [DPE-5462] - fix: handle NoNodeError during relation-broken (#168)

• [DPE-6157] - fix: don’t erase previous records from /etc/hosts (#175)

Other improvements

• [DPE-3477] - chore: reload stores (#152)

• [DPE-5373] - chore: create backup action (#156)

• [DPE-5126] - chore: use admin server instead of the 4lw commands (#154)

• [DPE-5373] - chore: implement list-backups action (#157)

• [DPE-5549] - chore: enable TLS v1.2 for client communication (#161)

• [DPE-5218] - chore: implement restore flow (#162)

• [DPE-5874] - test/refactor: Unit test migration (#171)

Compatibility

Principal charms support the latest LTS series “22.04” only.

Charm	Revision	Hardware architecture	Juju version	Artefacts
Charmed Apache Kafka	205	AMD64	2.9.45+, Juju 3.1+	Distribution: 3.9.0-ubuntu1. Snap: revision 48.
Charmed Apache ZooKeeper	149	AMD64	2.9.45+, Juju 3.1+	Distribution: 3.9.2-ubuntu0. Snap: revision 39.

Apache Kafka release notes: 3.7.0, 3.8.0, 3.9.0.

Apache ZooKeeper release notes: 3.9.0, 3.9.1, 3.9.2.