Release 82

Charmed Apache Kafka

New revisions of Charmed Apache Kafka and Charmed Apache Kafka K8s have been published to their 3/stable channels.

Check the documentation on how to upgrade between minor versions on VM, and on K8s

Highlights

• Upgraded Apache Kafka version from 3.6.1 → 3.9.0

  • Check the official Apache Kafka Version 3.7.0 release notes

  • Check the official Apache Kafka Version 3.8.0 release notes

  • Check the official Apache Kafka Version 3.9.0 release notes

• Added support for the KRaft consensus protocol, removing the need for Apache ZooKeeper

  • Check the documentation for a guide on setting up a KRaft cluster

• Added support for partition rebalancing using Cruise Control

  • Check the documentation for a tutorial on partition rebalancing and reassignment using Cruise Control

• Created the karapace and karapace-k8s charms as a drop-in replacement for Schema Registry

  • Check the documentation on how to manage message schemas using Karapace

• Upgraded Apache ZooKeeper version from 3.8.2 → 3.9.2

  • Check the official Apache ZooKeeper Version 3.9.0 release notes

• Adding backup/restore support using S3

Features

• DPE-2872 - feat: partition rebalancing with Cruise Control #219

• DPE-4328 - feat: support KRaft #232

• DPE-6574 - feat: support cross-model K8s relations with juju expose #309

• DPE-6260 - feat: trust multi-certificate ca-chains #297

• DPE-6636 - feat: support non-unit/port extra_listeners #315

Improvements

• DPE-4956 - test: stabilise integration tests #229

• DPE-5226 - refactor: make ‘broker’ the central relation #244

• DPE-5591 - refactor: rework status handling #254

• DPE-5945 - chore: rename expose_external configuration option #274

• DPE-5553 - feat: don’t restart server on keystore/truststore updates #272

• DPE-5349 - feat: add internal user and SASL/SCRAM authentication #284

• DPE-6138 - chore: update zookeeper client lib #282

• DPE-6266 - chore: prepare charm for Charmcraft 3 #293

• DPE-5232;DPE-5233 - chore: support for scaling operations in KRaft mode (single & multi-app) #281

• DPE-6247 - test/cicd: stabilise int-test CI #320

Bug fixes

• DPE-4703 - chore: sync vm + k8s w. nodeport feature #226

• DPE-4951 - fix: re-enable prefixed topic names during relations #227

• DPE-5208 - fix: secure written znodes #231

• DPE-5218 - chore: enable compatibility with ZK restore feature #243

• DPE-5686 - test: fix flaky CI

• DPE-5611 - fix: remove cruise-control metrics reporter if no balancer #250

• DPE-5826 - fix: remove lost+found from new storages #275

• DPE-6261 - fix: remove ‘/’ character from generated SANs for Digicert #297

• DPE-6498 - fix: gracefully handle rebalance action when role not set #313

• DPE-6547 - fix: KRaft multi-mode scaling bug on broker side #319

Charmed Apache ZooKeeper

New revisions of Charmed Apache ZooKeeper and Charmed Apache ZooKeeper K8s have been published to their 3/stable channels.

Features

• DPE-5216 - feat: S3 integration #151

• DPE-5987 - feat: add expose-external configuration option #172

• DPE-5438 - feat: enable digest auth #173

• DPE-6262 - feat: support TLS certificate chains #181

Improvements

• DPE-3477 - chore: reload stores #152

• DPE-5373 - chore: create backup action #156

• DPE-5126 - chore: use admin server instead of the 4lw commands #154

• DPE-5373 - chore: implement list-backups action #157

• DPE-5549 - chore: enable TLS v1.2 for client communication #161

• DPE-5218 - chore: implement restore flow #162

• DPE-5874 - test/refactor: Unit test migration #171

Bug fixes

• DPE-5208 - fix: enforce client auth #150

• DPE-5463;DPE-5462 - fix: quote SERVER_JVMFLAGS, safe rm tls files #160

• DPE-5462 - fix: handle NoNodeError during relation-broken #168

• DPE-6157 - fix: don’t erase previous records from /etc/hosts #175