1. Set up the environment

This is a part of the Charmed Apache Kafka Tutorial.

For this tutorial, we will need to set up the environment with two main components, and extra command-line tooling:

  • LXD - a simple and lightweight virtual machine provisioner

  • Juju - enables us to deploy and manage Charmed Apache Kafka and related applications

  • yq - a command-line YAML processor

  • jq - a command-line JSON processor

Prepare LXD

The fastest, simplest way to get started with Charmed Apache Kafka is to set up a local LXD cloud. LXD is a system container and virtual machine manager; Apache Kafka will be run in one of these containers and managed by Juju. While this tutorial covers the basics of LXD, you can learn more about LXD here.

LXD comes pre-installed on Ubuntu 24.04 LTS. Verify that LXD is installed by entering the command which lxd. This will output /snap/bin/lxd or, for some systems, /usr/sbin/lxd.

Although LXD is already installed, we need to run lxd init to perform post-installation tasks. For this tutorial, the default parameters are preferred and the network bridge should be set to have no IPv6 addresses since Juju does not support IPv6 addresses with LXD:

lxd init --auto
lxc network set lxdbr0 ipv6.address none

You can list all LXD containers by entering the command lxc list into the command line. However, at this point of the tutorial, none should exist and you’ll only see this as output:

+------+-------+------+------+------+-----------+
| NAME | STATE | IPV4 | IPV6 | TYPE | SNAPSHOTS |
+------+-------+------+------+------+-----------+

Install and prepare Juju

Juju is an Operator Lifecycle Manager (OLM) for clouds, bare metal, LXD or Kubernetes. We will be using it to deploy and manage Charmed Apache Kafka. As may be true for LXD, Juju is installed from a snap package:

sudo snap install juju

Juju already has built-in knowledge of LXD and how it works, so there is no additional setup or configuration needed. A Juju controller will be deployed, which will in turn manage the operations of Charmed Apache Kafka. All we need to do is run the following command to bootstrap a Juju controller named overlord to LXD. This bootstrapping process can take several minutes depending on the resources available on your machine:

juju bootstrap localhost overlord

The Juju controller exists within an LXD container. To verify this, check the list of containers:

lxc list
Output example
+---------------+---------+-----------------------+------+-----------+-----------+
|     NAME      |  STATE  |         IPV4          | IPV6 |   TYPE    | SNAPSHOTS |
+---------------+---------+-----------------------+------+-----------+-----------+
| juju-<id>     | RUNNING | 10.105.164.235 (eth0) |      | CONTAINER | 0         |
+---------------+---------+-----------------------+------+-----------+-----------+

where <id> is a unique combination of numbers and letters such as 9d7e4e-0.

The controller can work with different models; models host applications such as Charmed Apache Kafka. Set up a specific model for Charmed Apache Kafka named tutorial:

juju add-model tutorial

Check the status of the model you created:

juju status
Output example
Model     Controller  Cloud/Region         Version  SLA          Timestamp
tutorial  overlord    localhost/localhost  3.6.13   unsupported  12:10:54Z

Model "admin/tutorial" is empty.