Create a minimal Kubernetes charm¶
From Zero to Hero: Write your first Kubernetes charm > Create a minimal Kubernetes charm
See previous: Set up your development environment
As you already know from your knowledge of Juju, when you deploy a Kubernetes charm, the following things happen:
The Juju controller provisions a pod with at least two containers, one for the Juju unit agent and the charm itself and one container for each application workload container that is specified in the
containers
field of a file in the charm that is calledcharmcraft.yaml
.The same Juju controller injects Pebble – a lightweight, API-driven process supervisor – into each workload container and overrides the container entrypoint so that Pebble starts when the container is ready.
When the Kubernetes API reports that a workload container is ready, the Juju controller informs the charm that the instance of Pebble in that container is ready. At that point, the charm knows that it can start communicating with Pebble.
Typically, at this point the charm will make calls to Pebble so that Pebble can configure and start the workload and begin operations.
Note: In the past, the containers were specified in a
metadata.yaml
file, but the modern practice is that all charm specification is in a singlecharmcraft.yaml
file.
All subsequent workload management happens in the same way – the Juju controller sends events to the charm and the charm responds to these events by managing the workload application in various ways via Pebble. The picture below illustrates all of this for a simple case where there is just one workload container.
As a charm developer, your first job is to use this knowledge to create the basic structure and content for your charm:
descriptive files (e.g., YAML configuration files like the
charmcraft.yaml
file mentioned above) that give Juju, Python, or Charmcraft various bits of information about your charm, andexecutable files (like the
src/charm.py
file that we will see shortly) where you will use Ops-enriched Python to write all the logic of your charm.
Set the basic information, requirements, and workload for your charm¶
Create a file called charmcraft.yaml
. This is a file that describes metadata such as the charm name, purpose, environment constraints, workload containers, etc., in short, all the information that tells Juju what it can do with your charm.
In this file, do all of the following:
First, add basic information about your charm:
name: demo-api-charm
title: |
demo-fastapi-k8s
description: |
This is a demo charm built on top of a small Python FastAPI server.
This charm can be integrated with the PostgreSQL charm and COS Lite bundle (Canonical Observability Stack).
summary: |
FastAPI Demo charm for Kubernetes
Second, add a constraint assuming a Juju version with the required features and a Kubernetes-type cloud:
assumes:
- juju >= 3.1
- k8s-api
Third, describe the workload container, as below. Below, demo-server
is the name of the container, and demo-server-image
is the name of its OCI image.
containers:
demo-server:
resource: demo-server-image
Fourth, describe the workload container resources, as below. The name of the resource below, demo-server-image
, is the one you defined above.
resources:
# An OCI image resource for each container listed above.
# You may remove this if your charm will run without a workload sidecar container.
demo-server-image:
type: oci-image
description: OCI image from GitHub Container Repository
# The upstream-source field is ignored by Juju. It is included here as a reference
# so the integration testing suite knows which image to deploy during testing. This field
# is also used by the 'canonical/charming-actions' Github action for automated releasing.
upstream-source: ghcr.io/canonical/api_demo_server:1.0.1
Define the charm initialisation and application services¶
Create a file called requirements.txt
. This is a file that describes all the required external Python dependencies that will be used by your charm.
In this file, declare the ops
dependency, as below. At this point you’re ready to start using constructs from the Ops library.
ops >= 2.11
Create a file called src/charm.py
. This is the file that you will use to write all the Python code that you want your charm to execute in response to events it receives from the Juju controller.
This file needs to be executable. One way you can do this is:
chmod a+x src/charm.py
In this file, do all of the following:
First, add a shebang to ensure that the file is directly executable. Then, import the ops
package to access theCharmBase
class and the main
function. Next, use CharmBase
to create a charm class FastAPIDemoCharm
and then invoke this class in the main
function of Ops. As you can see, a charm is a pure Python class that inherits from the CharmBase class of Ops and which we pass to the main
function defined in the ops.main
module.
#!/usr/bin/env python3
import ops
class FastAPIDemoCharm(ops.CharmBase):
"""Charm the service."""
def __init__(self, framework: ops.Framework) -> None:
super().__init__(framework)
if __name__ == "__main__": # pragma: nocover
ops.main(FastAPIDemoCharm)
Now, in the __init__
function of your charm class, use Ops constructs to add an observer for when the Juju controller informs the charm that the Pebble in its workload container is up and running, as below. As you can see, the observer is a function that takes as an argument an event and an event handler. The event name is created automatically by Ops for each container on the template <container>-pebble-ready
. The event handler is a method in your charm class that will be executed when the event is fired; in this case, you will use it to tell Pebble how to start your application.
framework.observe(self.on.demo_server_pebble_ready, self._on_demo_server_pebble_ready)
Important
Generally speaking: A charm class is a collection of event handling methods. When you want to install, remove, upgrade, configure, etc., an application, Juju sends information to your charm. Ops translates this information into events and your job is to write event handlers
Tip
Pro tip: Use __init__
to hold references (pointers) to other Object
s or immutable state only. That is because a charm is reinitialised on every event.
Next, define the event handler, as follows:
We’ll use the ActiveStatus
class to set the charm status to active. Note that almost everything you need to define your charm is in the ops
package that you imported earlier - there’s no need to add additional imports.
Use ActiveStatus
as well as further Ops constructs to define the event handler, as below. As you can see, what is happening is that, from the event
argument, you extract the workload container object in which you add a custom layer. Once the layer is set you replan your service and set the charm status to active.
def _on_demo_server_pebble_ready(self, event: ops.PebbleReadyEvent) -> None:
"""Define and start a workload using the Pebble API.
Change this example to suit your needs. You'll need to specify the right entrypoint and
environment configuration for your specific workload.
Learn more about interacting with Pebble at at https://juju.is/docs/sdk/pebble
Learn more about Pebble layers at
https://documentation.ubuntu.com/pebble/how-to/use-layers/
"""
# Get a reference the container attribute on the PebbleReadyEvent
container = event.workload
# Add initial Pebble config layer using the Pebble API
container.add_layer("fastapi_demo", self._pebble_layer, combine=True)
# Make Pebble reevaluate its plan, ensuring any services are started if enabled.
container.replan()
# Learn more about statuses in the SDK docs:
# https://juju.is/docs/sdk/status
self.unit.status = ops.ActiveStatus()
The custom Pebble layer that you just added is defined in the self._pebble_layer
property. Update this property to match your application, as follows:
In the __init__
method of your charm class, name your service to fastapi-service
and add it as a class attribute :
self.pebble_service_name = "fastapi-service"
Finally, define the pebble_layer
function as below. The command
variable represents a command line that should be executed in order to start our application.
@property
def _pebble_layer(self) -> ops.pebble.Layer:
"""A Pebble layer for the FastAPI demo services."""
command = ' '.join(
[
'uvicorn',
'api_demo_server.app:app',
'--host=0.0.0.0',
'--port=8000',
]
)
pebble_layer: ops.pebble.LayerDict = {
'summary': 'FastAPI demo service',
'description': 'pebble config layer for FastAPI demo server',
'services': {
self.pebble_service_name: {
'override': 'replace',
'summary': 'fastapi demo',
'command': command,
'startup': 'enabled',
}
},
}
return ops.pebble.Layer(pebble_layer)
Add logger functionality¶
In the src/charm.py
file, in the imports section, import the Python logging
module and define a logger object, as below. This will allow you to read log data in juju
.
import logging
# Log messages can be retrieved using juju debug-log
logger = logging.getLogger(__name__)
Tell Charmcraft how to build your charm¶
In the same charmcraft.yaml
file you created earlier, you need to describe all the information needed for Charmcraft to be able to pack your charm. In this file, do the following:
First, add the block below. This will identify your charm as a charm (as opposed to something else you might know from using Juju, namely, a bundle).
type: charm
Also add the block below. This declares that your charm will build and run charm on Ubuntu 22.04.
bases:
- build-on:
- name: ubuntu
channel: "22.04"
run-on:
- name: ubuntu
channel: "22.04"
Aaaand that’s it! Time to validate your charm!
Tip
Once you’ve mastered the basics, you can speed things up by navigating to your empty charm project directory and running charmcraft init --profile kubernetes
. This will create all the files above and more, along with helpful descriptor keys and code scaffolding.
Validate your charm¶
First, ensure that you are inside the Multipass Ubuntu VM, in the ~/fastapi-demo
folder:
multipass shell charm-dev
cd ~/fastapi-demo
Now, pack your charm project directory into a .charm
file, as below. This will produce a .charm
file. In our case it was named demo-api-charm_ubuntu-22.04-amd64.charm
; yours should be named similarly, though the name might vary slightly depending on your architecture.
charmcraft pack
# Packed demo-api-charm_ubuntu-22.04-amd64.charm
Important
If packing failed - perhaps you forgot to make the charm.py executable earlier - you may need to run charmcraft clean
before re-running charmcraft pack
. charmcraft
will generally detect when files have changed, but will miss only file attributes changing.
Important
Did you know? A .charm
file is really just a zip file of your charm files and code dependencies that makes it more convenient to share, publish, and retrieve your charm contents.
Deploy the .charm
file, as below. Juju will create a Kubernetes StatefulSet
named after your application with one replica.
juju deploy ./demo-api-charm_ubuntu-22.04-amd64.charm --resource \
demo-server-image=ghcr.io/canonical/api_demo_server:1.0.1
Important
If you’ve never deployed a local charm (i.e., a charm from a location on your machine) before:
As you may know, when you deploy a charm from Charmhub it is sufficient to run juju deploy <charm name>
. However, to deploy a local charm you need to explicitly define a --resource
parameter with the same resource name and resource upstream source as in the charmcraft.yaml
.
Monitor your deployment:
juju status --watch 1s
When all units are settled down, you should see the output below, where 10.152.183.215
is the IP of the K8s Service and 10.1.157.73
is the IP of the pod.
Model Controller Cloud/Region Version SLA Timestamp
welcome-k8s tutorial-controller microk8s/localhost 3.0.0 unsupported 13:38:19+01:00
App Version Status Scale Charm Channel Rev Address Exposed Message
demo-api-charm active 1 demo-api-charm 1 10.152.183.215 no
Unit Workload Agent Address Ports Message
demo-api-charm/0* active idle 10.1.157.73
Now, validate that the app is running and reachable by sending an HTTP request as below, where 10.1.157.73
is the IP of our pod and 8000
is the default application port.
curl 10.1.157.73:8000/version
You should see a JSON string with the version of the application:
{"version":"1.0.0"}
Expand if you wish to inspect your deployment further
Run:
kubectl get namespaces
You should see that Juju has created a namespace called welcome-k8s
.
Try:
kubectl -n welcome-k8s get pods
You should see that your application has been deployed in a pod that has 2 containers running in it, one for the charm and one for the application. The containers talk to each other via the Pebble API using the UNIX socket.
NAME READY STATUS RESTARTS AGE
modeloperator-5df6588d89-ghxtz 1/1 Running 3 (7d2h ago) 13d
demo-api-charm-0 2/2 Running 0 7d2h
Check also:
kubectl -n welcome-k8s describe pod demo-api-charm-0
In the output you should see the definition for both containers. You’ll be able to verify that the default command and arguments for our application container (demo-server
) have been displaced by the Pebble service. You should be able to verify the same for the charm container (charm
).
Congratulations, you’ve successfully created a minimal Kubernetes charm!
Write unit tests for your charm¶
When you’re writing a charm, you will want to ensure that it will behave as intended.
For example, you’ll want to check that the various components – relation data, Pebble services, or configuration files – all behave as expected in response to an event.
You can ensure all this by writing a rich battery of unit tests. In the context of a charm, we recommended using pytest
(unittest
can also be used) with ops.testing (was: Scenario), the framework for state-transition testing in Ops.
We’ll also use the Python testing tool tox
to automate our testing and set up our testing environment.
In this section we’ll write a test to check that Pebble is configured as expected.
Prepare your test environment¶
Create a file called tox.ini
in your project root directory and add the following configuration:
[tox]
no_package = True
skip_missing_interpreters = True
min_version = 4.0.0
env_list = unit
[vars]
src_path = {tox_root}/src
tests_path = {tox_root}/tests
[testenv]
set_env =
PYTHONPATH = {tox_root}/lib:{[vars]src_path}
PYTHONBREAKPOINT=pdb.set_trace
PY_COLORS=1
pass_env =
PYTHONPATH
CHARM_BUILD_DIR
MODEL_SETTINGS
[testenv:unit]
description = Run unit tests
deps =
pytest
cosl
coverage[toml]
ops[testing]
-r {tox_root}/requirements.txt
commands =
coverage run --source={[vars]src_path} \
-m pytest \
--tb native \
-v \
-s \
{posargs} \
{[vars]tests_path}/unit
coverage report
Read more:
tox.ini
If you used charmcraft init --profile kubernetes
at the beginning of your project, you will already have the tox.ini
file.
Prepare your test directory¶
In your project root directory, create directory for the unit test:
mkdir -p tests/unit
Write a test¶
In your tests/unit
directory, create a new file called test_charm.py
and add the test below. This test will check the behaviour of the _on_demo_server_pebble_ready
function that you set up earlier. The test will first set up a context, then define the input state, run the action, and check whether the results match the expected values.
import ops
from ops import testing
from charm import FastAPIDemoCharm
def test_pebble_layer():
ctx = testing.Context(FastAPIDemoCharm)
container = testing.Container(name="demo-server", can_connect=True)
state_in = testing.State(
containers={container},
leader=True,
)
state_out = ctx.run(ctx.on.pebble_ready(container), state_in)
# Expected plan after Pebble ready with default config
expected_plan = {
"services": {
"fastapi-service": {
"override": "replace",
"summary": "fastapi demo",
"command": "uvicorn api_demo_server.app:app --host=0.0.0.0 --port=8000",
"startup": "enabled",
# Since the environment is empty, Layer.to_dict() will not
# include it.
}
}
}
# Check that we have the plan we expected:
assert state_out.get_container(container.name).plan == expected_plan
# Check the unit status is active
assert state_out.unit_status == testing.ActiveStatus()
# Check the service was started:
assert state_out.get_container(container.name).service_statuses["fastapi-service"] == ops.pebble.ServiceStatus.ACTIVE
Run the test¶
In your Multipass Ubuntu VM shell, run your test:
ubuntu@charm-dev:~/fastapi-demo$ tox -e unit
The result should be similar to the following output:
unit: install_deps> python -I -m pip install 'coverage[toml]' 'ops[testing]' pytest -r /home/ubuntu/juju-sdk-tutorial-k8s/requirements.txt
unit: commands[0]> coverage run --source=/home/ubuntu/juju-sdk-tutorial-k8s/src -m pytest --tb native -v -s /home/ubuntu/juju-sdk-tutorial-k8s/tests/unit
=================================================================== test session starts ===================================================================
platform linux -- Python 3.13.2, pytest-8.3.5, pluggy-1.5.0 -- /home/ubuntu/juju-sdk-tutorial-k8s/.tox/unit/bin/python
cachedir: .tox/unit/.pytest_cache
rootdir: /home/ubuntu/juju-sdk-tutorial-k8s
configfile: pyproject.toml
collected 1 item
tests/unit/test_charm.py::test_pebble_layer PASSED
==================================================================== 1 passed in 0.11s ====================================================================
unit: commands[1]> coverage report
Name Stmts Miss Branch BrPart Cover Missing
----------------------------------------------------------
src/charm.py 18 0 0 0 100%
----------------------------------------------------------
TOTAL 18 0 0 0 100%
unit: OK (2.12=setup[1.82]+cmd[0.26,0.04] seconds)
congratulations :) (2.14 seconds)
Congratulations, you have written your first unit test!
Write integration tests for your charm¶
A charm should function correctly not just in a mocked environment, but also in a real deployment.
For example, it should be able to pack, deploy, and integrate without throwing exceptions or getting stuck in a waiting
or a blocked
status – that is, it should correctly reach a status of active
or idle
.
You can ensure this by writing integration tests for your charm. In the charming world, these are usually written with the pytest-operator
library.
In this section we’ll write a small integration test to check that the charm packs and deploys correctly.
Prepare your test environment¶
In your tox.ini
file, add the following new environment:
[testenv:integration]
description = Run integration tests
deps =
pytest
juju
pytest-operator
-r {tox_root}/requirements.txt
commands =
pytest -v \
-s \
--tb native \
--log-cli-level=INFO \
{posargs} \
{[vars]tests_path}/integration
If you used charmcraft init --profile kubernetes
at the beginning of your project, the testenv:integration
section is already in the tox.ini
file.
Prepare your test directory¶
In your project root directory, create a directory for the integration test:
mkdir -p tests/integration
Write and run a pack-and-deploy integration test¶
Let’s begin with the simplest possible integration test, a smoke test. This test will build and deploy the charm, then verify that the installation event is handled without errors.
In your tests/integration
directory, create a file called test_charm.py
and add the following test:
import asyncio
import logging
from pathlib import Path
import pytest
import yaml
from pytest_operator.plugin import OpsTest
logger = logging.getLogger(__name__)
METADATA = yaml.safe_load(Path("./charmcraft.yaml").read_text())
APP_NAME = METADATA["name"]
@pytest.mark.abort_on_fail
async def test_build_and_deploy(ops_test: OpsTest):
"""Build the charm-under-test and deploy it together with related charms.
Assert on the unit status before any relations/configurations take place.
"""
# Build and deploy charm from local source folder
charm = await ops_test.build_charm(".")
resources = {
"demo-server-image": METADATA["resources"]["demo-server-image"]["upstream-source"]
}
await asyncio.gather(
ops_test.model.deploy(charm, resources=resources, application_name=APP_NAME),
ops_test.model.wait_for_idle(
apps=[APP_NAME], status="active", raise_on_blocked=False, timeout=300
),
)
In your Multipass Ubuntu VM, run the test:
tox -e integration
The test takes some time to run as the pytest-operator
running in the background will add a new model to an existing cluster (whose presence it assumes). If successful, it’ll verify that your charm can pack and deploy as expected.
The result should be similar to the following output:
integration: commands[0]> pytest -v -s --tb native --log-cli-level=INFO /home/ubuntu/juju-sdk-tutorial-k8s/tests/integration
=================================================================== test session starts ===================================================================
platform linux -- Python 3.13.2, pytest-8.3.5, pluggy-1.5.0 -- /home/ubuntu/juju-sdk-tutorial-k8s/.tox/integration/bin/python
cachedir: .tox/integration/.pytest_cache
rootdir: /home/ubuntu/juju-sdk-tutorial-k8s
configfile: pyproject.toml
plugins: operator-0.41.0, asyncio-0.21.2
asyncio: mode=Mode.STRICT
collected 1 item
tests/integration/test_charm.py::test_build_and_deploy
--------------------------------------------------------------------- live log setup ----------------------------------------------------------------------
INFO pytest_operator.plugin:plugin.py:753 Adding model microk8s:test-charm-7zn0 on cloud microk8s
WARNING juju.client.connection:connection.py:858 unexpected facade SSHServer received from the controller
---------------------------------------------------------------------- live log call ----------------------------------------------------------------------
INFO pytest_operator.plugin:plugin.py:612 Using tmp_path: /home/ubuntu/juju-sdk-tutorial-k8s/.tox/integration/tmp/pytest/test-charm-7zn00
INFO pytest_operator.plugin:plugin.py:1199 Building charm demo-api-charm
INFO pytest_operator.plugin:plugin.py:1204 Built charm demo-api-charm in 11.60s
INFO juju.model:__init__.py:3254 Waiting for model:
demo-api-charm (missing)
INFO juju.model:__init__.py:2301 Deploying local:demo-api-charm-0
INFO juju.model:__init__.py:3254 Waiting for model:
demo-api-charm/0 [idle] active:
PASSED
-------------------------------------------------------------------- live log teardown --------------------------------------------------------------------
INFO pytest_operator.plugin:plugin.py:937 Model status:
Model Controller Cloud/Region Version SLA Timestamp
test-charm-7zn0 microk8s microk8s/localhost 3.6.4 unsupported 12:07:36+08:00
App Version Status Scale Charm Channel Rev Address Exposed Message
demo-api-charm active 1 demo-api-charm 0 10.152.183.60 no
Unit Workload Agent Address Ports Message
demo-api-charm/0* active idle 10.1.226.162
INFO pytest_operator.plugin:plugin.py:943 Juju error logs:
INFO pytest_operator.plugin:plugin.py:1049 Resetting model test-charm-7zn0...
INFO pytest_operator.plugin:plugin.py:1038 Destroying applications demo-api-charm
INFO pytest_operator.plugin:plugin.py:1054 Not waiting on reset to complete.
INFO pytest_operator.plugin:plugin.py:1025 Forgetting model main...
=================================================================== 1 passed in 49.30s ====================================================================
integration: OK (49.69=setup[0.02]+cmd[49.67] seconds)
congratulations :) (49.71 seconds)
Review the final code¶
For the full code see: 01_create_minimal_charm
For a comparative view of the code before and after our edits see: Comparison
See next: Make your charm configurable