Install drivers

Inference snaps require certain drivers available on the host in order to function correctly. You must install these drivers before installing inference snaps to enable hardware detection and deployment of a matching engine.

In case you installed a driver after installing an inference snap, repeat the engine selection:

sudo <inference-snap> use-engine --auto

Install Intel GPU drivers

The user space drivers for Intel GPUs (integrated and discrete) are included in the snaps.

Lunar Lake and Battlemage GPUs may require a hardware enablement (HWE) kernel. Please refer here for details.

Install Intel NPU drivers

If your system has an Intel NPU and you want to make use of it, you need to install the user space driver for it. It is available as a snap:

sudo snap install intel-npu-driver

Install NVIDIA GPU drivers

You need a working CUDA setup on the host machine to use an NVIDIA GPU.

The version of the driver and utilities might be different depending on your setup. On Ubuntu Server 24.04, the following commands install the appropriate packages:

sudo apt update
sudo apt install nvidia-driver-550 nvidia-utils-550 nvidia-cuda-toolkit
sudo reboot