Configure inference snaps¶
Inference snaps expose a number of configurations. You can use the CLI to view these or set a new value for a configuration. The available configurations depend on the active engine.
View available configurations¶
Use the CLI tool’s get command to show all currently available configurations:
<inference-snap> get
Example:
user@host:~$ qwen-vl gethttp.host: 127.0.0.1
http.port: 8326
verbose: false
Get a configuration value¶
To get the current value of a configuration, pass the configuration key to the get command:
<inference-snap> get <key>
Example:
user@host:~$ qwen-vl get httphttp.base-path: v1
http.host: 127.0.0.1
http.port: 9999
user@host:~$ qwen-vl get http.port9999
Set a configuration value¶
You can change the value of a specific configuration using the set command.
This requires root permission.
sudo <inference-snap> set <key>=<new-value>
You’ll need to restart the server to apply the changes after setting a new configuration value.
sudo snap restart <inference-snap>
Example:
user@host:~$ sudo qwen-vl set http.port=9090user@host:~$ sudo snap restart qwen-vlRestarted.