lxd not working with zfs 2.3.0

[rusher97]

• Distribution: Ubuntu
• Distribution version: 22.04
  • Kernel version: 6.8.0-50
  • LXC version: 6.2
  • LXD version: 6.2
  • Storage backend in use: zfs 2.3.0

Issue description

lxc error: required tool zpool is missing
(zfs 2.3 comes with libzfs6 and libzpool6, zfs 2.2 comes with libzfs5 and libzpool5)

Steps to reproduce

1. upgrade from zfs 2.2.7 to 2.3.0-rc4
2. lxc start --all
3. lxc error: required tool zpool is missing

[tomponline]

Is this using the LXD snap package? What does snap list show?

[tomponline]

We need to add support ZFS 2.3 in the snap, like this:

https://github.com/canonical/lxd-pkg-snap/blob/latest-candidate/snapcraft.yaml#L1227-L1260

[simondeziel]

• Distribution: Ubuntu

  • Distribution version: 22.04

    • Kernel version: 6.8.0-50
    • LXC version: 6.2
    • LXD version: 6.2
    • Storage backend in use: zfs 2.3.0

This ZFS version isn't shipped in any official kernel I could find. Are you by any chance running with a DKMS built one?
If you are indeed using DKMS to get a bleeding edge version of ZFS, you might be interested in using the zfs/zpool tools from the host rather than those bundled in the snap.

To do that:

sudo snap set lxd zfs.external=true
sudo systemctl restart snap.lxd.daemon.service

[rusher97]

Yes i use the lxd snap latest/stable. (6.2-afb00d0)
Indeed i build zfs from source and install it with dkms, so i can use the zfs version i want.
I will try to use zfs.external=true for now, thanks.

[Qubitium]

@rusher97 Another hackish way to do this is modifying META file in zfs rc4 direction and change version from 2.3.0 to 2.2.99 to fool lxd. Recompile and install. =)

[simondeziel]

@Qubitium as we are in hackish territory, another simpler way to fool LXD into using the 2.2 tooling when meeting a 2.3 module is probably this:

echo 2.2.99 > fake-zfs-version
sudo mount -o ro,bind fake-zfs-version /sys/module/zfs/version
sudo systemctl restart snap.lxd.daemon.service