Bug#1079022: kmod: symbol lookup error: /usr/lib/dracut/dracut-install: undefined symbol: kmod_module_get_weakdeps, version LIBKMOD_5

[Ash Joubert]

Confirmed fixed for me in kmod/33+20240816-2. Thank you Marco! 🙏

Kind regards,

--
Ash Joubert (they/them) 
Director / Game Developer
Transient Software Limited 
New Zealand

Bug#1079022: kmod: symbol lookup error: /usr/lib/dracut/dracut-install: undefined symbol: kmod_module_get_weakdeps, version LIBKMOD_5

[Rodney Barnes]

This worked for me.  sudo apt install initramfs-tools=0.142  under kernel
6.10.3 to get 6.10.4 to work.

Thanks Bert!   Your a PC life saver.

Rodney Barnes

On Mon, 19 Aug 2024 23:54:10 +0200 Bert Karwatzki  wrote:
> I ran into the same problem today. Downgrading initramfs-tools to version
0.142
> worked as a workaround for me.
>
> Bert Karwatzki
>
>

Bug#1079022: kmod: symbol lookup error: /usr/lib/dracut/dracut-install: undefined symbol: kmod_module_get_weakdeps, version LIBKMOD_5

[Sedat Dilek]

Hi,

I followed solution #1:

> The quick and easy solution would be to rebuild dracut-install,
> but the release team refused to binNMU it (#1079038).

See [1].

Best regards,
-Sedat-

Link: https://bugs.debian.org/1079031#26 [1]

Bug#1079022: kmod: symbol lookup error: /usr/lib/dracut/dracut-install: undefined symbol: kmod_module_get_weakdeps, version LIBKMOD_5

[Johannes Schauer Marin Rodrigues]

Hi Marco,

Quoting Marco d'Itri (2024-08-19 23:48:24)
> The quick and easy solution would be to rebuild dracut-install, but the 
> release team refused to binNMU it (#1079038).
> 
> The stupid solution would be to revert the change, and I will not do it
> because I do not want to diverge from upstream.
> 
> The elegant solution would be to keep for a while both symbols in the 
> library, but I am not good enough with ld(1) and could not actually 
> manage to do it myself.
> 
> The nuclear solution would be to make a new upload with "Breaks: 
> dracut-install (<= 103-1)", which at least would make libkmod2 not 
> installable until somebody will be forced to do a new sourceful upload 
> of dracut-install.
> 
> So I will wait for a while to see if anybody can help with #3, and if not
> then I will proceed with #4.

given that this issue can render our user's systems unbootable, could we have a
quick-and-dirty solution now rather than the proper solution in a few days?

You could upload kmod with an ugly version like
33+20240816-2~really32+20240611-1 and the contents of the last-working version
of kmod and then take all the time you need to implement the correct solution.

Thanks!

cheers, josch

signature.asc
Description: signature

Bug#1079022: kmod: symbol lookup error: /usr/lib/dracut/dracut-install: undefined symbol: kmod_module_get_weakdeps, version LIBKMOD_5

[Bert Karwatzki]

I ran into the same problem today. Downgrading initramfs-tools to version 0.142
worked as a workaround for me.

Bert Karwatzki

Bug#1079022: kmod: symbol lookup error: /usr/lib/dracut/dracut-install: undefined symbol: kmod_module_get_weakdeps, version LIBKMOD_5

[Marco d'Itri]

The quick and easy solution would be to rebuild dracut-install, but the 
release team refused to binNMU it (#1079038).

The stupid solution would be to revert the change, and I will not do it 
because I do not want to diverge from upstream.

The elegant solution would be to keep for a while both symbols in the 
library, but I am not good enough with ld(1) and could not actually 
manage to do it myself.

The nuclear solution would be to make a new upload with "Breaks: 
dracut-install (<= 103-1)", which at least would make libkmod2 not 
installable until somebody will be forced to do a new sourceful upload 
of dracut-install.

So I will wait for a while to see if anybody can help with #3, and if 
not then I will proceed with #4.

-- 
ciao,
Marco


signature.asc
Description: PGP signature

Bug#1079022: kmod: symbol lookup error: /usr/lib/dracut/dracut-install: undefined symbol: kmod_module_get_weakdeps, version LIBKMOD_5

[Johannes Schauer Marin Rodrigues]

Hi,

On Mon, 19 Aug 2024 14:13:39 -0400 =?utf-8?Q?Antoine_Beaupr=C3=A9?= 
 wrote:
> So bizarrely, I installed an image from snapshot:
> 
> https://snapshot.debian.org/archive/debian/20240813
> 
> and *that* worked. So maybe `testing` doesn't work as an install target
> for that build script. Anyway.
> 
> So I confirm that kmod 32+20240611-1 doesn't have that issue, perhaps we
> should just upload that back to unstable until we figure out a fix? :)

we are building bootable system images for the MNT Reform open hardware laptop.
Since this is breaking our images and since this bug is still open, let me also
confirm here as well that using these two packages from snapshot.d.o prevents
the issue from happening:

wget 
http://snapshot.debian.org/archive/debian/20240612T203258Z/pool/main/k/kmod/libkmod2_32%2B20240611-1_arm64.deb
wget 
http://snapshot.debian.org/archive/debian/20240612T203258Z/pool/main/k/kmod/kmod_32%2B20240611-1_arm64.deb

Maybe this information (downgrading to the packages above) helps somebody who
is affected by this to make their system bootable again.

Thanks!

cheers, josch

signature.asc
Description: signature

Bug#1079022: kmod: symbol lookup error: /usr/lib/dracut/dracut-install: undefined symbol: kmod_module_get_weakdeps, version LIBKMOD_5

[Antoine Beaupré]

Control: fixed -1 32+20240611-1

On 2024-08-19 11:13:26, Antoine Beaupré wrote:
> On 2024-08-19 17:06:58, Christoph Anton Mitterer wrote:
>> On Mon, 2024-08-19 at 10:58 -0400, Antoine Beaupré wrote:
>>> To which version?
>>
>> Well I'd guess any earlier one. In my case I simply took the previous
>> one 32+20240611-1, which is still in testing.
>
> I tried to install a qemu image from testing, and that didn't work, so
> something else is happening there.

So bizarrely, I installed an image from snapshot:

https://snapshot.debian.org/archive/debian/20240813

and *that* worked. So maybe `testing` doesn't work as an install target
for that build script. Anyway.

So I confirm that kmod 32+20240611-1 doesn't have that issue, perhaps we
should just upload that back to unstable until we figure out a fix? :)

a.

-- 
Sous le projecteur, on ne voit pas les autres.
- Félix Leclerc

Bug#1079022: kmod: symbol lookup error: /usr/lib/dracut/dracut-install: undefined symbol: kmod_module_get_weakdeps, version LIBKMOD_5

[Antoine Beaupré]

On 2024-08-19 17:06:58, Christoph Anton Mitterer wrote:
> On Mon, 2024-08-19 at 10:58 -0400, Antoine Beaupré wrote:
>> To which version?
>
> Well I'd guess any earlier one. In my case I simply took the previous
> one 32+20240611-1, which is still in testing.

I tried to install a qemu image from testing, and that didn't work, so
something else is happening there.

-- 
Men are taught to apologize for their weaknesses, women for their
strengths.
- Lois Wyse

Bug#1079022: kmod: symbol lookup error: /usr/lib/dracut/dracut-install: undefined symbol: kmod_module_get_weakdeps, version LIBKMOD_5

[Christoph Anton Mitterer]

On Mon, 2024-08-19 at 10:58 -0400, Antoine Beaupré wrote:
> To which version?

Well I'd guess any earlier one. In my case I simply took the previous
one 32+20240611-1, which is still in testing.


Cheers,
Chris.

Bug#1079022: kmod: symbol lookup error: /usr/lib/dracut/dracut-install: undefined symbol: kmod_module_get_weakdeps, version LIBKMOD_5

[Antoine Beaupré]

On 2024-08-19 05:04:29, Christoph Anton Mitterer wrote:
> Downgrading fixes the issue.

To which version?

Bug#1079022: kmod: symbol lookup error: /usr/lib/dracut/dracut-install: undefined symbol: kmod_module_get_weakdeps, version LIBKMOD_5

[Antoine Beaupre]

Package: kmod
Followup-For: Bug #1079022

I can confirm this is still happening right now in sid. A simple way
to reproduce is with:

sudo sbuild-qemu-create -o /srv/sbuild/qemu/unstable-autopkgtest-amd64.img 
unstable https://deb.debian.org/debian
qemu-system-x86_64 -enable-kvm -object rng-random,filename=/dev/urandom,id=rng0 
-device virtio-rng-pci,rng=rng0,id=rng-device0 -device virtio-serial -nic 
user,model=virtio -m 1024 -smp 1 -nographic 
/srv/sbuild/qemu/unstable-autopkgtest-amd64.img

... and the image fails to boot when trying to mount the root
filesystem:

[1.492496] Run /init as init process
Loading, please wait...
Starting systemd-udevd version 256.5-1
[1.704989] input: VirtualPS/2 VMware VMMouse as 
/devices/platform/i8042/serio1/input/input3
[1.706840] input: VirtualPS/2 VMware VMMouse as 
/devices/platform/i8042/serio1/input/input2
Begin: Loading essential drivers ... done.
Begin: Running /scripts/init-premount ... done.
Begin: Mounting root file system ... Begin: Running /scripts/local-top ... done.
Begin: Running /scripts/local-premount ... done.
Begin: Waiting for root file system ... Begin: Running /scripts/local-block ... 
done.
Begin: Running /scripts/local-block ... done.
[... repeated for 30 seconds, once per second ...]
done.
Gave up waiting for root file system device.  Common problems:
 - Boot args (cat /proc/cmdline)
   - Check rootdelay= (did the system wait long enough?)
 - Missing modules (cat /proc/modules; ls /dev)
ALERT!  UUID=1469e8b3-537f-42e9-897b-cbd602cbf98c does not exist.  Dropping to 
a shell!


BusyBox v1.36.1 (Debian 1:1.36.1-9+b1) built-in shell (ash)
Enter 'help' for a list of built-in commands.

(initramfs) 


-- System Information:
Debian Release: 12.6
  APT prefers stable-security
  APT policy: (500, 'stable-security'), (500, 'stable-debug'), (500, 'stable'), 
(1, 'experimental'), (1, 'unstable'), (1, 'testing')
Architecture: amd64 (x86_64)

Kernel: Linux 6.9.7+bpo-amd64 (SMP w/16 CPU threads; PREEMPT)
Kernel taint flags: TAINT_WARN
Locale: LANG=fr_CA.UTF-8, LC_CTYPE=fr_CA.UTF-8 (charmap=UTF-8), LANGUAGE not set
Shell: /bin/sh linked to /usr/bin/dash
Init: systemd (via /run/systemd/system)
LSM: AppArmor: enabled

Versions of packages kmod depends on:
ii  libc6 2.36-9+deb12u7
ii  libkmod2  30+20221128-1
ii  liblzma5  5.4.1-0.2
ii  libssl3   3.0.13-1~deb12u1
ii  libzstd1  1.5.4+dfsg2-5

kmod recommends no packages.

kmod suggests no packages.

-- no debconf information

Bug#1079022: kmod: symbol lookup error: /usr/lib/dracut/dracut-install: undefined symbol: kmod_module_get_weakdeps, version LIBKMOD_5

[Diederik de Haas]

On Mon, 19 Aug 2024 11:41:59 +0200 Christoph Anton Mitterer 
 wrote:
> On Mon, 2024-08-19 at 05:12 +0200, Marco d'Itri wrote:
> > > With the new version, initramfs generation gives:
> > I know, the plan it to rebuild dracut-install.
> 
> Thanks. Then I guess from my side we could also already close the bug.
> Your choice :-)

Please don't. At least not yet so that people get warned about this bug before 
they try to reboot into an unbootable system.

signature.asc
Description: This is a digitally signed message part.

Bug#1079022: kmod: symbol lookup error: /usr/lib/dracut/dracut-install: undefined symbol: kmod_module_get_weakdeps, version LIBKMOD_5

[Christoph Anton Mitterer]

On Mon, 2024-08-19 at 11:59 +0200, Diederik de Haas wrote:
> Please don't. At least not yet so that people get warned about this
> bug before 
> they try to reboot into an unbootable system.

Ah, sure... I hadn't seen that the ticket was already raised to
critical... and last night when I've noticed it, it was too late to
check whether it actually causes a broken initrd or is just some noise.

So sure... leave it open then :-)

Bug#1079022: kmod: symbol lookup error: /usr/lib/dracut/dracut-install: undefined symbol: kmod_module_get_weakdeps, version LIBKMOD_5

[Diederik de Haas]

Control: affects -1 dracut initramfs-tools

On Mon, 19 Aug 2024 16:18:44 +1200 Ash Joubert  wrote:
> Control: severity -1 critical
> 
> This bug is critical because the dracut failure results in a nonbootable 
> initrd when followed by "apt-get install -f":
> 
> update-initramfs: Generating /boot/initrd.img-6.10.4-amd64
> /usr/lib/dracut/dracut-install: symbol lookup error: 
> /usr/lib/dracut/dracut-install: undefined symbol: 
> kmod_module_get_weakdeps, version LIBKMOD_5
> /usr/lib/dracut/dracut-install: symbol lookup error: 
> /usr/lib/dracut/dracut-install: undefined symbol: 
> kmod_module_get_weakdeps, version LIBKMOD_5
> /usr/lib/dracut/dracut-install: symbol lookup error: 
> /usr/lib/dracut/dracut-install: undefined symbol: 
> kmod_module_get_weakdeps, version LIBKMOD_5

I got the above error too, but I did my normal upgrade routine with just
``aptitude safe-upgrade``

Looks like I had a partial KDE (Frameworks) upgrade yesterday, so things look 
a bit 'funny', so the initial plan was to reboot immediately after today's 
upgrade ... when I saw the above error.

It was only after I saw https://bugs.debian.org/1079031 that I realized how 
serious it was:

```sh
root@bagend:~# ls -lh /boot/initrd.img-*
-rw-r--r-- 1 root root  33M Apr  4  2022 /boot/initrd.img-5.10.0-13-amd64
-rw-r--r-- 1 root root  37M Aug 13 01:45 /boot/initrd.img-6.10.3-amd64
-rw-r--r-- 1 root root 9.5M Aug 19 11:10 /boot/initrd.img-6.10.4-amd64
-rw-r--r-- 1 root root  35M Jun 14  2023 /boot/initrd.img-6.1.0-9-amd64
-rw-r--r-- 1 root root  37M Jul 26 00:52 /boot/initrd.img-6.9.10-amd64
```

So my original plan, reboot immediately, would've failed.

But the last dracut upgrade was from 2024-07-25, so that couldn't be it.
And that's when I noticed the kmod upgrade and found this bug.

```
aptitude install kmod/testing libkmod2/testing
```

Downgraded kmod and then my ``initrd.img-6.10.4-amd64`` was 37M again, so I'm 
pretty sure a reboot is NOW safe again.

signature.asc
Description: This is a digitally signed message part.

Bug#1079022: kmod: symbol lookup error: /usr/lib/dracut/dracut-install: undefined symbol: kmod_module_get_weakdeps, version LIBKMOD_5

[Christoph Anton Mitterer]

Hey Marco.

On Mon, 2024-08-19 at 05:12 +0200, Marco d'Itri wrote:
> > With the new version, initramfs generation gives:
> I know, the plan it to rebuild dracut-install.

Thanks. Then I guess from my side we could also already close the bug.
Your choice :-)


Cheers,
Chris.

Bug#1079022: kmod: symbol lookup error: /usr/lib/dracut/dracut-install: undefined symbol: kmod_module_get_weakdeps, version LIBKMOD_5

[Ash Joubert]

Control: severity -1 critical

This bug is critical because the dracut failure results in a nonbootable 
initrd when followed by "apt-get install -f":


update-initramfs: Generating /boot/initrd.img-6.10.4-amd64
/usr/lib/dracut/dracut-install: symbol lookup error: 
/usr/lib/dracut/dracut-install: undefined symbol: 
kmod_module_get_weakdeps, version LIBKMOD_5
/usr/lib/dracut/dracut-install: symbol lookup error: 
/usr/lib/dracut/dracut-install: undefined symbol: 
kmod_module_get_weakdeps, version LIBKMOD_5
/usr/lib/dracut/dracut-install: symbol lookup error: 
/usr/lib/dracut/dracut-install: undefined symbol: 
kmod_module_get_weakdeps, version LIBKMOD_5


Workaround was to boot from an older kernel/initrd, manually download 
the previous packages, downgrade to them, and then hold them.


dpkg -i kmod_32+20240611-1_amd64.deb libkmod-dev_32+20240611-1_amd64.deb 
libkmod2_32+20240611-1_amd64.deb


apt-mark hold kmod libkmod-dev libkmod2

Kind regards,

--
Ash Joubert (they/them) 
Director / Game Developer
Transient Software Limited 
New Zealand

Bug#1079022: kmod: symbol lookup error: /usr/lib/dracut/dracut-install: undefined symbol: kmod_module_get_weakdeps, version LIBKMOD_5

[Marco d'Itri]

On Aug 19, Christoph Anton Mitterer  wrote:

> With the new version, initramfs generation gives:
I know, the plan it to rebuild dracut-install.

-- 
ciao,
Marco


signature.asc
Description: PGP signature

Bug#1079022: kmod: symbol lookup error: /usr/lib/dracut/dracut-install: undefined symbol: kmod_module_get_weakdeps, version LIBKMOD_5

[Christoph Anton Mitterer]

Package: kmod
Version: 33+20240816-1
Severity: normal

Hey.

With the new version, initramfs generation gives:
Processing triggers for initramfs-tools (0.143.1) ...
update-initramfs: Generating /boot/initrd.img-6.10.4-amd64
/usr/lib/dracut/dracut-install: symbol lookup error: 
/usr/lib/dracut/dracut-install: undefined symbol: kmod_module_get_weakdeps, 
version LIBKMOD_5
/usr/lib/dracut/dracut-install: symbol lookup error: 
/usr/lib/dracut/dracut-install: undefined symbol: kmod_module_get_weakdeps, 
version LIBKMOD_5
/usr/lib/dracut/dracut-install: symbol lookup error: 
/usr/lib/dracut/dracut-install: undefined symbol: kmod_module_get_weakdeps, 
version LIBKMOD_5
Scanning processes...

Downgrading fixes the issue.

Cheers,
Chris.


-- System Information:
Debian Release: trixie/sid
  APT prefers unstable-debug
  APT policy: (500, 'unstable-debug'), (500, 'unstable')
Architecture: amd64 (x86_64)

Kernel: Linux 6.10.4-amd64 (SMP w/16 CPU threads; PREEMPT)
Locale: LANG=en_DE.UTF-8, LC_CTYPE=en_DE.UTF-8 (charmap=UTF-8), LANGUAGE not set
Shell: /bin/sh linked to /usr/bin/dash
Init: systemd (via /run/systemd/system)

Versions of packages kmod depends on:
ii  libc6   2.39-7
ii  libkmod233+20240816-1
ii  liblzma55.6.2-2
ii  libssl3t64  3.3.1-6
ii  libzstd11.5.6+dfsg-1

kmod recommends no packages.

kmod suggests no packages.

-- no debconf information