Public bug reported:
We've recently upgraded packages on one of our images from systemd
237-3ubuntu10.53 to 237-3ubuntu10.56 and are experiencing some
performance issues. A kernel upgrade also happened (4.15.0.192.177 ->
4.15.0.193.178) but I thought I'd check here first. Sorry if I'm raising
this in the wrong place!
Various operations are very slow:
* logging in via SSH
* ps auxf
* top
* systemctl
* + more
Weirdly, the issue seems to only happen on Amazon EC2 imported machines,
and not when running under ESXi, although this may be a red herring.
strace-ing ps shows a timeout reading from some kind of DBus socket:
recvmsg(6, {msg_name=NULL, msg_namelen=0,
msg_iov=[{iov_base="/org/freedesktop/DBus\0\0\0\2\1s\0\24\0\0\0"...,
iov_len=146}], msg_iovlen=1, msg_controllen=0, msg_flags=MSG_CMSG_CLOEXEC},
MSG_DONTWAIT|MSG_NOSIGNAL|MSG_CMSG_CLOEXEC) = 146
> /lib/x86_64-linux-gnu/libc-2.27.so(recvmsg+0x14) [0x122934]
> /lib/x86_64-linux-gnu/libnss_systemd.so.2(_nss_systemd_getpwnam_r+0xf257)
> [0x21df7]
> /lib/x86_64-linux-gnu/libnss_systemd.so.2() [0x10fd1]
> /lib/x86_64-linux-gnu/libnss_systemd.so.2(_nss_systemd_getpwuid_r+0x377)
> [0x12b27]
> /lib/x86_64-linux-gnu/libc-2.27.so(getpwuid_r+0x145) [0xe39e5]
> /lib/x86_64-linux-gnu/libc-2.27.so(getpwuid+0x98) [0xe3148]
> /lib/x86_64-linux-gnu/libprocps.so.6.0.0(pwcache_get_user+0x5c) [0x5bfc]
> /lib/x86_64-linux-gnu/libprocps.so.6.0.0(pwcache_get_user+0x1ebb) [0x7a5b]
> /lib/x86_64-linux-gnu/libprocps.so.6.0.0(readproc+0x149) [0x8659]
> /lib/x86_64-linux-gnu/libprocps.so.6.0.0(readproctab2+0x8a) [0x912a]
> /bin/ps(_init+0xe3b) [0xaef3]
> /lib/x86_64-linux-gnu/libc-2.27.so(__libc_start_main+0xe7) [0x21c87]
> /bin/ps(_init+0x1322) [0xb3da]
recvmsg(6, {msg_namelen=0}, MSG_DONTWAIT|MSG_NOSIGNAL|MSG_CMSG_CLOEXEC) = -1
EAGAIN (Resource temporarily unavailable)
> /lib/x86_64-linux-gnu/libc-2.27.so(recvmsg+0x14) [0x122934]
> /lib/x86_64-linux-gnu/libnss_systemd.so.2(_nss_systemd_getpwnam_r+0xf257)
> [0x21df7]
> /lib/x86_64-linux-gnu/libnss_systemd.so.2() [0x10fd1]
> /lib/x86_64-linux-gnu/libnss_systemd.so.2(_nss_systemd_getpwuid_r+0x377)
> [0x12b27]
> /lib/x86_64-linux-gnu/libc-2.27.so(getpwuid_r+0x145) [0xe39e5]
> /lib/x86_64-linux-gnu/libc-2.27.so(getpwuid+0x98) [0xe3148]
> /lib/x86_64-linux-gnu/libprocps.so.6.0.0(pwcache_get_user+0x5c) [0x5bfc]
> /lib/x86_64-linux-gnu/libprocps.so.6.0.0(pwcache_get_user+0x1ebb) [0x7a5b]
> /lib/x86_64-linux-gnu/libprocps.so.6.0.0(readproc+0x149) [0x8659]
> /lib/x86_64-linux-gnu/libprocps.so.6.0.0(readproctab2+0x8a) [0x912a]
> /bin/ps(_init+0xe3b) [0xaef3]
> /lib/x86_64-linux-gnu/libc-2.27.so(__libc_start_main+0xe7) [0x21c87]
> /bin/ps(_init+0x1322) [0xb3da]
ppoll([{fd=6, events=POLLIN}], 1, {tv_sec=24, tv_nsec=995725000}, NULL, 8) = 0
(Timeout) <----
> /lib/x86_64-linux-gnu/libc-2.27.so(ppoll+0x4a) [0x114c5a]
> /lib/x86_64-linux-gnu/libnss_systemd.so.2(_nss_systemd_getpwnam_r+0x1795f)
> [0x2a4ff]
> /lib/x86_64-linux-gnu/libnss_systemd.so.2() [0x1100a]
> /lib/x86_64-linux-gnu/libnss_systemd.so.2(_nss_systemd_getpwuid_r+0x377)
> [0x12b27]
> /lib/x86_64-linux-gnu/libc-2.27.so(getpwuid_r+0x145) [0xe39e5]
> /lib/x86_64-linux-gnu/libc-2.27.so(getpwuid+0x98) [0xe3148]
> /lib/x86_64-linux-gnu/libprocps.so.6.0.0(pwcache_get_user+0x5c) [0x5bfc]
> /lib/x86_64-linux-gnu/libprocps.so.6.0.0(pwcache_get_user+0x1ebb) [0x7a5b]
> /lib/x86_64-linux-gnu/libprocps.so.6.0.0(readproc+0x149) [0x8659]
> /lib/x86_64-linux-gnu/libprocps.so.6.0.0(readproctab2+0x8a) [0x912a]
> /bin/ps(_init+0xe3b) [0xaef3]
> /lib/x86_64-linux-gnu/libc-2.27.so(__libc_start_main+0xe7) [0x21c87]
> /bin/ps(_init+0x1322) [0xb3da]
LSB release output:
Description: Ubuntu 18.04.6 LTS
Release: 18.04
Unfortunately I'm unsure how to investigate this further.
** Affects: systemd (Ubuntu)
Importance: Undecided
Status: New
--
You received this bug notification because you are a member of Ubuntu
Touch seeded packages, which is subscribed to systemd in Ubuntu.
https://bugs.launchpad.net/bugs/1991235
Title:
systemd 237-3ubuntu10.56 times out on getpwuid
Status in systemd package in Ubuntu:
New
Bug description:
We've recently upgraded packages on one of our images from systemd
237-3ubuntu10.53 to 237-3ubuntu10.56 and are experiencing some
performance issues. A kernel upgrade also happened (4.15.0.192.177 ->
4.15.0.193.178) but I thought I'd check here first. Sorry if I'm
raising this in the wrong place!
Various operations are very slow:
* logging in via SSH
* ps auxf
* top
* systemctl
* + more
Weirdly, the issue seems to only happen on Amazon EC2 imported
machines, and not when running under ESXi, although this may be a red
herring.
strace-ing ps shows a timeout reading from some kind of DBus socket:
recvmsg(6, {msg_name=NULL, msg_namelen=0,
msg_iov=[{iov_base="/org/freedesktop/DBus\0\0\0\2\1s\0\24\0\0\0"...,
iov_len=146}], msg_iovlen=1, msg_controllen=0, msg_flags=MSG_CMSG_CLOEXEC},
MSG_DONTWAIT|MSG_NOSIGNAL|MSG_CMSG_CLOEXEC) = 146
> /lib/x86_64-linux-gnu/libc-2.27.so(recvmsg+0x14) [0x122934]
> /lib/x86_64-linux-gnu/libnss_systemd.so.2(_nss_systemd_getpwnam_r+0xf257)
[0x21df7]
> /lib/x86_64-linux-gnu/libnss_systemd.so.2() [0x10fd1]
> /lib/x86_64-linux-gnu/libnss_systemd.so.2(_nss_systemd_getpwuid_r+0x377)
[0x12b27]
> /lib/x86_64-linux-gnu/libc-2.27.so(getpwuid_r+0x145) [0xe39e5]
> /lib/x86_64-linux-gnu/libc-2.27.so(getpwuid+0x98) [0xe3148]
> /lib/x86_64-linux-gnu/libprocps.so.6.0.0(pwcache_get_user+0x5c) [0x5bfc]
> /lib/x86_64-linux-gnu/libprocps.so.6.0.0(pwcache_get_user+0x1ebb) [0x7a5b]
> /lib/x86_64-linux-gnu/libprocps.so.6.0.0(readproc+0x149) [0x8659]
> /lib/x86_64-linux-gnu/libprocps.so.6.0.0(readproctab2+0x8a) [0x912a]
> /bin/ps(_init+0xe3b) [0xaef3]
> /lib/x86_64-linux-gnu/libc-2.27.so(__libc_start_main+0xe7) [0x21c87]
> /bin/ps(_init+0x1322) [0xb3da]
recvmsg(6, {msg_namelen=0}, MSG_DONTWAIT|MSG_NOSIGNAL|MSG_CMSG_CLOEXEC) = -1
EAGAIN (Resource temporarily unavailable)
> /lib/x86_64-linux-gnu/libc-2.27.so(recvmsg+0x14) [0x122934]
> /lib/x86_64-linux-gnu/libnss_systemd.so.2(_nss_systemd_getpwnam_r+0xf257)
[0x21df7]
> /lib/x86_64-linux-gnu/libnss_systemd.so.2() [0x10fd1]
> /lib/x86_64-linux-gnu/libnss_systemd.so.2(_nss_systemd_getpwuid_r+0x377)
[0x12b27]
> /lib/x86_64-linux-gnu/libc-2.27.so(getpwuid_r+0x145) [0xe39e5]
> /lib/x86_64-linux-gnu/libc-2.27.so(getpwuid+0x98) [0xe3148]
> /lib/x86_64-linux-gnu/libprocps.so.6.0.0(pwcache_get_user+0x5c) [0x5bfc]
> /lib/x86_64-linux-gnu/libprocps.so.6.0.0(pwcache_get_user+0x1ebb) [0x7a5b]
> /lib/x86_64-linux-gnu/libprocps.so.6.0.0(readproc+0x149) [0x8659]
> /lib/x86_64-linux-gnu/libprocps.so.6.0.0(readproctab2+0x8a) [0x912a]
> /bin/ps(_init+0xe3b) [0xaef3]
> /lib/x86_64-linux-gnu/libc-2.27.so(__libc_start_main+0xe7) [0x21c87]
> /bin/ps(_init+0x1322) [0xb3da]
ppoll([{fd=6, events=POLLIN}], 1, {tv_sec=24, tv_nsec=995725000}, NULL, 8) =
0 (Timeout) <----
> /lib/x86_64-linux-gnu/libc-2.27.so(ppoll+0x4a) [0x114c5a]
> /lib/x86_64-linux-gnu/libnss_systemd.so.2(_nss_systemd_getpwnam_r+0x1795f)
[0x2a4ff]
> /lib/x86_64-linux-gnu/libnss_systemd.so.2() [0x1100a]
> /lib/x86_64-linux-gnu/libnss_systemd.so.2(_nss_systemd_getpwuid_r+0x377)
[0x12b27]
> /lib/x86_64-linux-gnu/libc-2.27.so(getpwuid_r+0x145) [0xe39e5]
> /lib/x86_64-linux-gnu/libc-2.27.so(getpwuid+0x98) [0xe3148]
> /lib/x86_64-linux-gnu/libprocps.so.6.0.0(pwcache_get_user+0x5c) [0x5bfc]
> /lib/x86_64-linux-gnu/libprocps.so.6.0.0(pwcache_get_user+0x1ebb) [0x7a5b]
> /lib/x86_64-linux-gnu/libprocps.so.6.0.0(readproc+0x149) [0x8659]
> /lib/x86_64-linux-gnu/libprocps.so.6.0.0(readproctab2+0x8a) [0x912a]
> /bin/ps(_init+0xe3b) [0xaef3]
> /lib/x86_64-linux-gnu/libc-2.27.so(__libc_start_main+0xe7) [0x21c87]
> /bin/ps(_init+0x1322) [0xb3da]
LSB release output:
Description: Ubuntu 18.04.6 LTS
Release: 18.04
Unfortunately I'm unsure how to investigate this further.
To manage notifications about this bug go to:
https://bugs.launchpad.net/ubuntu/+source/systemd/+bug/1991235/+subscriptions
--
Mailing list: https://launchpad.net/~touch-packages
Post to : touch-packages@lists.launchpad.net
Unsubscribe : https://launchpad.net/~touch-packages
More help : https://help.launchpad.net/ListHelp
