Public bug reported:
Hello.
I use unprivileged LXC containers with running systemd, systemd-journald,
apache and nginx on it.
Each lxc config have memory limits (lxc.cgroup.memory.limit_in_bytes) and this
scheme stable work long time.
After I add MemoryLimit to apache service file sometime the kernel crashes with
unix_gc RIP.
For simulate situation I running script "membomb.py" using service file
"membomb.service" (with included MemoryLimit) on each container and the
kernel stable crashes.
I try update the kernel from 4.4.0-77 to 4.4.0-89 and change server
(from IBM to Supermicro), stack trace changed but problem still exist.
[ 2477.309371] BUG: unable to handle kernel NULL pointer dereference at
0000000000000018
[ 2477.310336] IP: [<ffffffff817def24>] unix_gc+0xc4/0x3a0
[ 2477.311236] PGD 0
[ 2477.312104] Oops: 0000 [#1] SMP
[ 2477.312952] Modules linked in: ebt_arpreply ebt_arp ebtable_nat ebtables
veth nfnetlink_queue nfnetlink_log nfnetlink bluetooth netconsole configfs
ip6table_filter ip6_tables ipt_MASQUERADE nf_nat_masquerade_ipv4 xt_nat
xt_tcpudp iptable_nat nf_nat_ipv4 nf_nat ipt_REJECT nf_reject_ipv4
nf_conntrack_ipv4 nf_defrag_
ipv4 xt_multiport xt_conntrack iptable_filter ip_tables x_tables bridge
ipmi_ssif intel_rapl x86_pkg_temp_thermal coretemp kvm_intel kvm irqbypass
crct10dif_pclmul crc32_pclmul ghash_clmulni_intel aesni_intel aes_x86_64 8021q
lrw garp gf128mul mrp glue_helper stp ablk_helper llc cryptd joydev input_leds
sb_edac edac_
core mei_me mei lpc_ich shpchp ioatdma ipmi_si 8250_fintek ipmi_msghandler
acpi_power_meter mac_hid binfmt_misc nf_conntrack_ftp nf_conntrack autofs4 xfs
btrfs raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx
xor raid6_pq libcrc32c raid1 raid0 multipath linear ast ttm drm_kms_helper
hid_gener
ic igb syscopyarea sysfillrect usbhid sysimgblt dca fb_sys_fops ptp drm hid
ahci pps_core libahci i2c_algo_bit wmi fjes
[ 2477.321346] CPU: 1 PID: 2264 Comm: systemd-cgroups Not tainted
4.4.0-89-generic #112-Ubuntu
[ 2477.322281] Hardware name: Supermicro Super Server/X10DRW-i, BIOS 2.0
12/17/2015
[ 2477.323211] task: ffff880873b7aa00 ti: ffff8808239e8000 task.ti:
ffff8808239e8000
[ 2477.324143] RIP: 0010:[<ffffffff817def24>] [<ffffffff817def24>]
unix_gc+0xc4/0x3a0
[ 2477.325078] RSP: 0018:ffff8808239ebd58 EFLAGS: 00010287
[ 2477.326000] RAX: ffff88167eb09ff8 RBX: ffff8808239ebd68 RCX: 0000000000000000
[ 2477.326926] RDX: ffff88167eb0a328 RSI: ffff88167eb08ff8 RDI: ffff88167eb0f400
[ 2477.327852] RBP: ffff8808239ebdb0 R08: 0000000000000002 R09: 0000000000000000
[ 2477.328777] R10: ffff880860f096b0 R11: ffff88086c08c710 R12: ffff88080b51b0a8
[ 2477.329698] R13: 0000000000000001 R14: ffff88080b51b080 R15: ffff88080b519400
[ 2477.330617] FS: 00007f9239bc4840(0000) GS:ffff88103fc40000(0000)
knlGS:0000000000000000
[ 2477.331551] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[ 2477.332485] CR2: 0000000000000018 CR3: 000000082cadd000 CR4: 00000000001406e0
[ 2477.333429] Stack:
[ 2477.334365] 0000000000000000 0000000000000246 ffff8808239ebd68
ffff8808239ebd68
[ 2477.335331] 0000000000000202 0000000000000202 ffff8808239ebdb0
ddb43b7044268f20
[ 2477.336294] ffff88080b51b000 ffff88080b51b0a8 0000000000000001
ffff8808239ebe10
[ 2477.337262] Call Trace:
[ 2477.338220] [<ffffffff817dc882>] unix_release_sock+0x1c2/0x2f0
[ 2477.339187] [<ffffffff817dc9d0>] unix_release+0x20/0x30
[ 2477.340152] [<ffffffff8171857f>] sock_release+0x1f/0x80
[ 2477.341112] [<ffffffff817185f2>] sock_close+0x12/0x20
[ 2477.342069] [<ffffffff81211284>] __fput+0xe4/0x220
[ 2477.343005] [<ffffffff812113fe>] ____fput+0xe/0x10
[ 2477.343918] [<ffffffff8109f0d1>] task_work_run+0x81/0xa0
[ 2477.344824] [<ffffffff81003242>] exit_to_usermode_loop+0xc2/0xd0
[ 2477.345729] [<ffffffff81003c6e>] syscall_return_slowpath+0x4e/0x60
[ 2477.346631] [<ffffffff81842090>] int_ret_from_sys_call+0x25/0x8f
[ 2477.347512] Code: 74 51 48 8b b0 30 03 00 00 48 8d 90 30 03 00 00 48 81 ee
30 03 00 00 48 81 fa a0 0d f0 81 0f 84 af 00 00 00 48 8b 88 48 02 00 00 <48> 8b
49 18 4c 8b 41 38 48 8b 88 40 03 00 00 48 85 c9 0f 8e 8e
[ 2477.349382] RIP [<ffffffff817def24>] unix_gc+0xc4/0x3a0
[ 2477.350254] RSP <ffff8808239ebd58>
[ 2477.351107] CR2: 0000000000000018
[ 2477.355696] ---[ end trace 5c1dd6254f090648 ]---
ProblemType: Bug
DistroRelease: Ubuntu 16.04
Package: linux-image-4.4.0-89-generic 4.4.0-89.112
ProcVersionSignature: Ubuntu 4.4.0-89.112-generic 4.4.76
Uname: Linux 4.4.0-89-generic x86_64
AlsaDevices:
total 0
crw-rw---- 1 root audio 116, 1 Aug 9 13:09 seq
crw-rw---- 1 root audio 116, 33 Aug 9 13:09 timer
AplayDevices: Error: [Errno 2] No such file or directory: 'aplay'
ApportVersion: 2.20.1-0ubuntu2.10
Architecture: amd64
ArecordDevices: Error: [Errno 2] No such file or directory: 'arecord'
AudioDevicesInUse: Error: command ['fuser', '-v', '/dev/snd/seq',
'/dev/snd/timer'] failed with exit code 1:
Date: Wed Aug 9 13:10:47 2017
HibernationDevice: RESUME=/dev/mapper/vg_system-swap
IwConfig: Error: [Errno 2] No such file or directory: 'iwconfig'
MachineType: Supermicro Super Server
PciMultimedia:
ProcEnviron:
TERM=xterm-256color
PATH=(custom, no user)
LANG=en_US.UTF-8
SHELL=/bin/bash
ProcFB: 0 astdrmfb
ProcKernelCmdLine: BOOT_IMAGE=/vmlinuz-4.4.0-89-generic
root=/dev/mapper/vg_system-lv_root ro noquiet nosplash net.ifnames=0
biosdevname=0
RelatedPackageVersions:
linux-restricted-modules-4.4.0-89-generic N/A
linux-backports-modules-4.4.0-89-generic N/A
linux-firmware 1.157.11
RfKill: Error: [Errno 2] No such file or directory: 'rfkill'
SourcePackage: linux
UpgradeStatus: No upgrade log present (probably fresh install)
dmi.bios.date: 12/17/2015
dmi.bios.vendor: American Megatrends Inc.
dmi.bios.version: 2.0
dmi.board.asset.tag: Default string
dmi.board.name: X10DRW-i
dmi.board.vendor: Supermicro
dmi.board.version: 1.02
dmi.chassis.asset.tag: Default string
dmi.chassis.type: 17
dmi.chassis.vendor: Supermicro
dmi.chassis.version: 0123456789
dmi.modalias:
dmi:bvnAmericanMegatrendsInc.:bvr2.0:bd12/17/2015:svnSupermicro:pnSuperServer:pvr0123456789:rvnSupermicro:rnX10DRW-i:rvr1.02:cvnSupermicro:ct17:cvr0123456789:
dmi.product.name: Super Server
dmi.product.version: 0123456789
dmi.sys.vendor: Supermicro
** Affects: linux (Ubuntu)
Importance: Undecided
Status: New
** Tags: amd64 apport-bug xenial
** Attachment added: "unix_gc_4.4.0-89-generic.dmesg"
https://bugs.launchpad.net/bugs/1709591/+attachment/4929293/+files/unix_gc_4.4.0-89-generic.dmesg
--
You received this bug notification because you are a member of Kernel
Packages, which is subscribed to linux in Ubuntu.
https://bugs.launchpad.net/bugs/1709591
Title:
kernel crash on unix_gc
Status in linux package in Ubuntu:
New
Bug description:
Hello.
I use unprivileged LXC containers with running systemd, systemd-journald,
apache and nginx on it.
Each lxc config have memory limits (lxc.cgroup.memory.limit_in_bytes) and
this scheme stable work long time.
After I add MemoryLimit to apache service file sometime the kernel crashes
with unix_gc RIP.
For simulate situation I running script "membomb.py" using service
file "membomb.service" (with included MemoryLimit) on each container
and the kernel stable crashes.
I try update the kernel from 4.4.0-77 to 4.4.0-89 and change server
(from IBM to Supermicro), stack trace changed but problem still exist.
[ 2477.309371] BUG: unable to handle kernel NULL pointer dereference at
0000000000000018
[ 2477.310336] IP: [<ffffffff817def24>] unix_gc+0xc4/0x3a0
[ 2477.311236] PGD 0
[ 2477.312104] Oops: 0000 [#1] SMP
[ 2477.312952] Modules linked in: ebt_arpreply ebt_arp ebtable_nat ebtables
veth nfnetlink_queue nfnetlink_log nfnetlink bluetooth netconsole configfs
ip6table_filter ip6_tables ipt_MASQUERADE nf_nat_masquerade_ipv4 xt_nat
xt_tcpudp iptable_nat nf_nat_ipv4 nf_nat ipt_REJECT nf_reject_ipv4
nf_conntrack_ipv4 nf_defrag_
ipv4 xt_multiport xt_conntrack iptable_filter ip_tables x_tables bridge
ipmi_ssif intel_rapl x86_pkg_temp_thermal coretemp kvm_intel kvm irqbypass
crct10dif_pclmul crc32_pclmul ghash_clmulni_intel aesni_intel aes_x86_64 8021q
lrw garp gf128mul mrp glue_helper stp ablk_helper llc cryptd joydev input_leds
sb_edac edac_
core mei_me mei lpc_ich shpchp ioatdma ipmi_si 8250_fintek ipmi_msghandler
acpi_power_meter mac_hid binfmt_misc nf_conntrack_ftp nf_conntrack autofs4 xfs
btrfs raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx
xor raid6_pq libcrc32c raid1 raid0 multipath linear ast ttm drm_kms_helper
hid_gener
ic igb syscopyarea sysfillrect usbhid sysimgblt dca fb_sys_fops ptp drm hid
ahci pps_core libahci i2c_algo_bit wmi fjes
[ 2477.321346] CPU: 1 PID: 2264 Comm: systemd-cgroups Not tainted
4.4.0-89-generic #112-Ubuntu
[ 2477.322281] Hardware name: Supermicro Super Server/X10DRW-i, BIOS 2.0
12/17/2015
[ 2477.323211] task: ffff880873b7aa00 ti: ffff8808239e8000 task.ti:
ffff8808239e8000
[ 2477.324143] RIP: 0010:[<ffffffff817def24>] [<ffffffff817def24>]
unix_gc+0xc4/0x3a0
[ 2477.325078] RSP: 0018:ffff8808239ebd58 EFLAGS: 00010287
[ 2477.326000] RAX: ffff88167eb09ff8 RBX: ffff8808239ebd68 RCX:
0000000000000000
[ 2477.326926] RDX: ffff88167eb0a328 RSI: ffff88167eb08ff8 RDI:
ffff88167eb0f400
[ 2477.327852] RBP: ffff8808239ebdb0 R08: 0000000000000002 R09:
0000000000000000
[ 2477.328777] R10: ffff880860f096b0 R11: ffff88086c08c710 R12:
ffff88080b51b0a8
[ 2477.329698] R13: 0000000000000001 R14: ffff88080b51b080 R15:
ffff88080b519400
[ 2477.330617] FS: 00007f9239bc4840(0000) GS:ffff88103fc40000(0000)
knlGS:0000000000000000
[ 2477.331551] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[ 2477.332485] CR2: 0000000000000018 CR3: 000000082cadd000 CR4:
00000000001406e0
[ 2477.333429] Stack:
[ 2477.334365] 0000000000000000 0000000000000246 ffff8808239ebd68
ffff8808239ebd68
[ 2477.335331] 0000000000000202 0000000000000202 ffff8808239ebdb0
ddb43b7044268f20
[ 2477.336294] ffff88080b51b000 ffff88080b51b0a8 0000000000000001
ffff8808239ebe10
[ 2477.337262] Call Trace:
[ 2477.338220] [<ffffffff817dc882>] unix_release_sock+0x1c2/0x2f0
[ 2477.339187] [<ffffffff817dc9d0>] unix_release+0x20/0x30
[ 2477.340152] [<ffffffff8171857f>] sock_release+0x1f/0x80
[ 2477.341112] [<ffffffff817185f2>] sock_close+0x12/0x20
[ 2477.342069] [<ffffffff81211284>] __fput+0xe4/0x220
[ 2477.343005] [<ffffffff812113fe>] ____fput+0xe/0x10
[ 2477.343918] [<ffffffff8109f0d1>] task_work_run+0x81/0xa0
[ 2477.344824] [<ffffffff81003242>] exit_to_usermode_loop+0xc2/0xd0
[ 2477.345729] [<ffffffff81003c6e>] syscall_return_slowpath+0x4e/0x60
[ 2477.346631] [<ffffffff81842090>] int_ret_from_sys_call+0x25/0x8f
[ 2477.347512] Code: 74 51 48 8b b0 30 03 00 00 48 8d 90 30 03 00 00 48 81 ee
30 03 00 00 48 81 fa a0 0d f0 81 0f 84 af 00 00 00 48 8b 88 48 02 00 00 <48> 8b
49 18 4c 8b 41 38 48 8b 88 40 03 00 00 48 85 c9 0f 8e 8e
[ 2477.349382] RIP [<ffffffff817def24>] unix_gc+0xc4/0x3a0
[ 2477.350254] RSP <ffff8808239ebd58>
[ 2477.351107] CR2: 0000000000000018
[ 2477.355696] ---[ end trace 5c1dd6254f090648 ]---
ProblemType: Bug
DistroRelease: Ubuntu 16.04
Package: linux-image-4.4.0-89-generic 4.4.0-89.112
ProcVersionSignature: Ubuntu 4.4.0-89.112-generic 4.4.76
Uname: Linux 4.4.0-89-generic x86_64
AlsaDevices:
total 0
crw-rw---- 1 root audio 116, 1 Aug 9 13:09 seq
crw-rw---- 1 root audio 116, 33 Aug 9 13:09 timer
AplayDevices: Error: [Errno 2] No such file or directory: 'aplay'
ApportVersion: 2.20.1-0ubuntu2.10
Architecture: amd64
ArecordDevices: Error: [Errno 2] No such file or directory: 'arecord'
AudioDevicesInUse: Error: command ['fuser', '-v', '/dev/snd/seq',
'/dev/snd/timer'] failed with exit code 1:
Date: Wed Aug 9 13:10:47 2017
HibernationDevice: RESUME=/dev/mapper/vg_system-swap
IwConfig: Error: [Errno 2] No such file or directory: 'iwconfig'
MachineType: Supermicro Super Server
PciMultimedia:
ProcEnviron:
TERM=xterm-256color
PATH=(custom, no user)
LANG=en_US.UTF-8
SHELL=/bin/bash
ProcFB: 0 astdrmfb
ProcKernelCmdLine: BOOT_IMAGE=/vmlinuz-4.4.0-89-generic
root=/dev/mapper/vg_system-lv_root ro noquiet nosplash net.ifnames=0
biosdevname=0
RelatedPackageVersions:
linux-restricted-modules-4.4.0-89-generic N/A
linux-backports-modules-4.4.0-89-generic N/A
linux-firmware 1.157.11
RfKill: Error: [Errno 2] No such file or directory: 'rfkill'
SourcePackage: linux
UpgradeStatus: No upgrade log present (probably fresh install)
dmi.bios.date: 12/17/2015
dmi.bios.vendor: American Megatrends Inc.
dmi.bios.version: 2.0
dmi.board.asset.tag: Default string
dmi.board.name: X10DRW-i
dmi.board.vendor: Supermicro
dmi.board.version: 1.02
dmi.chassis.asset.tag: Default string
dmi.chassis.type: 17
dmi.chassis.vendor: Supermicro
dmi.chassis.version: 0123456789
dmi.modalias:
dmi:bvnAmericanMegatrendsInc.:bvr2.0:bd12/17/2015:svnSupermicro:pnSuperServer:pvr0123456789:rvnSupermicro:rnX10DRW-i:rvr1.02:cvnSupermicro:ct17:cvr0123456789:
dmi.product.name: Super Server
dmi.product.version: 0123456789
dmi.sys.vendor: Supermicro
To manage notifications about this bug go to:
https://bugs.launchpad.net/ubuntu/+source/linux/+bug/1709591/+subscriptions
--
Mailing list: https://launchpad.net/~kernel-packages
Post to : [email protected]
Unsubscribe : https://launchpad.net/~kernel-packages
More help : https://help.launchpad.net/ListHelp
