[Kernel-packages] [Bug 1653498] Re: Server reboots every 4.1 weeks
Hi, We have the same issue on our k8s cluster. Description: ubuntu16.04.1 LTSx86_64 Release: 16.04.1 Kernel: 4.4.0-104-generic the dump file can be downloaded via following way: wget http://129.226.115.161/dump.202006231820.tar.gz I did some analysis, however i still didnot find the root cause: Load the vmcore in crash (please refer to the hyperlink above). Crash should present details similar to the following: crash> bt PID: 11388 TASK: 880eb1f79e00 CPU: 29 COMMAND: "heartbeat" #0 [8809131a7b08] machine_kexec at 8105c22b #1 [8809131a7b68] crash_kexec at 8110e852 #2 [8809131a7c38] oops_end at 81031c49 #3 [8809131a7c60] die at 810320fb #4 [8809131a7c90] do_trap at 8102f121 #5 [8809131a7ce0] do_error_trap at 8102f4a9 #6 [8809131a7da0] do_invalid_op at 8102fa10 #7 [8809131a7db0] invalid_op at 8184638e [exception RIP: __fput+541] RIP: 812126ad RSP: 8809131a7e68 RFLAGS: 00010246 RAX: RBX: 880ef6915700 RCX: 000365fb1705 RDX: 0001 RSI: 880fff55a020 RDI: RBP: 8809131a7ea0 R8: 0001a020 R9: 811b591d R10: ea002b69b300 R11: 880ef6915710 R12: 0010 R13: 880ed152aef8 R14: 8800bba18aa0 R15: 880ed1513a40 ORIG_RAX: CS: 0010 SS: 0018 #8 [8809131a7e60] __fput at 812125ac #9 [8809131a7ea8] fput at 812126ee #10 [8809131a7eb8] task_work_run at 8109f101 #11 [8809131a7ef8] exit_to_usermode_loop at 81003242 #12 [8809131a7f30] syscall_return_slowpath at 81003c6e #13 [8809131a7f50] int_ret_from_sys_call at 818449d0 RIP: 0047f704 RSP: 00c423b77c98 RFLAGS: 0246 RAX: RBX: RCX: 0047f704 RDX: RSI: RDI: 00ca RBP: 00c423b77ce0 R8: R9: R10: R11: 0246 R12: R13: R14: 00c423b78ee0 R15: 0008 ORIG_RAX: 0003 CS: 0033 SS: 002b crash> crash> log [19156101.592212] [ cut here ] [19156101.593103] kernel BUG at /build/linux-SwhOyu/linux-4.4.0/include/linux/fs.h:2582! [19156101.594385] invalid opcode: [#1] SMP [19156101.595083] Modules linked in: binfmt_misc af_packet_diag netlink_diag dccp_diag dccp tcp_diag udp_diag inet_diag unix_diag veth br_netfilter ipt_MASQUERADE nf_nat_masquerade_ipv4 xt_set xt_mark ip_set_hash_ipportnet ip_set_hash_ipportip ip_set_bitmap_port ip_set_hash_ipport ip_set dummy xt_comment xt_addrtype iptable_nat nf_nat_ipv4 nf_conntrack_ipv4 nf_defrag_ipv4 ip_vs_sh ip_vs_wrr ip_vs_rr ip_vs xt_tcpudp bridge stp llc nf_conntrack_netlink nfnetlink xfrm_user xfrm_algo iptable_filter ip_tables xt_conntrack x_tables nf_nat nf_conntrack aufs isofs ppdev crct10dif_pclmul parport_pc crc32_pclmul input_leds joydev ghash_clmulni_intel parport serio_raw ib_iser rdma_cm iw_cm ib_cm ib_sa ib_mad ib_core ib_addr sunrpc iscsi_tcp libiscsi_tcp libiscsi scsi_transport_iscsi autofs4 btrfs raid10 raid456 async_raid6_recov [19156101.606434] async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear aesni_intel aes_x86_64 glue_helper lrw gf128mul ablk_helper cryptd psmouse floppy [19156101.609129] CPU: 29 PID: 11388 Comm: heartbeat Not tainted 4.4.0-104-generic #127-Ubuntu [19156101.610384] Hardware name: Smdbmds KVM, BIOS seabios-1.9.1-qemu-project.org 04/01/2014 [19156101.611637] task: 880eb1f79e00 ti: 8809131a4000 task.ti: 8809131a4000 [19156101.612905] RIP: 0010:[] [] __fput+0x21d/0x220 [19156101.614188] RSP: 0018:8809131a7e68 EFLAGS: 00010246 [19156101.614989] RAX: RBX: 880ef6915700 RCX: 000365fb1705 [19156101.616143] RDX: 0001 RSI: 880fff55a020 RDI: [19156101.617285] RBP: 8809131a7ea0 R08: 0001a020 R09: 811b591d [19156101.618422] R10: ea002b69b300 R11: 880ef6915710 R12: 0010 [19156101.619574] R13: 880ed152aef8 R14: 8800bba18aa0 R15: 880ed1513a40 [19156101.620785] FS: 00c42085bc90() GS:880fff54() knlGS: [19156101.622074] CS: 0010 DS: ES: CR0: 80050033 [19156101.622921] CR2: 7f508b166b04 CR3: 000e0981b000 CR4: 003406e0 [19156101.624062] DR0: DR1: DR2: [19156101.625210] DR3: DR6: fffe0ff0 DR7: 0400 [19156101.626349] Stack: [19156101.626765] 880ed152aef8 880ef6915710 880eb1f79e00 8210ad50 [19156101.628018] 880ef6915700 880eb1f7a4a0 8809131a7eb0 [19156101.629305] 812126ee
[Kernel-packages] [Bug 1653498] Re: Server reboots every 4.1 weeks
Hello, We have the same issue on our k8s cluster. Description: ubuntu16.04.1 LTSx86_64 Release: 16.04.1 Kernel: 4.4.0-104-generic [19156101.592212] [ cut here ] [19156101.593103] kernel BUG at /build/linux-SwhOyu/linux-4.4.0/include/linux/fs.h:2582! [19156101.594385] invalid opcode: [#1] SMP [19156101.595083] Modules linked in: binfmt_misc af_packet_diag netlink_diag dccp_diag dccp tcp_diag udp_diag inet_diag unix_diag veth br_netfilter ipt_MASQUERADE nf_nat_masquerade_ipv4 xt_set xt_mark ip_set_hash_ipportnet ip_set_hash_ipportip ip_set_bitmap_port ip_set_hash_ipport ip_set dummy xt_comment xt_addrtype iptable_nat nf_nat_ipv4 nf_conntrack_ipv4 nf_defrag_ipv4 ip_vs_sh ip_vs_wrr ip_vs_rr ip_vs xt_tcpudp bridge stp llc nf_conntrack_netlink nfnetlink xfrm_user xfrm_algo iptable_filter ip_tables xt_conntrack x_tables nf_nat nf_conntrack aufs isofs ppdev crct10dif_pclmul parport_pc crc32_pclmul input_leds joydev ghash_clmulni_intel parport serio_raw ib_iser rdma_cm iw_cm ib_cm ib_sa ib_mad ib_core ib_addr sunrpc iscsi_tcp libiscsi_tcp libiscsi scsi_transport_iscsi autofs4 btrfs raid10 raid456 async_raid6_recov [19156101.606434] async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear aesni_intel aes_x86_64 glue_helper lrw gf128mul ablk_helper cryptd psmouse floppy [19156101.609129] CPU: 29 PID: 11388 Comm: heartbeat Not tainted 4.4.0-104-generic #127-Ubuntu [19156101.610384] Hardware name: Smdbmds KVM, BIOS seabios-1.9.1-qemu-project.org 04/01/2014 [19156101.611637] task: 880eb1f79e00 ti: 8809131a4000 task.ti: 8809131a4000 [19156101.612905] RIP: 0010:[] [] __fput+0x21d/0x220 [19156101.614188] RSP: 0018:8809131a7e68 EFLAGS: 00010246 [19156101.614989] RAX: RBX: 880ef6915700 RCX: 000365fb1705 [19156101.616143] RDX: 0001 RSI: 880fff55a020 RDI: [19156101.617285] RBP: 8809131a7ea0 R08: 0001a020 R09: 811b591d [19156101.618422] R10: ea002b69b300 R11: 880ef6915710 R12: 0010 [19156101.619574] R13: 880ed152aef8 R14: 8800bba18aa0 R15: 880ed1513a40 [19156101.620785] FS: 00c42085bc90() GS:880fff54() knlGS: [19156101.622074] CS: 0010 DS: ES: CR0: 80050033 [19156101.622921] CR2: 7f508b166b04 CR3: 000e0981b000 CR4: 003406e0 [19156101.624062] DR0: DR1: DR2: [19156101.625210] DR3: DR6: fffe0ff0 DR7: 0400 [19156101.626349] Stack: [19156101.626765] 880ed152aef8 880ef6915710 880eb1f79e00 8210ad50 [19156101.628018] 880ef6915700 880eb1f7a4a0 8809131a7eb0 [19156101.629305] 812126ee 8809131a7ef0 8109f101 880eb1f7a4d4 [19156101.630568] Call Trace: [19156101.631036] [] fput+0xe/0x10 [19156101.631804] [] task_work_run+0x81/0xa0 [19156101.632612] [] exit_to_usermode_loop+0xc2/0xd0 [19156101.633497] [] syscall_return_slowpath+0x4e/0x60 [19156101.634402] [] int_ret_from_sys_call+0x25/0x8f [19156101.635285] Code: 0f 84 cf fe ff ff 48 8b 43 28 48 8b 80 80 00 00 00 48 85 c0 0f 84 bb fe ff ff 31 d2 48 89 de bf ff ff ff ff ff d0 e9 aa fe ff ff <0f> 0b 90 0f 1f 44 00 00 31 ff 48 87 3d 8a 6e fc 00 48 85 ff 74 [19156101.639244] RIP [] __fput+0x21d/0x220 [19156101.640049] RSP crash> Does this issue exist on Ubuntu18.04 -- You received this bug notification because you are a member of Kernel Packages, which is subscribed to linux in Ubuntu. https://bugs.launchpad.net/bugs/1653498 Title: Server reboots every 4.1 weeks Status in linux package in Ubuntu: Confirmed Status in linux source package in Xenial: Confirmed Bug description: Every 4.1 uptime weeks (more or less), our 34 servers reboots with the logs below. Description:Ubuntu 16.04.1 LTS Release:16.04 The servers hosts the stack flanneld (0.5.5) docker (1.11.2, build b9f10c9) kubernetes (v1.3.6) plus etcd (2.3.7) Jan 02 06:40:32 prd-node021 kernel: [ cut here ] Jan 02 06:40:32 prd-node021 kernel: kernel BUG at /build/linux-xHzv4a/linux-4.4.0/include/linux/fs.h:2569! Jan 02 06:40:32 prd-node021 kernel: invalid opcode: [#1] SMP Jan 02 06:40:32 prd-node021 kernel: Modules linked in: nf_conntrack_netlink nfnetlink veth xt_statistic xt_nat xt_recent ipt_REJECT nf_reject_ipv4 xt_tcpudp tcp_diag inet_diag Jan 02 06:40:32 prd-node021 kernel: raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc Jan 02 06:40:32 prd-node021 kernel: CPU: 46 PID: 22749 Comm: iptables-restor Not tainted 4.4.0-47-generic #68-Ubuntu Jan 02 06:40:32 prd-node021 kernel: Hardware name: HP ProLiant DL360 Gen9/ProLiant DL360 Gen9, BIOS P89 09/13/2016 Jan 02 06:40:32 prd-node021 kernel:
[Kernel-packages] [Bug 1653498] Re: Server reboots every 4.1 weeks
Hi, Does this issue exist on Ubuntu18.04? -- You received this bug notification because you are a member of Kernel Packages, which is subscribed to linux in Ubuntu. https://bugs.launchpad.net/bugs/1653498 Title: Server reboots every 4.1 weeks Status in linux package in Ubuntu: Confirmed Status in linux source package in Xenial: Confirmed Bug description: Every 4.1 uptime weeks (more or less), our 34 servers reboots with the logs below. Description:Ubuntu 16.04.1 LTS Release:16.04 The servers hosts the stack flanneld (0.5.5) docker (1.11.2, build b9f10c9) kubernetes (v1.3.6) plus etcd (2.3.7) Jan 02 06:40:32 prd-node021 kernel: [ cut here ] Jan 02 06:40:32 prd-node021 kernel: kernel BUG at /build/linux-xHzv4a/linux-4.4.0/include/linux/fs.h:2569! Jan 02 06:40:32 prd-node021 kernel: invalid opcode: [#1] SMP Jan 02 06:40:32 prd-node021 kernel: Modules linked in: nf_conntrack_netlink nfnetlink veth xt_statistic xt_nat xt_recent ipt_REJECT nf_reject_ipv4 xt_tcpudp tcp_diag inet_diag Jan 02 06:40:32 prd-node021 kernel: raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc Jan 02 06:40:32 prd-node021 kernel: CPU: 46 PID: 22749 Comm: iptables-restor Not tainted 4.4.0-47-generic #68-Ubuntu Jan 02 06:40:32 prd-node021 kernel: Hardware name: HP ProLiant DL360 Gen9/ProLiant DL360 Gen9, BIOS P89 09/13/2016 Jan 02 06:40:32 prd-node021 kernel: task: 882f7ccb44c0 ti: 882fcb81 task.ti: 882fcb81 Jan 02 06:40:32 prd-node021 kernel: RIP: 0010:[] [] __fput+0x21d/0x220 Jan 02 06:40:32 prd-node021 kernel: RSP: 0018:882fcb813e68 EFLAGS: 00010246 Jan 02 06:40:32 prd-node021 kernel: RAX: RBX: 8829dbd92700 RCX: 308c6396 Jan 02 06:40:32 prd-node021 kernel: RDX: 0001 RSI: 88301f299f60 RDI: Jan 02 06:40:32 prd-node021 kernel: RBP: 882fcb813ea0 R08: 00019f60 R09: 811b3a1d Jan 02 06:40:32 prd-node021 kernel: R10: ea0064756680 R11: 8829dbd92710 R12: 0010 Jan 02 06:40:32 prd-node021 kernel: R13: 8817d3520518 R14: 881021a34da0 R15: 8817d3542540 Jan 02 06:40:32 prd-node021 kernel: FS: 7fcdaa753700() GS:88301f28() knlGS: Jan 02 06:40:32 prd-node021 kernel: CS: 0010 DS: ES: CR0: 80050033 Jan 02 06:40:32 prd-node021 kernel: CR2: 7fcdaa758000 CR3: 001917993000 CR4: 003406e0 Jan 02 06:40:32 prd-node021 kernel: DR0: DR1: DR2: Jan 02 06:40:32 prd-node021 kernel: DR3: DR6: fffe0ff0 DR7: 0400 Jan 02 06:40:32 prd-node021 kernel: Stack: Jan 02 06:40:32 prd-node021 kernel: 8817d3520518 8829dbd92710 882f7ccb44c0 82103a30 Jan 02 06:40:32 prd-node021 kernel: 8829dbd92700 882f7ccb4b38 882fcb813eb0 Jan 02 06:40:32 prd-node021 kernel: 8120fa2e 882fcb813ef0 8109ee01 882f7ccb4b6c Jan 02 06:40:32 prd-node021 kernel: Call Trace: Jan 02 06:40:32 prd-node021 kernel: [] fput+0xe/0x10 Jan 02 06:40:32 prd-node021 kernel: [] task_work_run+0x81/0xa0 Jan 02 06:40:32 prd-node021 kernel: [] exit_to_usermode_loop+0xc2/0xd0 Jan 02 06:40:32 prd-node021 kernel: [] syscall_return_slowpath+0x4e/0x60 Jan 02 06:40:32 prd-node021 kernel: [] int_ret_from_sys_call+0x25/0x8f Jan 02 06:40:32 prd-node021 kernel: Code: 0f 84 cf fe ff ff 48 8b 43 28 48 8b 80 80 00 00 00 48 85 c0 0f 84 bb fe ff ff 31 d2 48 89 de bf ff ff ff ff ff d0 e9 aa fe ff ff <0f> Jan 02 06:40:32 prd-node021 kernel: RIP [] __fput+0x21d/0x220 -- Reboot -- Jan 02 06:42:56 prd-node021 systemd-journald[819]: Runtime journal (/run/log/journal/) is 8.0M, max 1.8G, 1.8G free. Jan 02 06:42:56 prd-node021 kernel: Initializing cgroup subsys cpuset ProblemType: Bug DistroRelease: Ubuntu 16.04 Package: linux-image-4.4.0-47-generic 4.4.0-47.68 ProcVersionSignature: Ubuntu 4.4.0-47.68-generic 4.4.24 Uname: Linux 4.4.0-47-generic x86_64 AlsaDevices: total 0 crw-rw 1 root audio 116, 1 Jan 2 06:42 seq crw-rw 1 root audio 116, 33 Jan 2 06:42 timer AplayDevices: Error: [Errno 2] No such file or directory: 'aplay' ApportVersion: 2.20.1-0ubuntu2.1 Architecture: amd64 ArecordDevices: Error: [Errno 2] No such file or directory: 'arecord' AudioDevicesInUse: Error: command ['fuser', '-v', '/dev/snd/seq', '/dev/snd/timer'] failed with exit code 1: Date: Mon Jan 2 10:49:15 2017 HibernationDevice: RESUME=/dev/mapper/vg00-swap InstallationDate: Installed on 2016-09-13 (110 days ago) InstallationMedia: Ubuntu-Server 16.04.1 LTS "Xenial Xerus" - Beta amd64 (20160803) IwConfig: Error: [Errno 2] No such file or directory: 'iwconfig' MachineType: HP ProLiant DL360
[Kernel-packages] [Bug 1653498] Re: Server reboots every 4.1 weeks
Hi, Does this issue exist on Ubuntu18.04? -- You received this bug notification because you are a member of Kernel Packages, which is subscribed to linux in Ubuntu. https://bugs.launchpad.net/bugs/1653498 Title: Server reboots every 4.1 weeks Status in linux package in Ubuntu: Confirmed Status in linux source package in Xenial: Confirmed Bug description: Every 4.1 uptime weeks (more or less), our 34 servers reboots with the logs below. Description:Ubuntu 16.04.1 LTS Release:16.04 The servers hosts the stack flanneld (0.5.5) docker (1.11.2, build b9f10c9) kubernetes (v1.3.6) plus etcd (2.3.7) Jan 02 06:40:32 prd-node021 kernel: [ cut here ] Jan 02 06:40:32 prd-node021 kernel: kernel BUG at /build/linux-xHzv4a/linux-4.4.0/include/linux/fs.h:2569! Jan 02 06:40:32 prd-node021 kernel: invalid opcode: [#1] SMP Jan 02 06:40:32 prd-node021 kernel: Modules linked in: nf_conntrack_netlink nfnetlink veth xt_statistic xt_nat xt_recent ipt_REJECT nf_reject_ipv4 xt_tcpudp tcp_diag inet_diag Jan 02 06:40:32 prd-node021 kernel: raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc Jan 02 06:40:32 prd-node021 kernel: CPU: 46 PID: 22749 Comm: iptables-restor Not tainted 4.4.0-47-generic #68-Ubuntu Jan 02 06:40:32 prd-node021 kernel: Hardware name: HP ProLiant DL360 Gen9/ProLiant DL360 Gen9, BIOS P89 09/13/2016 Jan 02 06:40:32 prd-node021 kernel: task: 882f7ccb44c0 ti: 882fcb81 task.ti: 882fcb81 Jan 02 06:40:32 prd-node021 kernel: RIP: 0010:[] [] __fput+0x21d/0x220 Jan 02 06:40:32 prd-node021 kernel: RSP: 0018:882fcb813e68 EFLAGS: 00010246 Jan 02 06:40:32 prd-node021 kernel: RAX: RBX: 8829dbd92700 RCX: 308c6396 Jan 02 06:40:32 prd-node021 kernel: RDX: 0001 RSI: 88301f299f60 RDI: Jan 02 06:40:32 prd-node021 kernel: RBP: 882fcb813ea0 R08: 00019f60 R09: 811b3a1d Jan 02 06:40:32 prd-node021 kernel: R10: ea0064756680 R11: 8829dbd92710 R12: 0010 Jan 02 06:40:32 prd-node021 kernel: R13: 8817d3520518 R14: 881021a34da0 R15: 8817d3542540 Jan 02 06:40:32 prd-node021 kernel: FS: 7fcdaa753700() GS:88301f28() knlGS: Jan 02 06:40:32 prd-node021 kernel: CS: 0010 DS: ES: CR0: 80050033 Jan 02 06:40:32 prd-node021 kernel: CR2: 7fcdaa758000 CR3: 001917993000 CR4: 003406e0 Jan 02 06:40:32 prd-node021 kernel: DR0: DR1: DR2: Jan 02 06:40:32 prd-node021 kernel: DR3: DR6: fffe0ff0 DR7: 0400 Jan 02 06:40:32 prd-node021 kernel: Stack: Jan 02 06:40:32 prd-node021 kernel: 8817d3520518 8829dbd92710 882f7ccb44c0 82103a30 Jan 02 06:40:32 prd-node021 kernel: 8829dbd92700 882f7ccb4b38 882fcb813eb0 Jan 02 06:40:32 prd-node021 kernel: 8120fa2e 882fcb813ef0 8109ee01 882f7ccb4b6c Jan 02 06:40:32 prd-node021 kernel: Call Trace: Jan 02 06:40:32 prd-node021 kernel: [] fput+0xe/0x10 Jan 02 06:40:32 prd-node021 kernel: [] task_work_run+0x81/0xa0 Jan 02 06:40:32 prd-node021 kernel: [] exit_to_usermode_loop+0xc2/0xd0 Jan 02 06:40:32 prd-node021 kernel: [] syscall_return_slowpath+0x4e/0x60 Jan 02 06:40:32 prd-node021 kernel: [] int_ret_from_sys_call+0x25/0x8f Jan 02 06:40:32 prd-node021 kernel: Code: 0f 84 cf fe ff ff 48 8b 43 28 48 8b 80 80 00 00 00 48 85 c0 0f 84 bb fe ff ff 31 d2 48 89 de bf ff ff ff ff ff d0 e9 aa fe ff ff <0f> Jan 02 06:40:32 prd-node021 kernel: RIP [] __fput+0x21d/0x220 -- Reboot -- Jan 02 06:42:56 prd-node021 systemd-journald[819]: Runtime journal (/run/log/journal/) is 8.0M, max 1.8G, 1.8G free. Jan 02 06:42:56 prd-node021 kernel: Initializing cgroup subsys cpuset ProblemType: Bug DistroRelease: Ubuntu 16.04 Package: linux-image-4.4.0-47-generic 4.4.0-47.68 ProcVersionSignature: Ubuntu 4.4.0-47.68-generic 4.4.24 Uname: Linux 4.4.0-47-generic x86_64 AlsaDevices: total 0 crw-rw 1 root audio 116, 1 Jan 2 06:42 seq crw-rw 1 root audio 116, 33 Jan 2 06:42 timer AplayDevices: Error: [Errno 2] No such file or directory: 'aplay' ApportVersion: 2.20.1-0ubuntu2.1 Architecture: amd64 ArecordDevices: Error: [Errno 2] No such file or directory: 'arecord' AudioDevicesInUse: Error: command ['fuser', '-v', '/dev/snd/seq', '/dev/snd/timer'] failed with exit code 1: Date: Mon Jan 2 10:49:15 2017 HibernationDevice: RESUME=/dev/mapper/vg00-swap InstallationDate: Installed on 2016-09-13 (110 days ago) InstallationMedia: Ubuntu-Server 16.04.1 LTS "Xenial Xerus" - Beta amd64 (20160803) IwConfig: Error: [Errno 2] No such file or directory: 'iwconfig' MachineType: HP ProLiant DL360
[Kernel-packages] [Bug 1653498] Re: Server reboots every 4.1 weeks
** Tags added: ubuntu-certified -- You received this bug notification because you are a member of Kernel Packages, which is subscribed to linux in Ubuntu. https://bugs.launchpad.net/bugs/1653498 Title: Server reboots every 4.1 weeks Status in linux package in Ubuntu: Confirmed Status in linux source package in Xenial: Confirmed Bug description: Every 4.1 uptime weeks (more or less), our 34 servers reboots with the logs below. Description:Ubuntu 16.04.1 LTS Release:16.04 The servers hosts the stack flanneld (0.5.5) docker (1.11.2, build b9f10c9) kubernetes (v1.3.6) plus etcd (2.3.7) Jan 02 06:40:32 prd-node021 kernel: [ cut here ] Jan 02 06:40:32 prd-node021 kernel: kernel BUG at /build/linux-xHzv4a/linux-4.4.0/include/linux/fs.h:2569! Jan 02 06:40:32 prd-node021 kernel: invalid opcode: [#1] SMP Jan 02 06:40:32 prd-node021 kernel: Modules linked in: nf_conntrack_netlink nfnetlink veth xt_statistic xt_nat xt_recent ipt_REJECT nf_reject_ipv4 xt_tcpudp tcp_diag inet_diag Jan 02 06:40:32 prd-node021 kernel: raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc Jan 02 06:40:32 prd-node021 kernel: CPU: 46 PID: 22749 Comm: iptables-restor Not tainted 4.4.0-47-generic #68-Ubuntu Jan 02 06:40:32 prd-node021 kernel: Hardware name: HP ProLiant DL360 Gen9/ProLiant DL360 Gen9, BIOS P89 09/13/2016 Jan 02 06:40:32 prd-node021 kernel: task: 882f7ccb44c0 ti: 882fcb81 task.ti: 882fcb81 Jan 02 06:40:32 prd-node021 kernel: RIP: 0010:[] [] __fput+0x21d/0x220 Jan 02 06:40:32 prd-node021 kernel: RSP: 0018:882fcb813e68 EFLAGS: 00010246 Jan 02 06:40:32 prd-node021 kernel: RAX: RBX: 8829dbd92700 RCX: 308c6396 Jan 02 06:40:32 prd-node021 kernel: RDX: 0001 RSI: 88301f299f60 RDI: Jan 02 06:40:32 prd-node021 kernel: RBP: 882fcb813ea0 R08: 00019f60 R09: 811b3a1d Jan 02 06:40:32 prd-node021 kernel: R10: ea0064756680 R11: 8829dbd92710 R12: 0010 Jan 02 06:40:32 prd-node021 kernel: R13: 8817d3520518 R14: 881021a34da0 R15: 8817d3542540 Jan 02 06:40:32 prd-node021 kernel: FS: 7fcdaa753700() GS:88301f28() knlGS: Jan 02 06:40:32 prd-node021 kernel: CS: 0010 DS: ES: CR0: 80050033 Jan 02 06:40:32 prd-node021 kernel: CR2: 7fcdaa758000 CR3: 001917993000 CR4: 003406e0 Jan 02 06:40:32 prd-node021 kernel: DR0: DR1: DR2: Jan 02 06:40:32 prd-node021 kernel: DR3: DR6: fffe0ff0 DR7: 0400 Jan 02 06:40:32 prd-node021 kernel: Stack: Jan 02 06:40:32 prd-node021 kernel: 8817d3520518 8829dbd92710 882f7ccb44c0 82103a30 Jan 02 06:40:32 prd-node021 kernel: 8829dbd92700 882f7ccb4b38 882fcb813eb0 Jan 02 06:40:32 prd-node021 kernel: 8120fa2e 882fcb813ef0 8109ee01 882f7ccb4b6c Jan 02 06:40:32 prd-node021 kernel: Call Trace: Jan 02 06:40:32 prd-node021 kernel: [] fput+0xe/0x10 Jan 02 06:40:32 prd-node021 kernel: [] task_work_run+0x81/0xa0 Jan 02 06:40:32 prd-node021 kernel: [] exit_to_usermode_loop+0xc2/0xd0 Jan 02 06:40:32 prd-node021 kernel: [] syscall_return_slowpath+0x4e/0x60 Jan 02 06:40:32 prd-node021 kernel: [] int_ret_from_sys_call+0x25/0x8f Jan 02 06:40:32 prd-node021 kernel: Code: 0f 84 cf fe ff ff 48 8b 43 28 48 8b 80 80 00 00 00 48 85 c0 0f 84 bb fe ff ff 31 d2 48 89 de bf ff ff ff ff ff d0 e9 aa fe ff ff <0f> Jan 02 06:40:32 prd-node021 kernel: RIP [] __fput+0x21d/0x220 -- Reboot -- Jan 02 06:42:56 prd-node021 systemd-journald[819]: Runtime journal (/run/log/journal/) is 8.0M, max 1.8G, 1.8G free. Jan 02 06:42:56 prd-node021 kernel: Initializing cgroup subsys cpuset ProblemType: Bug DistroRelease: Ubuntu 16.04 Package: linux-image-4.4.0-47-generic 4.4.0-47.68 ProcVersionSignature: Ubuntu 4.4.0-47.68-generic 4.4.24 Uname: Linux 4.4.0-47-generic x86_64 AlsaDevices: total 0 crw-rw 1 root audio 116, 1 Jan 2 06:42 seq crw-rw 1 root audio 116, 33 Jan 2 06:42 timer AplayDevices: Error: [Errno 2] No such file or directory: 'aplay' ApportVersion: 2.20.1-0ubuntu2.1 Architecture: amd64 ArecordDevices: Error: [Errno 2] No such file or directory: 'arecord' AudioDevicesInUse: Error: command ['fuser', '-v', '/dev/snd/seq', '/dev/snd/timer'] failed with exit code 1: Date: Mon Jan 2 10:49:15 2017 HibernationDevice: RESUME=/dev/mapper/vg00-swap InstallationDate: Installed on 2016-09-13 (110 days ago) InstallationMedia: Ubuntu-Server 16.04.1 LTS "Xenial Xerus" - Beta amd64 (20160803) IwConfig: Error: [Errno 2] No such file or directory: 'iwconfig' MachineType: HP ProLiant DL360 Gen9
[Kernel-packages] [Bug 1653498] Re: Server reboots every 4.1 weeks
The similar problem is described on github: https://github.com/kubernetes/kubernetes/issues/70229 ** Bug watch added: github.com/kubernetes/kubernetes/issues #70229 https://github.com/kubernetes/kubernetes/issues/70229 -- You received this bug notification because you are a member of Kernel Packages, which is subscribed to linux in Ubuntu. https://bugs.launchpad.net/bugs/1653498 Title: Server reboots every 4.1 weeks Status in linux package in Ubuntu: Confirmed Status in linux source package in Xenial: Confirmed Bug description: Every 4.1 uptime weeks (more or less), our 34 servers reboots with the logs below. Description:Ubuntu 16.04.1 LTS Release:16.04 The servers hosts the stack flanneld (0.5.5) docker (1.11.2, build b9f10c9) kubernetes (v1.3.6) plus etcd (2.3.7) Jan 02 06:40:32 prd-node021 kernel: [ cut here ] Jan 02 06:40:32 prd-node021 kernel: kernel BUG at /build/linux-xHzv4a/linux-4.4.0/include/linux/fs.h:2569! Jan 02 06:40:32 prd-node021 kernel: invalid opcode: [#1] SMP Jan 02 06:40:32 prd-node021 kernel: Modules linked in: nf_conntrack_netlink nfnetlink veth xt_statistic xt_nat xt_recent ipt_REJECT nf_reject_ipv4 xt_tcpudp tcp_diag inet_diag Jan 02 06:40:32 prd-node021 kernel: raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc Jan 02 06:40:32 prd-node021 kernel: CPU: 46 PID: 22749 Comm: iptables-restor Not tainted 4.4.0-47-generic #68-Ubuntu Jan 02 06:40:32 prd-node021 kernel: Hardware name: HP ProLiant DL360 Gen9/ProLiant DL360 Gen9, BIOS P89 09/13/2016 Jan 02 06:40:32 prd-node021 kernel: task: 882f7ccb44c0 ti: 882fcb81 task.ti: 882fcb81 Jan 02 06:40:32 prd-node021 kernel: RIP: 0010:[] [] __fput+0x21d/0x220 Jan 02 06:40:32 prd-node021 kernel: RSP: 0018:882fcb813e68 EFLAGS: 00010246 Jan 02 06:40:32 prd-node021 kernel: RAX: RBX: 8829dbd92700 RCX: 308c6396 Jan 02 06:40:32 prd-node021 kernel: RDX: 0001 RSI: 88301f299f60 RDI: Jan 02 06:40:32 prd-node021 kernel: RBP: 882fcb813ea0 R08: 00019f60 R09: 811b3a1d Jan 02 06:40:32 prd-node021 kernel: R10: ea0064756680 R11: 8829dbd92710 R12: 0010 Jan 02 06:40:32 prd-node021 kernel: R13: 8817d3520518 R14: 881021a34da0 R15: 8817d3542540 Jan 02 06:40:32 prd-node021 kernel: FS: 7fcdaa753700() GS:88301f28() knlGS: Jan 02 06:40:32 prd-node021 kernel: CS: 0010 DS: ES: CR0: 80050033 Jan 02 06:40:32 prd-node021 kernel: CR2: 7fcdaa758000 CR3: 001917993000 CR4: 003406e0 Jan 02 06:40:32 prd-node021 kernel: DR0: DR1: DR2: Jan 02 06:40:32 prd-node021 kernel: DR3: DR6: fffe0ff0 DR7: 0400 Jan 02 06:40:32 prd-node021 kernel: Stack: Jan 02 06:40:32 prd-node021 kernel: 8817d3520518 8829dbd92710 882f7ccb44c0 82103a30 Jan 02 06:40:32 prd-node021 kernel: 8829dbd92700 882f7ccb4b38 882fcb813eb0 Jan 02 06:40:32 prd-node021 kernel: 8120fa2e 882fcb813ef0 8109ee01 882f7ccb4b6c Jan 02 06:40:32 prd-node021 kernel: Call Trace: Jan 02 06:40:32 prd-node021 kernel: [] fput+0xe/0x10 Jan 02 06:40:32 prd-node021 kernel: [] task_work_run+0x81/0xa0 Jan 02 06:40:32 prd-node021 kernel: [] exit_to_usermode_loop+0xc2/0xd0 Jan 02 06:40:32 prd-node021 kernel: [] syscall_return_slowpath+0x4e/0x60 Jan 02 06:40:32 prd-node021 kernel: [] int_ret_from_sys_call+0x25/0x8f Jan 02 06:40:32 prd-node021 kernel: Code: 0f 84 cf fe ff ff 48 8b 43 28 48 8b 80 80 00 00 00 48 85 c0 0f 84 bb fe ff ff 31 d2 48 89 de bf ff ff ff ff ff d0 e9 aa fe ff ff <0f> Jan 02 06:40:32 prd-node021 kernel: RIP [] __fput+0x21d/0x220 -- Reboot -- Jan 02 06:42:56 prd-node021 systemd-journald[819]: Runtime journal (/run/log/journal/) is 8.0M, max 1.8G, 1.8G free. Jan 02 06:42:56 prd-node021 kernel: Initializing cgroup subsys cpuset ProblemType: Bug DistroRelease: Ubuntu 16.04 Package: linux-image-4.4.0-47-generic 4.4.0-47.68 ProcVersionSignature: Ubuntu 4.4.0-47.68-generic 4.4.24 Uname: Linux 4.4.0-47-generic x86_64 AlsaDevices: total 0 crw-rw 1 root audio 116, 1 Jan 2 06:42 seq crw-rw 1 root audio 116, 33 Jan 2 06:42 timer AplayDevices: Error: [Errno 2] No such file or directory: 'aplay' ApportVersion: 2.20.1-0ubuntu2.1 Architecture: amd64 ArecordDevices: Error: [Errno 2] No such file or directory: 'arecord' AudioDevicesInUse: Error: command ['fuser', '-v', '/dev/snd/seq', '/dev/snd/timer'] failed with exit code 1: Date: Mon Jan 2 10:49:15 2017 HibernationDevice: RESUME=/dev/mapper/vg00-swap InstallationDate: Installed on 2016-09-13 (110 days ago)
[Kernel-packages] [Bug 1653498] Re: Server reboots every 4.1 weeks
Hello, We have the same issue on our k8s cluster. Description:Ubuntu 16.04.3 LTS Release:16.04 Docker: 17.03.2-ce Kubernetes: v1.10.11 Kernel: 4.4.0-145-generic, 4.4.0-109-generic [5493817.706210] [ cut here ] [5493817.707602] kernel BUG at /build/linux-6VmqmP/linux-4.4.0/include/linux/fs.h:2585! [5493817.708284] invalid opcode: [#1] SMP [5493817.708935] Modules linked in: xt_set xt_multiport iptable_raw iptable_mangle ip_set_hash_net veth nf_conntrack_netlink xt_statistic xt_nat xt_recent ipt_REJECT nf_reject_ipv4 xt_tcpudp ip_set nfnetlink ip_vs ip6table_nat nf_conntrack_ipv6 nf_defrag_ipv6 nf_nat_ipv6 ip6_tables xt_comment xt_mark ipt_MASQUERADE nf_nat_masquerade_ipv4 xfrm_user xfrm_algo iptable_nat nf_conntrack_ipv4 nf_defrag_ipv4 nf_nat_ipv4 xt_addrtype iptable_filter ip_tables xt_conntrack x_tables nf_nat nf_conntrack br_netfilter bridge stp llc aufs vmw_balloon vmw_vsock_vmci_transport vsock joydev input_leds serio_raw shpchp i2c_piix4 vmw_vmci mac_hid ib_iser rdma_cm iw_cm ib_cm ib_sa ib_mad ib_core ib_addr sunrpc iscsi_tcp libiscsi_tcp libiscsi scsi_transport_iscsi autofs4 btrfs raid10 raid456 async_raid6_recov async_memcpy async_pq [5493817.714295] async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel aesni_intel vmwgfx aes_x86_64 lrw gf128mul glue_helper ablk_helper cryptd ttm psmouse drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops vmxnet3 drm vmw_pvscsi ahci libahci pata_acpi fjes [5493817.716942] CPU: 5 PID: 13487 Comm: iptables-save Not tainted 4.4.0-145-generic #171-Ubuntu [5493817.717597] Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 04/05/2016 [5493817.718885] task: 8800bb16d400 ti: 88045f38c000 task.ti: 88045f38c000 [5493817.719627] RIP: 0010:[] [] __fput+0x223/0x230 [5493817.720314] RSP: 0018:88045f38fe78 EFLAGS: 00010246 [5493817.721030] RAX: RBX: 88005f20e200 RCX: b86bfbc9 [5493817.721714] RDX: 0001 RSI: e8d51350 RDI: [5493817.722383] RBP: 88045f38feb0 R08: 60f7c0011350 R09: 811beded [5493817.723038] R10: ea000a9f3f00 R11: 88005f20e210 R12: 0010 [5493817.723695] R13: 880816bd11a8 R14: 8808130a1520 R15: 880816aaed80 [5493817.724371] FS: 7f6087f8b700() GS:88083fd4() knlGS: [5493817.725147] CS: 0010 DS: ES: CR0: 80050033 [5493817.725835] CR2: 7f6085f6d1f0 CR3: 0004621e2000 CR4: 00060670 [5493817.726518] Stack: [5493817.727156] 880816bd11a8 88005f20e210 82113f30 8800bb16daa8 [5493817.727806] 8800bb16d400 8800bb16d400 88045f38fec0 [5493817.728508] 8121df5e 88045f38fef0 810a4895 0002 [5493817.729138] Call Trace: [5493817.729845] [] fput+0xe/0x10 [5493817.730511] [] task_work_run+0x95/0xb0 [5493817.731222] [] exit_to_usermode_loop+0xc2/0xd0 [5493817.731875] [] syscall_return_slowpath+0x4e/0x60 [5493817.732579] [] int_ret_from_sys_call+0x25/0xa3 [5493817.733214] Code: fe ff ff 48 8b 43 28 48 8b 80 80 00 00 00 48 85 c0 0f 84 b8 fe ff ff 31 d2 48 89 de bf ff ff ff ff e8 32 a5 64 00 e9 a4 fe ff ff <0f> 0b 90 66 2e 0f 1f 84 00 00 00 00 00 66 66 66 66 90 31 ff 48 [5493817.735013] RIP [] __fput+0x223/0x230 [5493817.735582] RSP -- You received this bug notification because you are a member of Kernel Packages, which is subscribed to linux in Ubuntu. https://bugs.launchpad.net/bugs/1653498 Title: Server reboots every 4.1 weeks Status in linux package in Ubuntu: Confirmed Status in linux source package in Xenial: Confirmed Bug description: Every 4.1 uptime weeks (more or less), our 34 servers reboots with the logs below. Description:Ubuntu 16.04.1 LTS Release:16.04 The servers hosts the stack flanneld (0.5.5) docker (1.11.2, build b9f10c9) kubernetes (v1.3.6) plus etcd (2.3.7) Jan 02 06:40:32 prd-node021 kernel: [ cut here ] Jan 02 06:40:32 prd-node021 kernel: kernel BUG at /build/linux-xHzv4a/linux-4.4.0/include/linux/fs.h:2569! Jan 02 06:40:32 prd-node021 kernel: invalid opcode: [#1] SMP Jan 02 06:40:32 prd-node021 kernel: Modules linked in: nf_conntrack_netlink nfnetlink veth xt_statistic xt_nat xt_recent ipt_REJECT nf_reject_ipv4 xt_tcpudp tcp_diag inet_diag Jan 02 06:40:32 prd-node021 kernel: raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc Jan 02 06:40:32 prd-node021 kernel: CPU: 46 PID: 22749 Comm: iptables-restor Not tainted 4.4.0-47-generic #68-Ubuntu Jan 02 06:40:32 prd-node021 kernel: Hardware name: HP ProLiant DL360 Gen9/ProLiant DL360 Gen9, BIOS P89 09/13/2016 Jan 02 06:40:32 prd-node021 kernel: task:
[Kernel-packages] [Bug 1653498] Re: Server reboots every 4.1 weeks
** Tags added: confirmed -- You received this bug notification because you are a member of Kernel Packages, which is subscribed to linux in Ubuntu. https://bugs.launchpad.net/bugs/1653498 Title: Server reboots every 4.1 weeks Status in linux package in Ubuntu: Confirmed Status in linux source package in Xenial: Confirmed Bug description: Every 4.1 uptime weeks (more or less), our 34 servers reboots with the logs below. Description:Ubuntu 16.04.1 LTS Release:16.04 The servers hosts the stack flanneld (0.5.5) docker (1.11.2, build b9f10c9) kubernetes (v1.3.6) plus etcd (2.3.7) Jan 02 06:40:32 prd-node021 kernel: [ cut here ] Jan 02 06:40:32 prd-node021 kernel: kernel BUG at /build/linux-xHzv4a/linux-4.4.0/include/linux/fs.h:2569! Jan 02 06:40:32 prd-node021 kernel: invalid opcode: [#1] SMP Jan 02 06:40:32 prd-node021 kernel: Modules linked in: nf_conntrack_netlink nfnetlink veth xt_statistic xt_nat xt_recent ipt_REJECT nf_reject_ipv4 xt_tcpudp tcp_diag inet_diag Jan 02 06:40:32 prd-node021 kernel: raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc Jan 02 06:40:32 prd-node021 kernel: CPU: 46 PID: 22749 Comm: iptables-restor Not tainted 4.4.0-47-generic #68-Ubuntu Jan 02 06:40:32 prd-node021 kernel: Hardware name: HP ProLiant DL360 Gen9/ProLiant DL360 Gen9, BIOS P89 09/13/2016 Jan 02 06:40:32 prd-node021 kernel: task: 882f7ccb44c0 ti: 882fcb81 task.ti: 882fcb81 Jan 02 06:40:32 prd-node021 kernel: RIP: 0010:[] [] __fput+0x21d/0x220 Jan 02 06:40:32 prd-node021 kernel: RSP: 0018:882fcb813e68 EFLAGS: 00010246 Jan 02 06:40:32 prd-node021 kernel: RAX: RBX: 8829dbd92700 RCX: 308c6396 Jan 02 06:40:32 prd-node021 kernel: RDX: 0001 RSI: 88301f299f60 RDI: Jan 02 06:40:32 prd-node021 kernel: RBP: 882fcb813ea0 R08: 00019f60 R09: 811b3a1d Jan 02 06:40:32 prd-node021 kernel: R10: ea0064756680 R11: 8829dbd92710 R12: 0010 Jan 02 06:40:32 prd-node021 kernel: R13: 8817d3520518 R14: 881021a34da0 R15: 8817d3542540 Jan 02 06:40:32 prd-node021 kernel: FS: 7fcdaa753700() GS:88301f28() knlGS: Jan 02 06:40:32 prd-node021 kernel: CS: 0010 DS: ES: CR0: 80050033 Jan 02 06:40:32 prd-node021 kernel: CR2: 7fcdaa758000 CR3: 001917993000 CR4: 003406e0 Jan 02 06:40:32 prd-node021 kernel: DR0: DR1: DR2: Jan 02 06:40:32 prd-node021 kernel: DR3: DR6: fffe0ff0 DR7: 0400 Jan 02 06:40:32 prd-node021 kernel: Stack: Jan 02 06:40:32 prd-node021 kernel: 8817d3520518 8829dbd92710 882f7ccb44c0 82103a30 Jan 02 06:40:32 prd-node021 kernel: 8829dbd92700 882f7ccb4b38 882fcb813eb0 Jan 02 06:40:32 prd-node021 kernel: 8120fa2e 882fcb813ef0 8109ee01 882f7ccb4b6c Jan 02 06:40:32 prd-node021 kernel: Call Trace: Jan 02 06:40:32 prd-node021 kernel: [] fput+0xe/0x10 Jan 02 06:40:32 prd-node021 kernel: [] task_work_run+0x81/0xa0 Jan 02 06:40:32 prd-node021 kernel: [] exit_to_usermode_loop+0xc2/0xd0 Jan 02 06:40:32 prd-node021 kernel: [] syscall_return_slowpath+0x4e/0x60 Jan 02 06:40:32 prd-node021 kernel: [] int_ret_from_sys_call+0x25/0x8f Jan 02 06:40:32 prd-node021 kernel: Code: 0f 84 cf fe ff ff 48 8b 43 28 48 8b 80 80 00 00 00 48 85 c0 0f 84 bb fe ff ff 31 d2 48 89 de bf ff ff ff ff ff d0 e9 aa fe ff ff <0f> Jan 02 06:40:32 prd-node021 kernel: RIP [] __fput+0x21d/0x220 -- Reboot -- Jan 02 06:42:56 prd-node021 systemd-journald[819]: Runtime journal (/run/log/journal/) is 8.0M, max 1.8G, 1.8G free. Jan 02 06:42:56 prd-node021 kernel: Initializing cgroup subsys cpuset ProblemType: Bug DistroRelease: Ubuntu 16.04 Package: linux-image-4.4.0-47-generic 4.4.0-47.68 ProcVersionSignature: Ubuntu 4.4.0-47.68-generic 4.4.24 Uname: Linux 4.4.0-47-generic x86_64 AlsaDevices: total 0 crw-rw 1 root audio 116, 1 Jan 2 06:42 seq crw-rw 1 root audio 116, 33 Jan 2 06:42 timer AplayDevices: Error: [Errno 2] No such file or directory: 'aplay' ApportVersion: 2.20.1-0ubuntu2.1 Architecture: amd64 ArecordDevices: Error: [Errno 2] No such file or directory: 'arecord' AudioDevicesInUse: Error: command ['fuser', '-v', '/dev/snd/seq', '/dev/snd/timer'] failed with exit code 1: Date: Mon Jan 2 10:49:15 2017 HibernationDevice: RESUME=/dev/mapper/vg00-swap InstallationDate: Installed on 2016-09-13 (110 days ago) InstallationMedia: Ubuntu-Server 16.04.1 LTS "Xenial Xerus" - Beta amd64 (20160803) IwConfig: Error: [Errno 2] No such file or directory: 'iwconfig' MachineType: HP ProLiant DL360 Gen9
[Kernel-packages] [Bug 1653498] Re: Server reboots every 4.1 weeks
kernel-bug-exists-upstream ** Tags added: kernel-bug-exists-upstream -- You received this bug notification because you are a member of Kernel Packages, which is subscribed to linux in Ubuntu. https://bugs.launchpad.net/bugs/1653498 Title: Server reboots every 4.1 weeks Status in linux package in Ubuntu: Confirmed Status in linux source package in Xenial: Confirmed Bug description: Every 4.1 uptime weeks (more or less), our 34 servers reboots with the logs below. Description:Ubuntu 16.04.1 LTS Release:16.04 The servers hosts the stack flanneld (0.5.5) docker (1.11.2, build b9f10c9) kubernetes (v1.3.6) plus etcd (2.3.7) Jan 02 06:40:32 prd-node021 kernel: [ cut here ] Jan 02 06:40:32 prd-node021 kernel: kernel BUG at /build/linux-xHzv4a/linux-4.4.0/include/linux/fs.h:2569! Jan 02 06:40:32 prd-node021 kernel: invalid opcode: [#1] SMP Jan 02 06:40:32 prd-node021 kernel: Modules linked in: nf_conntrack_netlink nfnetlink veth xt_statistic xt_nat xt_recent ipt_REJECT nf_reject_ipv4 xt_tcpudp tcp_diag inet_diag Jan 02 06:40:32 prd-node021 kernel: raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc Jan 02 06:40:32 prd-node021 kernel: CPU: 46 PID: 22749 Comm: iptables-restor Not tainted 4.4.0-47-generic #68-Ubuntu Jan 02 06:40:32 prd-node021 kernel: Hardware name: HP ProLiant DL360 Gen9/ProLiant DL360 Gen9, BIOS P89 09/13/2016 Jan 02 06:40:32 prd-node021 kernel: task: 882f7ccb44c0 ti: 882fcb81 task.ti: 882fcb81 Jan 02 06:40:32 prd-node021 kernel: RIP: 0010:[] [] __fput+0x21d/0x220 Jan 02 06:40:32 prd-node021 kernel: RSP: 0018:882fcb813e68 EFLAGS: 00010246 Jan 02 06:40:32 prd-node021 kernel: RAX: RBX: 8829dbd92700 RCX: 308c6396 Jan 02 06:40:32 prd-node021 kernel: RDX: 0001 RSI: 88301f299f60 RDI: Jan 02 06:40:32 prd-node021 kernel: RBP: 882fcb813ea0 R08: 00019f60 R09: 811b3a1d Jan 02 06:40:32 prd-node021 kernel: R10: ea0064756680 R11: 8829dbd92710 R12: 0010 Jan 02 06:40:32 prd-node021 kernel: R13: 8817d3520518 R14: 881021a34da0 R15: 8817d3542540 Jan 02 06:40:32 prd-node021 kernel: FS: 7fcdaa753700() GS:88301f28() knlGS: Jan 02 06:40:32 prd-node021 kernel: CS: 0010 DS: ES: CR0: 80050033 Jan 02 06:40:32 prd-node021 kernel: CR2: 7fcdaa758000 CR3: 001917993000 CR4: 003406e0 Jan 02 06:40:32 prd-node021 kernel: DR0: DR1: DR2: Jan 02 06:40:32 prd-node021 kernel: DR3: DR6: fffe0ff0 DR7: 0400 Jan 02 06:40:32 prd-node021 kernel: Stack: Jan 02 06:40:32 prd-node021 kernel: 8817d3520518 8829dbd92710 882f7ccb44c0 82103a30 Jan 02 06:40:32 prd-node021 kernel: 8829dbd92700 882f7ccb4b38 882fcb813eb0 Jan 02 06:40:32 prd-node021 kernel: 8120fa2e 882fcb813ef0 8109ee01 882f7ccb4b6c Jan 02 06:40:32 prd-node021 kernel: Call Trace: Jan 02 06:40:32 prd-node021 kernel: [] fput+0xe/0x10 Jan 02 06:40:32 prd-node021 kernel: [] task_work_run+0x81/0xa0 Jan 02 06:40:32 prd-node021 kernel: [] exit_to_usermode_loop+0xc2/0xd0 Jan 02 06:40:32 prd-node021 kernel: [] syscall_return_slowpath+0x4e/0x60 Jan 02 06:40:32 prd-node021 kernel: [] int_ret_from_sys_call+0x25/0x8f Jan 02 06:40:32 prd-node021 kernel: Code: 0f 84 cf fe ff ff 48 8b 43 28 48 8b 80 80 00 00 00 48 85 c0 0f 84 bb fe ff ff 31 d2 48 89 de bf ff ff ff ff ff d0 e9 aa fe ff ff <0f> Jan 02 06:40:32 prd-node021 kernel: RIP [] __fput+0x21d/0x220 -- Reboot -- Jan 02 06:42:56 prd-node021 systemd-journald[819]: Runtime journal (/run/log/journal/) is 8.0M, max 1.8G, 1.8G free. Jan 02 06:42:56 prd-node021 kernel: Initializing cgroup subsys cpuset ProblemType: Bug DistroRelease: Ubuntu 16.04 Package: linux-image-4.4.0-47-generic 4.4.0-47.68 ProcVersionSignature: Ubuntu 4.4.0-47.68-generic 4.4.24 Uname: Linux 4.4.0-47-generic x86_64 AlsaDevices: total 0 crw-rw 1 root audio 116, 1 Jan 2 06:42 seq crw-rw 1 root audio 116, 33 Jan 2 06:42 timer AplayDevices: Error: [Errno 2] No such file or directory: 'aplay' ApportVersion: 2.20.1-0ubuntu2.1 Architecture: amd64 ArecordDevices: Error: [Errno 2] No such file or directory: 'arecord' AudioDevicesInUse: Error: command ['fuser', '-v', '/dev/snd/seq', '/dev/snd/timer'] failed with exit code 1: Date: Mon Jan 2 10:49:15 2017 HibernationDevice: RESUME=/dev/mapper/vg00-swap InstallationDate: Installed on 2016-09-13 (110 days ago) InstallationMedia: Ubuntu-Server 16.04.1 LTS "Xenial Xerus" - Beta amd64 (20160803) IwConfig: Error: [Errno 2] No such file or directory: 'iwconfig'
[Kernel-packages] [Bug 1653498] Re: Server reboots every 4.1 weeks
The server with kernel 4.9.2 reboots after 2.874 weeks. -- You received this bug notification because you are a member of Kernel Packages, which is subscribed to linux in Ubuntu. https://bugs.launchpad.net/bugs/1653498 Title: Server reboots every 4.1 weeks Status in linux package in Ubuntu: Confirmed Status in linux source package in Xenial: Confirmed Bug description: Every 4.1 uptime weeks (more or less), our 34 servers reboots with the logs below. Description:Ubuntu 16.04.1 LTS Release:16.04 The servers hosts the stack flanneld (0.5.5) docker (1.11.2, build b9f10c9) kubernetes (v1.3.6) plus etcd (2.3.7) Jan 02 06:40:32 prd-node021 kernel: [ cut here ] Jan 02 06:40:32 prd-node021 kernel: kernel BUG at /build/linux-xHzv4a/linux-4.4.0/include/linux/fs.h:2569! Jan 02 06:40:32 prd-node021 kernel: invalid opcode: [#1] SMP Jan 02 06:40:32 prd-node021 kernel: Modules linked in: nf_conntrack_netlink nfnetlink veth xt_statistic xt_nat xt_recent ipt_REJECT nf_reject_ipv4 xt_tcpudp tcp_diag inet_diag Jan 02 06:40:32 prd-node021 kernel: raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc Jan 02 06:40:32 prd-node021 kernel: CPU: 46 PID: 22749 Comm: iptables-restor Not tainted 4.4.0-47-generic #68-Ubuntu Jan 02 06:40:32 prd-node021 kernel: Hardware name: HP ProLiant DL360 Gen9/ProLiant DL360 Gen9, BIOS P89 09/13/2016 Jan 02 06:40:32 prd-node021 kernel: task: 882f7ccb44c0 ti: 882fcb81 task.ti: 882fcb81 Jan 02 06:40:32 prd-node021 kernel: RIP: 0010:[] [] __fput+0x21d/0x220 Jan 02 06:40:32 prd-node021 kernel: RSP: 0018:882fcb813e68 EFLAGS: 00010246 Jan 02 06:40:32 prd-node021 kernel: RAX: RBX: 8829dbd92700 RCX: 308c6396 Jan 02 06:40:32 prd-node021 kernel: RDX: 0001 RSI: 88301f299f60 RDI: Jan 02 06:40:32 prd-node021 kernel: RBP: 882fcb813ea0 R08: 00019f60 R09: 811b3a1d Jan 02 06:40:32 prd-node021 kernel: R10: ea0064756680 R11: 8829dbd92710 R12: 0010 Jan 02 06:40:32 prd-node021 kernel: R13: 8817d3520518 R14: 881021a34da0 R15: 8817d3542540 Jan 02 06:40:32 prd-node021 kernel: FS: 7fcdaa753700() GS:88301f28() knlGS: Jan 02 06:40:32 prd-node021 kernel: CS: 0010 DS: ES: CR0: 80050033 Jan 02 06:40:32 prd-node021 kernel: CR2: 7fcdaa758000 CR3: 001917993000 CR4: 003406e0 Jan 02 06:40:32 prd-node021 kernel: DR0: DR1: DR2: Jan 02 06:40:32 prd-node021 kernel: DR3: DR6: fffe0ff0 DR7: 0400 Jan 02 06:40:32 prd-node021 kernel: Stack: Jan 02 06:40:32 prd-node021 kernel: 8817d3520518 8829dbd92710 882f7ccb44c0 82103a30 Jan 02 06:40:32 prd-node021 kernel: 8829dbd92700 882f7ccb4b38 882fcb813eb0 Jan 02 06:40:32 prd-node021 kernel: 8120fa2e 882fcb813ef0 8109ee01 882f7ccb4b6c Jan 02 06:40:32 prd-node021 kernel: Call Trace: Jan 02 06:40:32 prd-node021 kernel: [] fput+0xe/0x10 Jan 02 06:40:32 prd-node021 kernel: [] task_work_run+0x81/0xa0 Jan 02 06:40:32 prd-node021 kernel: [] exit_to_usermode_loop+0xc2/0xd0 Jan 02 06:40:32 prd-node021 kernel: [] syscall_return_slowpath+0x4e/0x60 Jan 02 06:40:32 prd-node021 kernel: [] int_ret_from_sys_call+0x25/0x8f Jan 02 06:40:32 prd-node021 kernel: Code: 0f 84 cf fe ff ff 48 8b 43 28 48 8b 80 80 00 00 00 48 85 c0 0f 84 bb fe ff ff 31 d2 48 89 de bf ff ff ff ff ff d0 e9 aa fe ff ff <0f> Jan 02 06:40:32 prd-node021 kernel: RIP [] __fput+0x21d/0x220 -- Reboot -- Jan 02 06:42:56 prd-node021 systemd-journald[819]: Runtime journal (/run/log/journal/) is 8.0M, max 1.8G, 1.8G free. Jan 02 06:42:56 prd-node021 kernel: Initializing cgroup subsys cpuset ProblemType: Bug DistroRelease: Ubuntu 16.04 Package: linux-image-4.4.0-47-generic 4.4.0-47.68 ProcVersionSignature: Ubuntu 4.4.0-47.68-generic 4.4.24 Uname: Linux 4.4.0-47-generic x86_64 AlsaDevices: total 0 crw-rw 1 root audio 116, 1 Jan 2 06:42 seq crw-rw 1 root audio 116, 33 Jan 2 06:42 timer AplayDevices: Error: [Errno 2] No such file or directory: 'aplay' ApportVersion: 2.20.1-0ubuntu2.1 Architecture: amd64 ArecordDevices: Error: [Errno 2] No such file or directory: 'arecord' AudioDevicesInUse: Error: command ['fuser', '-v', '/dev/snd/seq', '/dev/snd/timer'] failed with exit code 1: Date: Mon Jan 2 10:49:15 2017 HibernationDevice: RESUME=/dev/mapper/vg00-swap InstallationDate: Installed on 2016-09-13 (110 days ago) InstallationMedia: Ubuntu-Server 16.04.1 LTS "Xenial Xerus" - Beta amd64 (20160803) IwConfig: Error: [Errno 2] No such file or directory: 'iwconfig' MachineType: HP
[Kernel-packages] [Bug 1653498] Re: Server reboots every 4.1 weeks
We installed the 4.9.2 kernel a few days ago. We are still waiting for crash :) For now, we have more or less 3.1 weeks of uptime. I'll keep you posted. -- You received this bug notification because you are a member of Kernel Packages, which is subscribed to linux in Ubuntu. https://bugs.launchpad.net/bugs/1653498 Title: Server reboots every 4.1 weeks Status in linux package in Ubuntu: Confirmed Status in linux source package in Xenial: Confirmed Bug description: Every 4.1 uptime weeks (more or less), our 34 servers reboots with the logs below. Description:Ubuntu 16.04.1 LTS Release:16.04 The servers hosts the stack flanneld (0.5.5) docker (1.11.2, build b9f10c9) kubernetes (v1.3.6) plus etcd (2.3.7) Jan 02 06:40:32 prd-node021 kernel: [ cut here ] Jan 02 06:40:32 prd-node021 kernel: kernel BUG at /build/linux-xHzv4a/linux-4.4.0/include/linux/fs.h:2569! Jan 02 06:40:32 prd-node021 kernel: invalid opcode: [#1] SMP Jan 02 06:40:32 prd-node021 kernel: Modules linked in: nf_conntrack_netlink nfnetlink veth xt_statistic xt_nat xt_recent ipt_REJECT nf_reject_ipv4 xt_tcpudp tcp_diag inet_diag Jan 02 06:40:32 prd-node021 kernel: raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc Jan 02 06:40:32 prd-node021 kernel: CPU: 46 PID: 22749 Comm: iptables-restor Not tainted 4.4.0-47-generic #68-Ubuntu Jan 02 06:40:32 prd-node021 kernel: Hardware name: HP ProLiant DL360 Gen9/ProLiant DL360 Gen9, BIOS P89 09/13/2016 Jan 02 06:40:32 prd-node021 kernel: task: 882f7ccb44c0 ti: 882fcb81 task.ti: 882fcb81 Jan 02 06:40:32 prd-node021 kernel: RIP: 0010:[] [] __fput+0x21d/0x220 Jan 02 06:40:32 prd-node021 kernel: RSP: 0018:882fcb813e68 EFLAGS: 00010246 Jan 02 06:40:32 prd-node021 kernel: RAX: RBX: 8829dbd92700 RCX: 308c6396 Jan 02 06:40:32 prd-node021 kernel: RDX: 0001 RSI: 88301f299f60 RDI: Jan 02 06:40:32 prd-node021 kernel: RBP: 882fcb813ea0 R08: 00019f60 R09: 811b3a1d Jan 02 06:40:32 prd-node021 kernel: R10: ea0064756680 R11: 8829dbd92710 R12: 0010 Jan 02 06:40:32 prd-node021 kernel: R13: 8817d3520518 R14: 881021a34da0 R15: 8817d3542540 Jan 02 06:40:32 prd-node021 kernel: FS: 7fcdaa753700() GS:88301f28() knlGS: Jan 02 06:40:32 prd-node021 kernel: CS: 0010 DS: ES: CR0: 80050033 Jan 02 06:40:32 prd-node021 kernel: CR2: 7fcdaa758000 CR3: 001917993000 CR4: 003406e0 Jan 02 06:40:32 prd-node021 kernel: DR0: DR1: DR2: Jan 02 06:40:32 prd-node021 kernel: DR3: DR6: fffe0ff0 DR7: 0400 Jan 02 06:40:32 prd-node021 kernel: Stack: Jan 02 06:40:32 prd-node021 kernel: 8817d3520518 8829dbd92710 882f7ccb44c0 82103a30 Jan 02 06:40:32 prd-node021 kernel: 8829dbd92700 882f7ccb4b38 882fcb813eb0 Jan 02 06:40:32 prd-node021 kernel: 8120fa2e 882fcb813ef0 8109ee01 882f7ccb4b6c Jan 02 06:40:32 prd-node021 kernel: Call Trace: Jan 02 06:40:32 prd-node021 kernel: [] fput+0xe/0x10 Jan 02 06:40:32 prd-node021 kernel: [] task_work_run+0x81/0xa0 Jan 02 06:40:32 prd-node021 kernel: [] exit_to_usermode_loop+0xc2/0xd0 Jan 02 06:40:32 prd-node021 kernel: [] syscall_return_slowpath+0x4e/0x60 Jan 02 06:40:32 prd-node021 kernel: [] int_ret_from_sys_call+0x25/0x8f Jan 02 06:40:32 prd-node021 kernel: Code: 0f 84 cf fe ff ff 48 8b 43 28 48 8b 80 80 00 00 00 48 85 c0 0f 84 bb fe ff ff 31 d2 48 89 de bf ff ff ff ff ff d0 e9 aa fe ff ff <0f> Jan 02 06:40:32 prd-node021 kernel: RIP [] __fput+0x21d/0x220 -- Reboot -- Jan 02 06:42:56 prd-node021 systemd-journald[819]: Runtime journal (/run/log/journal/) is 8.0M, max 1.8G, 1.8G free. Jan 02 06:42:56 prd-node021 kernel: Initializing cgroup subsys cpuset ProblemType: Bug DistroRelease: Ubuntu 16.04 Package: linux-image-4.4.0-47-generic 4.4.0-47.68 ProcVersionSignature: Ubuntu 4.4.0-47.68-generic 4.4.24 Uname: Linux 4.4.0-47-generic x86_64 AlsaDevices: total 0 crw-rw 1 root audio 116, 1 Jan 2 06:42 seq crw-rw 1 root audio 116, 33 Jan 2 06:42 timer AplayDevices: Error: [Errno 2] No such file or directory: 'aplay' ApportVersion: 2.20.1-0ubuntu2.1 Architecture: amd64 ArecordDevices: Error: [Errno 2] No such file or directory: 'arecord' AudioDevicesInUse: Error: command ['fuser', '-v', '/dev/snd/seq', '/dev/snd/timer'] failed with exit code 1: Date: Mon Jan 2 10:49:15 2017 HibernationDevice: RESUME=/dev/mapper/vg00-swap InstallationDate: Installed on 2016-09-13 (110 days ago) InstallationMedia: Ubuntu-Server 16.04.1 LTS "Xenial Xerus" - Beta amd64
[Kernel-packages] [Bug 1653498] Re: Server reboots every 4.1 weeks
What is the latest on this. We are running into a similar problem with kubernetes only the most recent occurrence was in 13 days. Did upgrading the kernel to 4.9.2 work? -- You received this bug notification because you are a member of Kernel Packages, which is subscribed to linux in Ubuntu. https://bugs.launchpad.net/bugs/1653498 Title: Server reboots every 4.1 weeks Status in linux package in Ubuntu: Confirmed Status in linux source package in Xenial: Confirmed Bug description: Every 4.1 uptime weeks (more or less), our 34 servers reboots with the logs below. Description:Ubuntu 16.04.1 LTS Release:16.04 The servers hosts the stack flanneld (0.5.5) docker (1.11.2, build b9f10c9) kubernetes (v1.3.6) plus etcd (2.3.7) Jan 02 06:40:32 prd-node021 kernel: [ cut here ] Jan 02 06:40:32 prd-node021 kernel: kernel BUG at /build/linux-xHzv4a/linux-4.4.0/include/linux/fs.h:2569! Jan 02 06:40:32 prd-node021 kernel: invalid opcode: [#1] SMP Jan 02 06:40:32 prd-node021 kernel: Modules linked in: nf_conntrack_netlink nfnetlink veth xt_statistic xt_nat xt_recent ipt_REJECT nf_reject_ipv4 xt_tcpudp tcp_diag inet_diag Jan 02 06:40:32 prd-node021 kernel: raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc Jan 02 06:40:32 prd-node021 kernel: CPU: 46 PID: 22749 Comm: iptables-restor Not tainted 4.4.0-47-generic #68-Ubuntu Jan 02 06:40:32 prd-node021 kernel: Hardware name: HP ProLiant DL360 Gen9/ProLiant DL360 Gen9, BIOS P89 09/13/2016 Jan 02 06:40:32 prd-node021 kernel: task: 882f7ccb44c0 ti: 882fcb81 task.ti: 882fcb81 Jan 02 06:40:32 prd-node021 kernel: RIP: 0010:[] [] __fput+0x21d/0x220 Jan 02 06:40:32 prd-node021 kernel: RSP: 0018:882fcb813e68 EFLAGS: 00010246 Jan 02 06:40:32 prd-node021 kernel: RAX: RBX: 8829dbd92700 RCX: 308c6396 Jan 02 06:40:32 prd-node021 kernel: RDX: 0001 RSI: 88301f299f60 RDI: Jan 02 06:40:32 prd-node021 kernel: RBP: 882fcb813ea0 R08: 00019f60 R09: 811b3a1d Jan 02 06:40:32 prd-node021 kernel: R10: ea0064756680 R11: 8829dbd92710 R12: 0010 Jan 02 06:40:32 prd-node021 kernel: R13: 8817d3520518 R14: 881021a34da0 R15: 8817d3542540 Jan 02 06:40:32 prd-node021 kernel: FS: 7fcdaa753700() GS:88301f28() knlGS: Jan 02 06:40:32 prd-node021 kernel: CS: 0010 DS: ES: CR0: 80050033 Jan 02 06:40:32 prd-node021 kernel: CR2: 7fcdaa758000 CR3: 001917993000 CR4: 003406e0 Jan 02 06:40:32 prd-node021 kernel: DR0: DR1: DR2: Jan 02 06:40:32 prd-node021 kernel: DR3: DR6: fffe0ff0 DR7: 0400 Jan 02 06:40:32 prd-node021 kernel: Stack: Jan 02 06:40:32 prd-node021 kernel: 8817d3520518 8829dbd92710 882f7ccb44c0 82103a30 Jan 02 06:40:32 prd-node021 kernel: 8829dbd92700 882f7ccb4b38 882fcb813eb0 Jan 02 06:40:32 prd-node021 kernel: 8120fa2e 882fcb813ef0 8109ee01 882f7ccb4b6c Jan 02 06:40:32 prd-node021 kernel: Call Trace: Jan 02 06:40:32 prd-node021 kernel: [] fput+0xe/0x10 Jan 02 06:40:32 prd-node021 kernel: [] task_work_run+0x81/0xa0 Jan 02 06:40:32 prd-node021 kernel: [] exit_to_usermode_loop+0xc2/0xd0 Jan 02 06:40:32 prd-node021 kernel: [] syscall_return_slowpath+0x4e/0x60 Jan 02 06:40:32 prd-node021 kernel: [] int_ret_from_sys_call+0x25/0x8f Jan 02 06:40:32 prd-node021 kernel: Code: 0f 84 cf fe ff ff 48 8b 43 28 48 8b 80 80 00 00 00 48 85 c0 0f 84 bb fe ff ff 31 d2 48 89 de bf ff ff ff ff ff d0 e9 aa fe ff ff <0f> Jan 02 06:40:32 prd-node021 kernel: RIP [] __fput+0x21d/0x220 -- Reboot -- Jan 02 06:42:56 prd-node021 systemd-journald[819]: Runtime journal (/run/log/journal/) is 8.0M, max 1.8G, 1.8G free. Jan 02 06:42:56 prd-node021 kernel: Initializing cgroup subsys cpuset ProblemType: Bug DistroRelease: Ubuntu 16.04 Package: linux-image-4.4.0-47-generic 4.4.0-47.68 ProcVersionSignature: Ubuntu 4.4.0-47.68-generic 4.4.24 Uname: Linux 4.4.0-47-generic x86_64 AlsaDevices: total 0 crw-rw 1 root audio 116, 1 Jan 2 06:42 seq crw-rw 1 root audio 116, 33 Jan 2 06:42 timer AplayDevices: Error: [Errno 2] No such file or directory: 'aplay' ApportVersion: 2.20.1-0ubuntu2.1 Architecture: amd64 ArecordDevices: Error: [Errno 2] No such file or directory: 'arecord' AudioDevicesInUse: Error: command ['fuser', '-v', '/dev/snd/seq', '/dev/snd/timer'] failed with exit code 1: Date: Mon Jan 2 10:49:15 2017 HibernationDevice: RESUME=/dev/mapper/vg00-swap InstallationDate: Installed on 2016-09-13 (110 days ago) InstallationMedia: Ubuntu-Server 16.04.1 LTS "Xenial
[Kernel-packages] [Bug 1653498] Re: Server reboots every 4.1 weeks
In the meantime, I compiled the upstream 4.9.2 kernel + ubuntu patches + aufs Let me know if make sense the test with this kernel version -- You received this bug notification because you are a member of Kernel Packages, which is subscribed to linux in Ubuntu. https://bugs.launchpad.net/bugs/1653498 Title: Server reboots every 4.1 weeks Status in linux package in Ubuntu: Confirmed Status in linux source package in Xenial: Confirmed Bug description: Every 4.1 uptime weeks (more or less), our 34 servers reboots with the logs below. Description:Ubuntu 16.04.1 LTS Release:16.04 The servers hosts the stack flanneld (0.5.5) docker (1.11.2, build b9f10c9) kubernetes (v1.3.6) plus etcd (2.3.7) Jan 02 06:40:32 prd-node021 kernel: [ cut here ] Jan 02 06:40:32 prd-node021 kernel: kernel BUG at /build/linux-xHzv4a/linux-4.4.0/include/linux/fs.h:2569! Jan 02 06:40:32 prd-node021 kernel: invalid opcode: [#1] SMP Jan 02 06:40:32 prd-node021 kernel: Modules linked in: nf_conntrack_netlink nfnetlink veth xt_statistic xt_nat xt_recent ipt_REJECT nf_reject_ipv4 xt_tcpudp tcp_diag inet_diag Jan 02 06:40:32 prd-node021 kernel: raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc Jan 02 06:40:32 prd-node021 kernel: CPU: 46 PID: 22749 Comm: iptables-restor Not tainted 4.4.0-47-generic #68-Ubuntu Jan 02 06:40:32 prd-node021 kernel: Hardware name: HP ProLiant DL360 Gen9/ProLiant DL360 Gen9, BIOS P89 09/13/2016 Jan 02 06:40:32 prd-node021 kernel: task: 882f7ccb44c0 ti: 882fcb81 task.ti: 882fcb81 Jan 02 06:40:32 prd-node021 kernel: RIP: 0010:[] [] __fput+0x21d/0x220 Jan 02 06:40:32 prd-node021 kernel: RSP: 0018:882fcb813e68 EFLAGS: 00010246 Jan 02 06:40:32 prd-node021 kernel: RAX: RBX: 8829dbd92700 RCX: 308c6396 Jan 02 06:40:32 prd-node021 kernel: RDX: 0001 RSI: 88301f299f60 RDI: Jan 02 06:40:32 prd-node021 kernel: RBP: 882fcb813ea0 R08: 00019f60 R09: 811b3a1d Jan 02 06:40:32 prd-node021 kernel: R10: ea0064756680 R11: 8829dbd92710 R12: 0010 Jan 02 06:40:32 prd-node021 kernel: R13: 8817d3520518 R14: 881021a34da0 R15: 8817d3542540 Jan 02 06:40:32 prd-node021 kernel: FS: 7fcdaa753700() GS:88301f28() knlGS: Jan 02 06:40:32 prd-node021 kernel: CS: 0010 DS: ES: CR0: 80050033 Jan 02 06:40:32 prd-node021 kernel: CR2: 7fcdaa758000 CR3: 001917993000 CR4: 003406e0 Jan 02 06:40:32 prd-node021 kernel: DR0: DR1: DR2: Jan 02 06:40:32 prd-node021 kernel: DR3: DR6: fffe0ff0 DR7: 0400 Jan 02 06:40:32 prd-node021 kernel: Stack: Jan 02 06:40:32 prd-node021 kernel: 8817d3520518 8829dbd92710 882f7ccb44c0 82103a30 Jan 02 06:40:32 prd-node021 kernel: 8829dbd92700 882f7ccb4b38 882fcb813eb0 Jan 02 06:40:32 prd-node021 kernel: 8120fa2e 882fcb813ef0 8109ee01 882f7ccb4b6c Jan 02 06:40:32 prd-node021 kernel: Call Trace: Jan 02 06:40:32 prd-node021 kernel: [] fput+0xe/0x10 Jan 02 06:40:32 prd-node021 kernel: [] task_work_run+0x81/0xa0 Jan 02 06:40:32 prd-node021 kernel: [] exit_to_usermode_loop+0xc2/0xd0 Jan 02 06:40:32 prd-node021 kernel: [] syscall_return_slowpath+0x4e/0x60 Jan 02 06:40:32 prd-node021 kernel: [] int_ret_from_sys_call+0x25/0x8f Jan 02 06:40:32 prd-node021 kernel: Code: 0f 84 cf fe ff ff 48 8b 43 28 48 8b 80 80 00 00 00 48 85 c0 0f 84 bb fe ff ff 31 d2 48 89 de bf ff ff ff ff ff d0 e9 aa fe ff ff <0f> Jan 02 06:40:32 prd-node021 kernel: RIP [] __fput+0x21d/0x220 -- Reboot -- Jan 02 06:42:56 prd-node021 systemd-journald[819]: Runtime journal (/run/log/journal/) is 8.0M, max 1.8G, 1.8G free. Jan 02 06:42:56 prd-node021 kernel: Initializing cgroup subsys cpuset ProblemType: Bug DistroRelease: Ubuntu 16.04 Package: linux-image-4.4.0-47-generic 4.4.0-47.68 ProcVersionSignature: Ubuntu 4.4.0-47.68-generic 4.4.24 Uname: Linux 4.4.0-47-generic x86_64 AlsaDevices: total 0 crw-rw 1 root audio 116, 1 Jan 2 06:42 seq crw-rw 1 root audio 116, 33 Jan 2 06:42 timer AplayDevices: Error: [Errno 2] No such file or directory: 'aplay' ApportVersion: 2.20.1-0ubuntu2.1 Architecture: amd64 ArecordDevices: Error: [Errno 2] No such file or directory: 'arecord' AudioDevicesInUse: Error: command ['fuser', '-v', '/dev/snd/seq', '/dev/snd/timer'] failed with exit code 1: Date: Mon Jan 2 10:49:15 2017 HibernationDevice: RESUME=/dev/mapper/vg00-swap InstallationDate: Installed on 2016-09-13 (110 days ago) InstallationMedia: Ubuntu-Server 16.04.1 LTS "Xenial Xerus" - Beta amd64 (20160803)
[Kernel-packages] [Bug 1653498] Re: Server reboots every 4.1 weeks
Hi Joseph Salisbury I installed the upstream kernel but this kernel AUFS miss the support that's needed by our stack. I also tried to compile the kernel with the upstream AUFS but the online AUFS is too old and patches do not apply correctly and the process goes in error. I dunno if make sense to try some older kernel v4.8 or v4.9 (if the compile works... ) -- You received this bug notification because you are a member of Kernel Packages, which is subscribed to linux in Ubuntu. https://bugs.launchpad.net/bugs/1653498 Title: Server reboots every 4.1 weeks Status in linux package in Ubuntu: Confirmed Status in linux source package in Xenial: Confirmed Bug description: Every 4.1 uptime weeks (more or less), our 34 servers reboots with the logs below. Description:Ubuntu 16.04.1 LTS Release:16.04 The servers hosts the stack flanneld (0.5.5) docker (1.11.2, build b9f10c9) kubernetes (v1.3.6) plus etcd (2.3.7) Jan 02 06:40:32 prd-node021 kernel: [ cut here ] Jan 02 06:40:32 prd-node021 kernel: kernel BUG at /build/linux-xHzv4a/linux-4.4.0/include/linux/fs.h:2569! Jan 02 06:40:32 prd-node021 kernel: invalid opcode: [#1] SMP Jan 02 06:40:32 prd-node021 kernel: Modules linked in: nf_conntrack_netlink nfnetlink veth xt_statistic xt_nat xt_recent ipt_REJECT nf_reject_ipv4 xt_tcpudp tcp_diag inet_diag Jan 02 06:40:32 prd-node021 kernel: raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc Jan 02 06:40:32 prd-node021 kernel: CPU: 46 PID: 22749 Comm: iptables-restor Not tainted 4.4.0-47-generic #68-Ubuntu Jan 02 06:40:32 prd-node021 kernel: Hardware name: HP ProLiant DL360 Gen9/ProLiant DL360 Gen9, BIOS P89 09/13/2016 Jan 02 06:40:32 prd-node021 kernel: task: 882f7ccb44c0 ti: 882fcb81 task.ti: 882fcb81 Jan 02 06:40:32 prd-node021 kernel: RIP: 0010:[] [] __fput+0x21d/0x220 Jan 02 06:40:32 prd-node021 kernel: RSP: 0018:882fcb813e68 EFLAGS: 00010246 Jan 02 06:40:32 prd-node021 kernel: RAX: RBX: 8829dbd92700 RCX: 308c6396 Jan 02 06:40:32 prd-node021 kernel: RDX: 0001 RSI: 88301f299f60 RDI: Jan 02 06:40:32 prd-node021 kernel: RBP: 882fcb813ea0 R08: 00019f60 R09: 811b3a1d Jan 02 06:40:32 prd-node021 kernel: R10: ea0064756680 R11: 8829dbd92710 R12: 0010 Jan 02 06:40:32 prd-node021 kernel: R13: 8817d3520518 R14: 881021a34da0 R15: 8817d3542540 Jan 02 06:40:32 prd-node021 kernel: FS: 7fcdaa753700() GS:88301f28() knlGS: Jan 02 06:40:32 prd-node021 kernel: CS: 0010 DS: ES: CR0: 80050033 Jan 02 06:40:32 prd-node021 kernel: CR2: 7fcdaa758000 CR3: 001917993000 CR4: 003406e0 Jan 02 06:40:32 prd-node021 kernel: DR0: DR1: DR2: Jan 02 06:40:32 prd-node021 kernel: DR3: DR6: fffe0ff0 DR7: 0400 Jan 02 06:40:32 prd-node021 kernel: Stack: Jan 02 06:40:32 prd-node021 kernel: 8817d3520518 8829dbd92710 882f7ccb44c0 82103a30 Jan 02 06:40:32 prd-node021 kernel: 8829dbd92700 882f7ccb4b38 882fcb813eb0 Jan 02 06:40:32 prd-node021 kernel: 8120fa2e 882fcb813ef0 8109ee01 882f7ccb4b6c Jan 02 06:40:32 prd-node021 kernel: Call Trace: Jan 02 06:40:32 prd-node021 kernel: [] fput+0xe/0x10 Jan 02 06:40:32 prd-node021 kernel: [] task_work_run+0x81/0xa0 Jan 02 06:40:32 prd-node021 kernel: [] exit_to_usermode_loop+0xc2/0xd0 Jan 02 06:40:32 prd-node021 kernel: [] syscall_return_slowpath+0x4e/0x60 Jan 02 06:40:32 prd-node021 kernel: [] int_ret_from_sys_call+0x25/0x8f Jan 02 06:40:32 prd-node021 kernel: Code: 0f 84 cf fe ff ff 48 8b 43 28 48 8b 80 80 00 00 00 48 85 c0 0f 84 bb fe ff ff 31 d2 48 89 de bf ff ff ff ff ff d0 e9 aa fe ff ff <0f> Jan 02 06:40:32 prd-node021 kernel: RIP [] __fput+0x21d/0x220 -- Reboot -- Jan 02 06:42:56 prd-node021 systemd-journald[819]: Runtime journal (/run/log/journal/) is 8.0M, max 1.8G, 1.8G free. Jan 02 06:42:56 prd-node021 kernel: Initializing cgroup subsys cpuset ProblemType: Bug DistroRelease: Ubuntu 16.04 Package: linux-image-4.4.0-47-generic 4.4.0-47.68 ProcVersionSignature: Ubuntu 4.4.0-47.68-generic 4.4.24 Uname: Linux 4.4.0-47-generic x86_64 AlsaDevices: total 0 crw-rw 1 root audio 116, 1 Jan 2 06:42 seq crw-rw 1 root audio 116, 33 Jan 2 06:42 timer AplayDevices: Error: [Errno 2] No such file or directory: 'aplay' ApportVersion: 2.20.1-0ubuntu2.1 Architecture: amd64 ArecordDevices: Error: [Errno 2] No such file or directory: 'arecord' AudioDevicesInUse: Error: command ['fuser', '-v', '/dev/snd/seq', '/dev/snd/timer'] failed with exit code 1: Date:
[Kernel-packages] [Bug 1653498] Re: Server reboots every 4.1 weeks
Did this issue start happening after an update/upgrade? Was there a prior kernel version where you were not having this particular problem? Would it be possible for you to test the latest upstream kernel? Refer to https://wiki.ubuntu.com/KernelMainlineBuilds . Please test the latest v4.10 kernel[0]. If this bug is fixed in the mainline kernel, please add the following tag 'kernel-fixed-upstream'. If the mainline kernel does not fix this bug, please add the tag: 'kernel-bug-exists-upstream'. Once testing of the upstream kernel is complete, please mark this bug as "Confirmed". Thanks in advance. [0] http://kernel.ubuntu.com/~kernel-ppa/mainline/v4.10-rc2 ** Changed in: linux (Ubuntu) Importance: Undecided => High ** Also affects: linux (Ubuntu Xenial) Importance: Undecided Status: New ** Changed in: linux (Ubuntu Xenial) Importance: Undecided => High ** Changed in: linux (Ubuntu Xenial) Status: New => Confirmed -- You received this bug notification because you are a member of Kernel Packages, which is subscribed to linux in Ubuntu. https://bugs.launchpad.net/bugs/1653498 Title: Server reboots every 4.1 weeks Status in linux package in Ubuntu: Confirmed Status in linux source package in Xenial: Confirmed Bug description: Every 4.1 uptime weeks (more or less), our 34 servers reboots with the logs below. Description:Ubuntu 16.04.1 LTS Release:16.04 The servers hosts the stack flanneld (0.5.5) docker (1.11.2, build b9f10c9) kubernetes (v1.3.6) plus etcd (2.3.7) Jan 02 06:40:32 prd-node021 kernel: [ cut here ] Jan 02 06:40:32 prd-node021 kernel: kernel BUG at /build/linux-xHzv4a/linux-4.4.0/include/linux/fs.h:2569! Jan 02 06:40:32 prd-node021 kernel: invalid opcode: [#1] SMP Jan 02 06:40:32 prd-node021 kernel: Modules linked in: nf_conntrack_netlink nfnetlink veth xt_statistic xt_nat xt_recent ipt_REJECT nf_reject_ipv4 xt_tcpudp tcp_diag inet_diag Jan 02 06:40:32 prd-node021 kernel: raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc Jan 02 06:40:32 prd-node021 kernel: CPU: 46 PID: 22749 Comm: iptables-restor Not tainted 4.4.0-47-generic #68-Ubuntu Jan 02 06:40:32 prd-node021 kernel: Hardware name: HP ProLiant DL360 Gen9/ProLiant DL360 Gen9, BIOS P89 09/13/2016 Jan 02 06:40:32 prd-node021 kernel: task: 882f7ccb44c0 ti: 882fcb81 task.ti: 882fcb81 Jan 02 06:40:32 prd-node021 kernel: RIP: 0010:[] [] __fput+0x21d/0x220 Jan 02 06:40:32 prd-node021 kernel: RSP: 0018:882fcb813e68 EFLAGS: 00010246 Jan 02 06:40:32 prd-node021 kernel: RAX: RBX: 8829dbd92700 RCX: 308c6396 Jan 02 06:40:32 prd-node021 kernel: RDX: 0001 RSI: 88301f299f60 RDI: Jan 02 06:40:32 prd-node021 kernel: RBP: 882fcb813ea0 R08: 00019f60 R09: 811b3a1d Jan 02 06:40:32 prd-node021 kernel: R10: ea0064756680 R11: 8829dbd92710 R12: 0010 Jan 02 06:40:32 prd-node021 kernel: R13: 8817d3520518 R14: 881021a34da0 R15: 8817d3542540 Jan 02 06:40:32 prd-node021 kernel: FS: 7fcdaa753700() GS:88301f28() knlGS: Jan 02 06:40:32 prd-node021 kernel: CS: 0010 DS: ES: CR0: 80050033 Jan 02 06:40:32 prd-node021 kernel: CR2: 7fcdaa758000 CR3: 001917993000 CR4: 003406e0 Jan 02 06:40:32 prd-node021 kernel: DR0: DR1: DR2: Jan 02 06:40:32 prd-node021 kernel: DR3: DR6: fffe0ff0 DR7: 0400 Jan 02 06:40:32 prd-node021 kernel: Stack: Jan 02 06:40:32 prd-node021 kernel: 8817d3520518 8829dbd92710 882f7ccb44c0 82103a30 Jan 02 06:40:32 prd-node021 kernel: 8829dbd92700 882f7ccb4b38 882fcb813eb0 Jan 02 06:40:32 prd-node021 kernel: 8120fa2e 882fcb813ef0 8109ee01 882f7ccb4b6c Jan 02 06:40:32 prd-node021 kernel: Call Trace: Jan 02 06:40:32 prd-node021 kernel: [] fput+0xe/0x10 Jan 02 06:40:32 prd-node021 kernel: [] task_work_run+0x81/0xa0 Jan 02 06:40:32 prd-node021 kernel: [] exit_to_usermode_loop+0xc2/0xd0 Jan 02 06:40:32 prd-node021 kernel: [] syscall_return_slowpath+0x4e/0x60 Jan 02 06:40:32 prd-node021 kernel: [] int_ret_from_sys_call+0x25/0x8f Jan 02 06:40:32 prd-node021 kernel: Code: 0f 84 cf fe ff ff 48 8b 43 28 48 8b 80 80 00 00 00 48 85 c0 0f 84 bb fe ff ff 31 d2 48 89 de bf ff ff ff ff ff d0 e9 aa fe ff ff <0f> Jan 02 06:40:32 prd-node021 kernel: RIP [] __fput+0x21d/0x220 -- Reboot -- Jan 02 06:42:56 prd-node021 systemd-journald[819]: Runtime journal (/run/log/journal/) is 8.0M, max 1.8G, 1.8G free. Jan 02 06:42:56 prd-node021 kernel: Initializing cgroup subsys cpuset ProblemType: Bug DistroRelease: Ubuntu 16.04
[Kernel-packages] [Bug 1653498] Re: Server reboots every 4.1 weeks
I thought about this, but I've no idea which buffer fills -- You received this bug notification because you are a member of Kernel Packages, which is subscribed to linux in Ubuntu. https://bugs.launchpad.net/bugs/1653498 Title: Server reboots every 4.1 weeks Status in linux package in Ubuntu: Confirmed Bug description: Every 4.1 uptime weeks (more or less), our 34 servers reboots with the logs below. Description:Ubuntu 16.04.1 LTS Release:16.04 The servers hosts the stack flanneld (0.5.5) docker (1.11.2, build b9f10c9) kubernetes (v1.3.6) plus etcd (2.3.7) Jan 02 06:40:32 prd-node021 kernel: [ cut here ] Jan 02 06:40:32 prd-node021 kernel: kernel BUG at /build/linux-xHzv4a/linux-4.4.0/include/linux/fs.h:2569! Jan 02 06:40:32 prd-node021 kernel: invalid opcode: [#1] SMP Jan 02 06:40:32 prd-node021 kernel: Modules linked in: nf_conntrack_netlink nfnetlink veth xt_statistic xt_nat xt_recent ipt_REJECT nf_reject_ipv4 xt_tcpudp tcp_diag inet_diag Jan 02 06:40:32 prd-node021 kernel: raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc Jan 02 06:40:32 prd-node021 kernel: CPU: 46 PID: 22749 Comm: iptables-restor Not tainted 4.4.0-47-generic #68-Ubuntu Jan 02 06:40:32 prd-node021 kernel: Hardware name: HP ProLiant DL360 Gen9/ProLiant DL360 Gen9, BIOS P89 09/13/2016 Jan 02 06:40:32 prd-node021 kernel: task: 882f7ccb44c0 ti: 882fcb81 task.ti: 882fcb81 Jan 02 06:40:32 prd-node021 kernel: RIP: 0010:[] [] __fput+0x21d/0x220 Jan 02 06:40:32 prd-node021 kernel: RSP: 0018:882fcb813e68 EFLAGS: 00010246 Jan 02 06:40:32 prd-node021 kernel: RAX: RBX: 8829dbd92700 RCX: 308c6396 Jan 02 06:40:32 prd-node021 kernel: RDX: 0001 RSI: 88301f299f60 RDI: Jan 02 06:40:32 prd-node021 kernel: RBP: 882fcb813ea0 R08: 00019f60 R09: 811b3a1d Jan 02 06:40:32 prd-node021 kernel: R10: ea0064756680 R11: 8829dbd92710 R12: 0010 Jan 02 06:40:32 prd-node021 kernel: R13: 8817d3520518 R14: 881021a34da0 R15: 8817d3542540 Jan 02 06:40:32 prd-node021 kernel: FS: 7fcdaa753700() GS:88301f28() knlGS: Jan 02 06:40:32 prd-node021 kernel: CS: 0010 DS: ES: CR0: 80050033 Jan 02 06:40:32 prd-node021 kernel: CR2: 7fcdaa758000 CR3: 001917993000 CR4: 003406e0 Jan 02 06:40:32 prd-node021 kernel: DR0: DR1: DR2: Jan 02 06:40:32 prd-node021 kernel: DR3: DR6: fffe0ff0 DR7: 0400 Jan 02 06:40:32 prd-node021 kernel: Stack: Jan 02 06:40:32 prd-node021 kernel: 8817d3520518 8829dbd92710 882f7ccb44c0 82103a30 Jan 02 06:40:32 prd-node021 kernel: 8829dbd92700 882f7ccb4b38 882fcb813eb0 Jan 02 06:40:32 prd-node021 kernel: 8120fa2e 882fcb813ef0 8109ee01 882f7ccb4b6c Jan 02 06:40:32 prd-node021 kernel: Call Trace: Jan 02 06:40:32 prd-node021 kernel: [] fput+0xe/0x10 Jan 02 06:40:32 prd-node021 kernel: [] task_work_run+0x81/0xa0 Jan 02 06:40:32 prd-node021 kernel: [] exit_to_usermode_loop+0xc2/0xd0 Jan 02 06:40:32 prd-node021 kernel: [] syscall_return_slowpath+0x4e/0x60 Jan 02 06:40:32 prd-node021 kernel: [] int_ret_from_sys_call+0x25/0x8f Jan 02 06:40:32 prd-node021 kernel: Code: 0f 84 cf fe ff ff 48 8b 43 28 48 8b 80 80 00 00 00 48 85 c0 0f 84 bb fe ff ff 31 d2 48 89 de bf ff ff ff ff ff d0 e9 aa fe ff ff <0f> Jan 02 06:40:32 prd-node021 kernel: RIP [] __fput+0x21d/0x220 -- Reboot -- Jan 02 06:42:56 prd-node021 systemd-journald[819]: Runtime journal (/run/log/journal/) is 8.0M, max 1.8G, 1.8G free. Jan 02 06:42:56 prd-node021 kernel: Initializing cgroup subsys cpuset ProblemType: Bug DistroRelease: Ubuntu 16.04 Package: linux-image-4.4.0-47-generic 4.4.0-47.68 ProcVersionSignature: Ubuntu 4.4.0-47.68-generic 4.4.24 Uname: Linux 4.4.0-47-generic x86_64 AlsaDevices: total 0 crw-rw 1 root audio 116, 1 Jan 2 06:42 seq crw-rw 1 root audio 116, 33 Jan 2 06:42 timer AplayDevices: Error: [Errno 2] No such file or directory: 'aplay' ApportVersion: 2.20.1-0ubuntu2.1 Architecture: amd64 ArecordDevices: Error: [Errno 2] No such file or directory: 'arecord' AudioDevicesInUse: Error: command ['fuser', '-v', '/dev/snd/seq', '/dev/snd/timer'] failed with exit code 1: Date: Mon Jan 2 10:49:15 2017 HibernationDevice: RESUME=/dev/mapper/vg00-swap InstallationDate: Installed on 2016-09-13 (110 days ago) InstallationMedia: Ubuntu-Server 16.04.1 LTS "Xenial Xerus" - Beta amd64 (20160803) IwConfig: Error: [Errno 2] No such file or directory: 'iwconfig' MachineType: HP ProLiant DL360 Gen9 PciMultimedia: ProcFB: 0
[Kernel-packages] [Bug 1653498] Re: Server reboots every 4.1 weeks
A possible interesting data point is that /proc/interrupts CAL interrupts (Function call interrupts) are reaching a 32 bit wrap around. -- You received this bug notification because you are a member of Kernel Packages, which is subscribed to linux in Ubuntu. https://bugs.launchpad.net/bugs/1653498 Title: Server reboots every 4.1 weeks Status in linux package in Ubuntu: Confirmed Bug description: Every 4.1 uptime weeks (more or less), our 34 servers reboots with the logs below. Description:Ubuntu 16.04.1 LTS Release:16.04 The servers hosts the stack flanneld (0.5.5) docker (1.11.2, build b9f10c9) kubernetes (v1.3.6) plus etcd (2.3.7) Jan 02 06:40:32 prd-node021 kernel: [ cut here ] Jan 02 06:40:32 prd-node021 kernel: kernel BUG at /build/linux-xHzv4a/linux-4.4.0/include/linux/fs.h:2569! Jan 02 06:40:32 prd-node021 kernel: invalid opcode: [#1] SMP Jan 02 06:40:32 prd-node021 kernel: Modules linked in: nf_conntrack_netlink nfnetlink veth xt_statistic xt_nat xt_recent ipt_REJECT nf_reject_ipv4 xt_tcpudp tcp_diag inet_diag Jan 02 06:40:32 prd-node021 kernel: raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc Jan 02 06:40:32 prd-node021 kernel: CPU: 46 PID: 22749 Comm: iptables-restor Not tainted 4.4.0-47-generic #68-Ubuntu Jan 02 06:40:32 prd-node021 kernel: Hardware name: HP ProLiant DL360 Gen9/ProLiant DL360 Gen9, BIOS P89 09/13/2016 Jan 02 06:40:32 prd-node021 kernel: task: 882f7ccb44c0 ti: 882fcb81 task.ti: 882fcb81 Jan 02 06:40:32 prd-node021 kernel: RIP: 0010:[] [] __fput+0x21d/0x220 Jan 02 06:40:32 prd-node021 kernel: RSP: 0018:882fcb813e68 EFLAGS: 00010246 Jan 02 06:40:32 prd-node021 kernel: RAX: RBX: 8829dbd92700 RCX: 308c6396 Jan 02 06:40:32 prd-node021 kernel: RDX: 0001 RSI: 88301f299f60 RDI: Jan 02 06:40:32 prd-node021 kernel: RBP: 882fcb813ea0 R08: 00019f60 R09: 811b3a1d Jan 02 06:40:32 prd-node021 kernel: R10: ea0064756680 R11: 8829dbd92710 R12: 0010 Jan 02 06:40:32 prd-node021 kernel: R13: 8817d3520518 R14: 881021a34da0 R15: 8817d3542540 Jan 02 06:40:32 prd-node021 kernel: FS: 7fcdaa753700() GS:88301f28() knlGS: Jan 02 06:40:32 prd-node021 kernel: CS: 0010 DS: ES: CR0: 80050033 Jan 02 06:40:32 prd-node021 kernel: CR2: 7fcdaa758000 CR3: 001917993000 CR4: 003406e0 Jan 02 06:40:32 prd-node021 kernel: DR0: DR1: DR2: Jan 02 06:40:32 prd-node021 kernel: DR3: DR6: fffe0ff0 DR7: 0400 Jan 02 06:40:32 prd-node021 kernel: Stack: Jan 02 06:40:32 prd-node021 kernel: 8817d3520518 8829dbd92710 882f7ccb44c0 82103a30 Jan 02 06:40:32 prd-node021 kernel: 8829dbd92700 882f7ccb4b38 882fcb813eb0 Jan 02 06:40:32 prd-node021 kernel: 8120fa2e 882fcb813ef0 8109ee01 882f7ccb4b6c Jan 02 06:40:32 prd-node021 kernel: Call Trace: Jan 02 06:40:32 prd-node021 kernel: [] fput+0xe/0x10 Jan 02 06:40:32 prd-node021 kernel: [] task_work_run+0x81/0xa0 Jan 02 06:40:32 prd-node021 kernel: [] exit_to_usermode_loop+0xc2/0xd0 Jan 02 06:40:32 prd-node021 kernel: [] syscall_return_slowpath+0x4e/0x60 Jan 02 06:40:32 prd-node021 kernel: [] int_ret_from_sys_call+0x25/0x8f Jan 02 06:40:32 prd-node021 kernel: Code: 0f 84 cf fe ff ff 48 8b 43 28 48 8b 80 80 00 00 00 48 85 c0 0f 84 bb fe ff ff 31 d2 48 89 de bf ff ff ff ff ff d0 e9 aa fe ff ff <0f> Jan 02 06:40:32 prd-node021 kernel: RIP [] __fput+0x21d/0x220 -- Reboot -- Jan 02 06:42:56 prd-node021 systemd-journald[819]: Runtime journal (/run/log/journal/) is 8.0M, max 1.8G, 1.8G free. Jan 02 06:42:56 prd-node021 kernel: Initializing cgroup subsys cpuset ProblemType: Bug DistroRelease: Ubuntu 16.04 Package: linux-image-4.4.0-47-generic 4.4.0-47.68 ProcVersionSignature: Ubuntu 4.4.0-47.68-generic 4.4.24 Uname: Linux 4.4.0-47-generic x86_64 AlsaDevices: total 0 crw-rw 1 root audio 116, 1 Jan 2 06:42 seq crw-rw 1 root audio 116, 33 Jan 2 06:42 timer AplayDevices: Error: [Errno 2] No such file or directory: 'aplay' ApportVersion: 2.20.1-0ubuntu2.1 Architecture: amd64 ArecordDevices: Error: [Errno 2] No such file or directory: 'arecord' AudioDevicesInUse: Error: command ['fuser', '-v', '/dev/snd/seq', '/dev/snd/timer'] failed with exit code 1: Date: Mon Jan 2 10:49:15 2017 HibernationDevice: RESUME=/dev/mapper/vg00-swap InstallationDate: Installed on 2016-09-13 (110 days ago) InstallationMedia: Ubuntu-Server 16.04.1 LTS "Xenial Xerus" - Beta amd64 (20160803) IwConfig: Error: [Errno 2] No such file or directory:
