Re: Kernel warnings from tcp.c
On Wed, 29 Aug 2018 14:38:38 -0400 Adam Mitchell wrote: > Anyone with experience in tcp.c have an idea what's causing this on > our busy database server? Comes from this macro at line 2278: > WARN_ON(sock_owned_by_user(sk)); > > > [726780.788201] WARNING: CPU: 15 PID: 52245 at net/ipv4/tcp.c:2278 > tcp_close+0x40f/0x430 > > [726780.794947] Modules linked in: binfmt_misc nf_conntrack_netlink > nfnetlink_queue tcp_diag inet_diag isofs ip6table_mangle ip6table_raw > ip6table_nat nf_nat_ipv6 iptable_security xt_CT iptable_raw > iptable_nat nf_nat_ipv4 nf_nat iptable_mangle xt_pkttype xt_NFLOG > nfnetlink_log xt_u32 xt_multiport xt_set xt_conntrack > ip_set_hash_netport ip_set_hash_ipport ip_set_hash_net ip_set_hash_ip > ip_set nfnetlink nf_conntrack_proto_gre nf_conntrack_ipv6 > nf_defrag_ipv6 ip6table_filter ip6_tables xt_LOG nf_conntrack_tftp > nf_conntrack_ftp nf_conntrack_ipv4 nf_defrag_ipv4 nf_conntrack > iptable_filter zfs(PO) zunicode(PO) zavl(PO) icp(PO) sb_edac > intel_powerclamp crct10dif_pclmul crc32_pclmul ghash_clmulni_intel > pcbc aesni_intel crypto_simd glue_helper cryptd cirrus snd_seq > zcommon(PO) ttm intel_rapl_perf snd_seq_device > [726780.848696] drm_kms_helper znvpair(PO) snd_pcm snd_timer spl(O) > drm snd soundcore syscopyarea sysfillrect pcspkr sysimgblt input_leds > fb_sys_fops i2c_piix4 ip_tables xfs libcrc32c ata_generic pata_acpi > ata_piix xen_blkfront crc32c_intel libata ena(O) serio_raw floppy > sunrpc > [726780.863916] CPU: 15 PID: 52245 Comm: mysqld Tainted: PW O > 4.16.13-1.el7.elrepo.x86_64 #1 > Sorry, you have a tainted kernel with modules that are not upstream therefore don't expect any support from kernel community
Kernel warnings from tcp.c
Anyone with experience in tcp.c have an idea what's causing this on our busy database server? Comes from this macro at line 2278: WARN_ON(sock_owned_by_user(sk)); [726780.788201] WARNING: CPU: 15 PID: 52245 at net/ipv4/tcp.c:2278 tcp_close+0x40f/0x430 [726780.794947] Modules linked in: binfmt_misc nf_conntrack_netlink nfnetlink_queue tcp_diag inet_diag isofs ip6table_mangle ip6table_raw ip6table_nat nf_nat_ipv6 iptable_security xt_CT iptable_raw iptable_nat nf_nat_ipv4 nf_nat iptable_mangle xt_pkttype xt_NFLOG nfnetlink_log xt_u32 xt_multiport xt_set xt_conntrack ip_set_hash_netport ip_set_hash_ipport ip_set_hash_net ip_set_hash_ip ip_set nfnetlink nf_conntrack_proto_gre nf_conntrack_ipv6 nf_defrag_ipv6 ip6table_filter ip6_tables xt_LOG nf_conntrack_tftp nf_conntrack_ftp nf_conntrack_ipv4 nf_defrag_ipv4 nf_conntrack iptable_filter zfs(PO) zunicode(PO) zavl(PO) icp(PO) sb_edac intel_powerclamp crct10dif_pclmul crc32_pclmul ghash_clmulni_intel pcbc aesni_intel crypto_simd glue_helper cryptd cirrus snd_seq zcommon(PO) ttm intel_rapl_perf snd_seq_device [726780.848696] drm_kms_helper znvpair(PO) snd_pcm snd_timer spl(O) drm snd soundcore syscopyarea sysfillrect pcspkr sysimgblt input_leds fb_sys_fops i2c_piix4 ip_tables xfs libcrc32c ata_generic pata_acpi ata_piix xen_blkfront crc32c_intel libata ena(O) serio_raw floppy sunrpc [726780.863916] CPU: 15 PID: 52245 Comm: mysqld Tainted: PW O 4.16.13-1.el7.elrepo.x86_64 #1 [726780.869486] Hardware name: Xen HVM domU, BIOS 4.2.amazon 08/24/2006 [726780.873756] RIP: 0010:tcp_close+0x40f/0x430 [726780.877049] RSP: 0018:c90063a87dd0 EFLAGS: 00010202 [726780.880913] RAX: 0001 RBX: 8839cbb4b300 RCX: 0001 [726780.885708] RDX: 0041 RSI: 00023540 RDI: 002b [726780.890412] RBP: c90063a87df0 R08: R09: 0101 [726780.895192] R10: 03ff R11: 2057 R12: 8839cbb4b388 [726780.900029] R13: 0009 R14: 8839cbb4b3c8 R15: 883c5ed14900 [726780.904777] FS: 7f6acd467700() GS:883c8b1c() knlGS: [726780.909964] CS: 0010 DS: ES: CR0: 80050033 [726780.914078] CR2: 7f6cd5d430c8 CR3: 003c7e6b6005 CR4: 001606e0 [726780.918837] DR0: DR1: DR2: [726780.923433] DR3: DR6: fffe0ff0 DR7: 0400 [726780.927882] Call Trace: [726780.930410] inet_release+0x42/0x70 [726780.933423] inet6_release+0x30/0x40 [726780.936439] sock_release+0x25/0x80 [726780.939421] sock_close+0x12/0x20 [726780.942342] __fput+0xea/0x220 [726780.945170] fput+0xe/0x10 [726780.947963] task_work_run+0x8c/0xb0 [726780.951052] exit_to_usermode_loop+0x6b/0x95 [726780.954480] do_syscall_64+0x182/0x1b0 [726780.957586] entry_SYSCALL_64_after_hwframe+0x3d/0xa2 [726780.961288] RIP: 0033:0x7fd82b27085d [726780.964349] RSP: 002b:7f6acd466b50 EFLAGS: 0293 ORIG_RAX: 0003 [726780.969280] RAX: RBX: 7f65b2418220 RCX: 7fd82b27085d [726780.973987] RDX: 0003 RSI: 7f6d5e9990c0 RDI: 02d8 [726780.978689] RBP: 7f6acd466c00 R08: 01622848 R09: 01f8 [726780.983373] R10: R11: 0293 R12: [726780.988049] R13: 7f6d5e9990c0 R14: 01d87cc0 R15: 02d8 [726780.992700] Code: ff 48 8b 43 28 31 f6 48 89 df 48 8b 40 10 e8 49 2d 4e 00 48 8b 43 30 48 8b 80 98 01 00 00 65 48 ff 80 90 01 00 00 e9 49 ff ff ff <0f> 0b e9 ab fc ff ff 48 8b 43 28 31 f6 48 89 df 48 8b 40 10 e8 [726781.004156] ---[ end trace 8525f27644ac4631 ]---
