i am using the version 1.2.38 of the i40e stable downloads on opensuse
13.2 (kernel Konsole outpu3.16.7-21 3.16.7-21) and i seem to get a
complete system hang about once a week. it is always preceeded by at
least 3-4 of these page allocation failures in the i40e module within
very short time (less than 1 second)
logfile output of one of these page allocation failures:
May 18 09:57:00 srv2 kernel: kworker/0:0: page allocation failure:
order:6, mode:0x80d0
May 18 09:57:00 srv2 kernel: CPU: 0 PID: 23490 Comm: kworker/0:0
Tainted: G O 3.16.7-21-desktop #1
May 18 09:57:00 srv2 kernel: Hardware name: ASUSTeK Computer INC.
KGP(M)E-D16/KGP(M)E-D16, BIOS 3201 02/19/2013
May 18 09:57:00 srv2 kernel: Workqueue: events i40e_service_task [i40e]
May 18 09:57:00 srv2 kernel: ffff8800608e79f0 ffffffff8161c373
00000000000080d0 ffffffff81150e8f
May 18 09:57:00 srv2 kernel: ffff88041ffedc00 0000000000000000
0000000000000006 0000000000000040
May 18 09:57:00 srv2 kernel: ffffffff81617aa5 ffff88041ffece00
ffffffff00000002 ffff880400000000
May 18 09:57:00 srv2 kernel: Call Trace:
May 18 09:57:00 srv2 kernel: [<ffffffff810051ee>] dump_trace+0x8e/0x350
May 18 09:57:00 srv2 kernel: [<ffffffff81005556>]
show_stack_log_lvl+0xa6/0x190
May 18 09:57:00 srv2 kernel: [<ffffffff81006c51>] show_stack+0x21/0x50
May 18 09:57:00 srv2 kernel: [<ffffffff8161c373>] dump_stack+0x49/0x6a
May 18 09:57:00 srv2 kernel: [<ffffffff81150e8f>]
warn_alloc_failed+0xdf/0x150
May 18 09:57:00 srv2 kernel: [<ffffffff81618219>]
__alloc_pages_slowpath+0x757/0x7b0
May 18 09:57:00 srv2 kernel: [<ffffffff81154cf1>]
__alloc_pages_nodemask+0x2d1/0x2e0
May 18 09:57:00 srv2 kernel: [<ffffffff81193aad>]
alloc_pages_current+0x9d/0x160
May 18 09:57:00 srv2 kernel: [<ffffffff8114fe1a>] __get_free_pages+0xa/0x50
May 18 09:57:00 srv2 kernel: [<ffffffff815048ca>] alloc_coherent+0x6a/0x1b0
May 18 09:57:00 srv2 kernel: [<ffffffffa04b19dc>]
i40e_alloc_rx_headers+0x9c/0x120 [i40e]
May 18 09:57:00 srv2 kernel: [<ffffffffa0496d18>]
i40e_vsi_configure+0x668/0x750 [i40e]
May 18 09:57:00 srv2 kernel: [<ffffffffa049c060>]
i40e_vsi_open+0xa0/0x1e0 [i40e]
May 18 09:57:00 srv2 kernel: [<ffffffffa049cadb>] i40e_open+0x4b/0xa0
[i40e]
May 18 09:57:00 srv2 kernel: [<ffffffffa049c252>]
i40e_pf_unquiesce_all_vsi+0x52/0x70 [i40e]
May 18 09:57:00 srv2 kernel: [<ffffffffa049bb69>]
i40e_reset_and_rebuild+0x3c9/0x570 [i40e]
May 18 09:57:00 srv2 kernel: [<ffffffffa049d7d0>]
i40e_service_task+0xa20/0x12b0 [i40e]
May 18 09:57:00 srv2 kernel: [<ffffffff8107711d>]
process_one_work+0x16d/0x460
May 18 09:57:00 srv2 kernel: [<ffffffff81077a05>] worker_thread+0x115/0x510
May 18 09:57:00 srv2 kernel: [<ffffffff8107dd7d>] kthread+0xbd/0xe0
May 18 09:57:00 srv2 kernel: [<ffffffff81622fd8>] ret_from_fork+0x58/0x90
May 18 09:57:00 srv2 kernel: Mem-Info:
May 18 09:57:00 srv2 kernel: Node 0 DMA per-cpu:
May 18 09:57:00 srv2 kernel: CPU 0: hi: 0, btch: 1 usd: 0
May 18 09:57:00 srv2 kernel: CPU 1: hi: 0, btch: 1 usd: 0
May 18 09:57:00 srv2 kernel: CPU 2: hi: 0, btch: 1 usd: 0
May 18 09:57:00 srv2 kernel: CPU 3: hi: 0, btch: 1 usd: 0
May 18 09:57:00 srv2 kernel: CPU 4: hi: 0, btch: 1 usd: 0
May 18 09:57:00 srv2 kernel: CPU 5: hi: 0, btch: 1 usd: 0
May 18 09:57:00 srv2 kernel: CPU 6: hi: 0, btch: 1 usd: 0
May 18 09:57:00 srv2 kernel: CPU 7: hi: 0, btch: 1 usd: 0
May 18 09:57:00 srv2 kernel: CPU 8: hi: 0, btch: 1 usd: 0
May 18 09:57:00 srv2 kernel: CPU 9: hi: 0, btch: 1 usd: 0
May 18 09:57:00 srv2 kernel: CPU 10: hi: 0, btch: 1 usd: 0
May 18 09:57:00 srv2 kernel: CPU 11: hi: 0, btch: 1 usd: 0
May 18 09:57:00 srv2 kernel: CPU 12: hi: 0, btch: 1 usd: 0
May 18 09:57:00 srv2 kernel: CPU 13: hi: 0, btch: 1 usd: 0
May 18 09:57:00 srv2 kernel: CPU 14: hi: 0, btch: 1 usd: 0
May 18 09:57:00 srv2 kernel: CPU 15: hi: 0, btch: 1 usd: 0
May 18 09:57:00 srv2 kernel: Node 0 DMA32 per-cpu:
May 18 09:57:00 srv2 kernel: CPU 0: hi: 186, btch: 31 usd: 0
May 18 09:57:00 srv2 kernel: CPU 1: hi: 186, btch: 31 usd: 0
May 18 09:57:00 srv2 kernel: CPU 2: hi: 186, btch: 31 usd: 0
May 18 09:57:00 srv2 kernel: CPU 3: hi: 186, btch: 31 usd: 0
May 18 09:57:00 srv2 kernel: CPU 4: hi: 186, btch: 31 usd: 0
May 18 09:57:00 srv2 kernel: CPU 5: hi: 186, btch: 31 usd: 0
May 18 09:57:00 srv2 kernel: CPU 6: hi: 186, btch: 31 usd: 0
May 18 09:57:00 srv2 kernel: CPU 7: hi: 186, btch: 31 usd: 0
May 18 09:57:00 srv2 kernel: CPU 8: hi: 186, btch: 31 usd: 0
May 18 09:57:00 srv2 kernel: CPU 9: hi: 186, btch: 31 usd: 0
May 18 09:57:00 srv2 kernel: CPU 10: hi: 186, btch: 31 usd: 0
May 18 09:57:00 srv2 kernel: CPU 11: hi: 186, btch: 31 usd: 0
May 18 09:57:00 srv2 kernel: CPU 12: hi: 186, btch: 31 usd: 0
May 18 09:57:00 srv2 kernel: CPU 13: hi: 186, btch: 31 usd: 0
May 18 09:57:00 srv2 kernel: CPU 14: hi: 186, btch: 31 usd: 0
May 18 09:57:00 srv2 kernel: CPU 15: hi: 186, btch: 31 usd: 0
May 18 09:57:00 srv2 kernel: Node 0 Normal per-cpu:
May 18 09:57:00 srv2 kernel: CPU 0: hi: 186, btch: 31 usd: 0
May 18 09:57:00 srv2 kernel: CPU 1: hi: 186, btch: 31 usd: 0
May 18 09:57:00 srv2 kernel: CPU 2: hi: 186, btch: 31 usd: 1
May 18 09:57:00 srv2 kernel: CPU 3: hi: 186, btch: 31 usd: 0
May 18 09:57:00 srv2 kernel: CPU 4: hi: 186, btch: 31 usd: 0
May 18 09:57:00 srv2 kernel: CPU 5: hi: 186, btch: 31 usd: 0
May 18 09:57:00 srv2 kernel: CPU 6: hi: 186, btch: 31 usd: 0
May 18 09:57:00 srv2 kernel: CPU 7: hi: 186, btch: 31 usd: 0
May 18 09:57:00 srv2 kernel: CPU 8: hi: 186, btch: 31 usd: 0
May 18 09:57:00 srv2 kernel: CPU 9: hi: 186, btch: 31 usd: 0
May 18 09:57:00 srv2 kernel: CPU 10: hi: 186, btch: 31 usd: 0
May 18 09:57:00 srv2 kernel: CPU 11: hi: 186, btch: 31 usd: 0
May 18 09:57:00 srv2 kernel: CPU 12: hi: 186, btch: 31 usd: 0
May 18 09:57:00 srv2 kernel: CPU 13: hi: 186, btch: 31 usd: 0
May 18 09:57:00 srv2 kernel: CPU 14: hi: 186, btch: 31 usd: 0
May 18 09:57:00 srv2 kernel: CPU 15: hi: 186, btch: 31 usd: 0
May 18 09:57:00 srv2 kernel: Node 3 Normal per-cpu:
May 18 09:57:00 srv2 kernel: CPU 0: hi: 186, btch: 31 usd: 0
May 18 09:57:00 srv2 kernel: CPU 1: hi: 186, btch: 31 usd: 0
May 18 09:57:00 srv2 kernel: CPU 2: hi: 186, btch: 31 usd: 0
May 18 09:57:00 srv2 kernel: CPU 3: hi: 186, btch: 31 usd: 0
May 18 09:57:00 srv2 kernel: CPU 4: hi: 186, btch: 31 usd: 0
May 18 09:57:00 srv2 kernel: CPU 5: hi: 186, btch: 31 usd: 0
May 18 09:57:00 srv2 kernel: CPU 6: hi: 186, btch: 31 usd: 0
May 18 09:57:00 srv2 kernel: CPU 7: hi: 186, btch: 31 usd: 0
May 18 09:57:00 srv2 kernel: CPU 8: hi: 186, btch: 31 usd: 0
May 18 09:57:00 srv2 kernel: CPU 9: hi: 186, btch: 31 usd: 0
May 18 09:57:00 srv2 kernel: CPU 10: hi: 186, btch: 31 usd: 0
May 18 09:57:00 srv2 kernel: CPU 11: hi: 186, btch: 31 usd: 0
May 18 09:57:00 srv2 kernel: CPU 12: hi: 186, btch: 31 usd: 0
May 18 09:57:00 srv2 kernel: CPU 13: hi: 186, btch: 31 usd: 0
May 18 09:57:00 srv2 kernel: CPU 14: hi: 186, btch: 31 usd: 0
May 18 09:57:00 srv2 kernel: CPU 15: hi: 186, btch: 31 usd: 0
May 18 09:57:00 srv2 kernel: active_anon:1270 inactive_anon:52214
isolated_anon:0
active_file:2454067 inactive_file:2418231
isolated_file:0
unevictable:20 dirty:14191 writeback:0
unstable:0
free:90677 slab_reclaimable:2373033
slab_unreclaimable:149763
mapped:12537 shmem:936 pagetables:2125
bounce:0
free_cma:0
May 18 09:57:00 srv2 kernel: Node 0 DMA free:15872kB min:40kB low:48kB
high:60kB active_anon:0kB inactive_anon:0kB active_file:0kB
inactive_file:0kB unevictable:0kB isolated(anon):0kB isolated(file):0kB
present:15968kB managed:15884kB mlo
May 18 09:57:00 srv2 kernel: lowmem_reserve[]: 0 3421 15992 15992
May 18 09:57:00 srv2 kernel: Node 0 DMA32 free:68192kB min:9584kB
low:11980kB high:14376kB active_anon:1256kB inactive_anon:25252kB
active_file:787076kB inactive_file:784736kB unevictable:0kB
isolated(anon):0kB isolated(file):0kB present:
May 18 09:57:00 srv2 kernel: lowmem_reserve[]: 0 0 12571 12571
May 18 09:57:00 srv2 kernel: Node 0 Normal free:60204kB min:35216kB
low:44020kB high:52824kB active_anon:1652kB inactive_anon:80568kB
active_file:2831544kB inactive_file:2824656kB unevictable:64kB
isolated(anon):0kB isolated(file):0kB pre
May 18 09:57:00 srv2 kernel: lowmem_reserve[]: 0 0 0 0
May 18 09:57:00 srv2 kernel: Node 0 DMA: 2*4kB (U) 1*8kB (U) 1*16kB (U)
1*32kB (U) 1*64kB (U) 1*128kB (U) 1*256kB (U) 0*512kB 1*1024kB (U)
1*2048kB (R) 3*4096kB (M) = 15872kB
May 18 09:57:00 srv2 kernel: Node 0 DMA32: 4767*4kB (UEM) 3620*8kB (UEM)
756*16kB (UEMR) 184*32kB (UEMR) 36*64kB (UMR) 2*128kB (ER) 1*256kB (R)
0*512kB 0*1024kB 0*2048kB 0*4096kB = 68828kB
May 18 09:57:00 srv2 kernel: Node 0 Normal: 13385*4kB (UEM) 710*8kB (UM)
7*16kB (M) 1*32kB (R) 1*64kB (R) 1*128kB (R) 1*256kB (R) 1*512kB (R)
1*1024kB (R) 0*2048kB 0*4096kB = 61348kB
May 18 09:57:00 srv2 kernel: Node 3 Normal: 54208*4kB (UEM) 156*8kB
(UEM) 5*16kB (EM) 0*32kB 0*64kB 0*128kB 0*256kB 0*512kB 0*1024kB
1*2048kB (R) 0*4096kB = 220208kB
May 18 09:57:00 srv2 kernel: Node 0 hugepages_total=0 hugepages_free=0
hugepages_surp=0 hugepages_size=2048kB
May 18 09:57:00 srv2 kernel: Node 3 hugepages_total=0 hugepages_free=0
hugepages_surp=0 hugepages_size=2048kB
May 18 09:57:00 srv2 kernel: 4873626 total pagecache pages
May 18 09:57:00 srv2 kernel: 421 pages in swap cache
May 18 09:57:00 srv2 kernel: Swap cache stats: add 2749, delete 2328,
find 69/129
May 18 09:57:00 srv2 kernel: Free swap = 31446680kB
May 18 09:57:00 srv2 kernel: Total swap = 31457276kB
May 18 09:57:00 srv2 kernel: 8388376 pages RAM
May 18 09:57:00 srv2 kernel: 0 pages HighMem/MovableOnly
May 18 09:57:00 srv2 kernel: 57823 pages reserved
May 18 09:57:00 srv2 kernel: 0 pages hwpoisoned
------------------------------------------------------------------------------
One dashboard for servers and applications across Physical-Virtual-Cloud
Widest out-of-the-box monitoring support with 50+ applications
Performance metrics, stats and reports that give you Actionable Insights
Deep dive visibility with transaction tracing using APM Insight.
http://ad.doubleclick.net/ddm/clk/290420510;117567292;y
_______________________________________________
E1000-devel mailing list
E1000-devel@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/e1000-devel
To learn more about Intel® Ethernet, visit
http://communities.intel.com/community/wired
