[Kernel-packages] [Bug 1319244] Re: iostat: Cannot open /proc/stat: Cannot allocate memory
Will the patch be integrated in Saucy Salamander? -- You received this bug notification because you are a member of Kernel Packages, which is subscribed to linux in Ubuntu. https://bugs.launchpad.net/bugs/1319244 Title: iostat: Cannot open /proc/stat: Cannot allocate memory Status in “linux” package in Ubuntu: Fix Released Bug description: break-fix: 59a32e2ce5eb809967cac4e718bc527beca83c59 f74373a5cc7a0155d232c4e999648c7a95435bb2 break-fix: 59a32e2ce5eb809967cac4e718bc527beca83c59 058504edd02667eef8fac9be27ab3ea74332e9b4 Intermitently I get errors stating that various programs cannot allocate memory when reading /proc/stat I have 2 servers that are affected by the issue. Probably a duplicate of 1226172 [1764593.455329] top: page allocation failure: order:4, mode:0x1040d0 [1764593.455335] CPU: 3 PID: 10323 Comm: top Tainted: GF O 3.11.0-18-generic #32-Ubuntu [1764593.455338] Hardware name: Intel Corporation S2400SC/S2400SC, BIOS SE5C600.86B.02.02.0002.122320131210 12/23/2013 [1764593.455340] 88042670b9d0 816e8571 001040d0 [1764593.455345] 88042670ba58 81144ae0 880a3fffcb48 [1764593.455348] 000e 88042670ba28 0040 0007 [1764593.455351] Call Trace: [1764593.455361] [816e8571] dump_stack+0x45/0x56 [1764593.455367] [81144ae0] warn_alloc_failed+0xf0/0x140 [1764593.455371] [81148a15] __alloc_pages_nodemask+0x725/0x920 [1764593.455376] [81184589] alloc_pages_current+0xa9/0x160 [1764593.455379] [81143bfe] __get_free_pages+0xe/0x50 [1764593.455384] [8118d75e] kmalloc_order_trace+0x2e/0xa0 [1764593.455388] [811c9960] ? single_open+0xb0/0xb0 [1764593.455391] [8118ee19] __kmalloc+0x159/0x180 [1764593.455393] [811c9960] ? single_open+0xb0/0xb0 [1764593.455398] [81213c10] stat_open+0x50/0xc0 [1764593.455401] [8120a700] proc_reg_open+0x70/0x110 [1764593.455405] [811a5d4b] do_dentry_open+0x1eb/0x280 [1764593.455408] [8120a690] ? proc_reg_release+0x70/0x70 [1764593.455411] [811a5e69] vfs_open+0x49/0x50 [1764593.455415] [811b5e13] do_last+0x1c3/0xe50 [1764593.455418] [8118e5d8] ? kmem_cache_alloc_trace+0x108/0x130 [1764593.455421] [811b6b61] path_openat+0xc1/0x630 [1764593.455426] [811689d9] ? handle_mm_fault+0x299/0x670 [1764593.455429] [811b7eda] do_filp_open+0x3a/0x90 [1764593.455433] [816ef78e] ? _raw_spin_lock+0xe/0x20 [1764593.455437] [811c4847] ? __alloc_fd+0xa7/0x130 [1764593.455440] [811a704c] do_sys_open+0x12c/0x270 [1764593.455445] [81074989] ? __set_current_blocked+0x49/0x60 [1764593.455448] [811a71ae] SyS_open+0x1e/0x20 [1764593.455452] [816f841d] system_call_fastpath+0x1a/0x1f [1764593.455454] Mem-Info: [1764593.455455] Node 0 DMA per-cpu: [1764593.455458] CPU0: hi:0, btch: 1 usd: 0 [1764593.455459] CPU1: hi:0, btch: 1 usd: 0 [1764593.455461] CPU2: hi:0, btch: 1 usd: 0 [1764593.455462] CPU3: hi:0, btch: 1 usd: 0 [1764593.455463] CPU4: hi:0, btch: 1 usd: 0 [1764593.455465] CPU5: hi:0, btch: 1 usd: 0 [1764593.455466] CPU6: hi:0, btch: 1 usd: 0 [1764593.455468] CPU7: hi:0, btch: 1 usd: 0 [1764593.455469] Node 0 DMA32 per-cpu: [1764593.455471] CPU0: hi: 186, btch: 31 usd: 0 [1764593.455472] CPU1: hi: 186, btch: 31 usd: 0 [1764593.455474] CPU2: hi: 186, btch: 31 usd: 0 [1764593.455475] CPU3: hi: 186, btch: 31 usd: 0 [1764593.455477] CPU4: hi: 186, btch: 31 usd: 0 [1764593.455478] CPU5: hi: 186, btch: 31 usd: 0 [1764593.455480] CPU6: hi: 186, btch: 31 usd: 0 [1764593.455481] CPU7: hi: 186, btch: 31 usd: 0 [1764593.455482] Node 0 Normal per-cpu: [1764593.455484] CPU0: hi: 186, btch: 31 usd: 0 [1764593.455485] CPU1: hi: 186, btch: 31 usd: 0 [1764593.455487] CPU2: hi: 186, btch: 31 usd: 0 [1764593.455488] CPU3: hi: 186, btch: 31 usd: 0 [1764593.455490] CPU4: hi: 186, btch: 31 usd: 0 [1764593.455491] CPU5: hi: 186, btch: 31 usd: 0 [1764593.455492] CPU6: hi: 186, btch: 31 usd: 0 [1764593.455494] CPU7: hi: 186, btch: 31 usd: 0 [1764593.455495] Node 1 Normal per-cpu: [1764593.455497] CPU0: hi: 186, btch: 31 usd: 0 [1764593.455498] CPU1: hi: 186, btch: 31 usd: 0 [1764593.455500] CPU2: hi: 186, btch: 31 usd: 0 [1764593.455501] CPU3: hi: 186, btch: 31 usd: 0 [1764593.455503] CPU4: hi: 186, btch: 31 usd: 0 [1764593.455504] CPU5: hi: 186, btch: 31 usd: 30 [1764593.455505] CPU6: hi: 186, btch: 31 usd: 0 [1764593.455507] CPU7: hi: 186, btch: 31
[Kernel-packages] [Bug 1319244] Re: iostat: Cannot open /proc/stat: Cannot allocate memory
Alright the test kernel clearly fixed the issue. My gut tells me that there might be some memory leak also at play with the non patched version, but I don't know kernel code well enough to analyze that. -- You received this bug notification because you are a member of Kernel Packages, which is subscribed to linux in Ubuntu. https://bugs.launchpad.net/bugs/1319244 Title: iostat: Cannot open /proc/stat: Cannot allocate memory Status in “linux” package in Ubuntu: Confirmed Bug description: Intermitently I get errors stating that various programs cannot allocate memory when reading /proc/stat I have 2 servers that are affected by the issue. Probably a duplicate of 1226172 [1764593.455329] top: page allocation failure: order:4, mode:0x1040d0 [1764593.455335] CPU: 3 PID: 10323 Comm: top Tainted: GF O 3.11.0-18-generic #32-Ubuntu [1764593.455338] Hardware name: Intel Corporation S2400SC/S2400SC, BIOS SE5C600.86B.02.02.0002.122320131210 12/23/2013 [1764593.455340] 88042670b9d0 816e8571 001040d0 [1764593.455345] 88042670ba58 81144ae0 880a3fffcb48 [1764593.455348] 000e 88042670ba28 0040 0007 [1764593.455351] Call Trace: [1764593.455361] [816e8571] dump_stack+0x45/0x56 [1764593.455367] [81144ae0] warn_alloc_failed+0xf0/0x140 [1764593.455371] [81148a15] __alloc_pages_nodemask+0x725/0x920 [1764593.455376] [81184589] alloc_pages_current+0xa9/0x160 [1764593.455379] [81143bfe] __get_free_pages+0xe/0x50 [1764593.455384] [8118d75e] kmalloc_order_trace+0x2e/0xa0 [1764593.455388] [811c9960] ? single_open+0xb0/0xb0 [1764593.455391] [8118ee19] __kmalloc+0x159/0x180 [1764593.455393] [811c9960] ? single_open+0xb0/0xb0 [1764593.455398] [81213c10] stat_open+0x50/0xc0 [1764593.455401] [8120a700] proc_reg_open+0x70/0x110 [1764593.455405] [811a5d4b] do_dentry_open+0x1eb/0x280 [1764593.455408] [8120a690] ? proc_reg_release+0x70/0x70 [1764593.455411] [811a5e69] vfs_open+0x49/0x50 [1764593.455415] [811b5e13] do_last+0x1c3/0xe50 [1764593.455418] [8118e5d8] ? kmem_cache_alloc_trace+0x108/0x130 [1764593.455421] [811b6b61] path_openat+0xc1/0x630 [1764593.455426] [811689d9] ? handle_mm_fault+0x299/0x670 [1764593.455429] [811b7eda] do_filp_open+0x3a/0x90 [1764593.455433] [816ef78e] ? _raw_spin_lock+0xe/0x20 [1764593.455437] [811c4847] ? __alloc_fd+0xa7/0x130 [1764593.455440] [811a704c] do_sys_open+0x12c/0x270 [1764593.455445] [81074989] ? __set_current_blocked+0x49/0x60 [1764593.455448] [811a71ae] SyS_open+0x1e/0x20 [1764593.455452] [816f841d] system_call_fastpath+0x1a/0x1f [1764593.455454] Mem-Info: [1764593.455455] Node 0 DMA per-cpu: [1764593.455458] CPU0: hi:0, btch: 1 usd: 0 [1764593.455459] CPU1: hi:0, btch: 1 usd: 0 [1764593.455461] CPU2: hi:0, btch: 1 usd: 0 [1764593.455462] CPU3: hi:0, btch: 1 usd: 0 [1764593.455463] CPU4: hi:0, btch: 1 usd: 0 [1764593.455465] CPU5: hi:0, btch: 1 usd: 0 [1764593.455466] CPU6: hi:0, btch: 1 usd: 0 [1764593.455468] CPU7: hi:0, btch: 1 usd: 0 [1764593.455469] Node 0 DMA32 per-cpu: [1764593.455471] CPU0: hi: 186, btch: 31 usd: 0 [1764593.455472] CPU1: hi: 186, btch: 31 usd: 0 [1764593.455474] CPU2: hi: 186, btch: 31 usd: 0 [1764593.455475] CPU3: hi: 186, btch: 31 usd: 0 [1764593.455477] CPU4: hi: 186, btch: 31 usd: 0 [1764593.455478] CPU5: hi: 186, btch: 31 usd: 0 [1764593.455480] CPU6: hi: 186, btch: 31 usd: 0 [1764593.455481] CPU7: hi: 186, btch: 31 usd: 0 [1764593.455482] Node 0 Normal per-cpu: [1764593.455484] CPU0: hi: 186, btch: 31 usd: 0 [1764593.455485] CPU1: hi: 186, btch: 31 usd: 0 [1764593.455487] CPU2: hi: 186, btch: 31 usd: 0 [1764593.455488] CPU3: hi: 186, btch: 31 usd: 0 [1764593.455490] CPU4: hi: 186, btch: 31 usd: 0 [1764593.455491] CPU5: hi: 186, btch: 31 usd: 0 [1764593.455492] CPU6: hi: 186, btch: 31 usd: 0 [1764593.455494] CPU7: hi: 186, btch: 31 usd: 0 [1764593.455495] Node 1 Normal per-cpu: [1764593.455497] CPU0: hi: 186, btch: 31 usd: 0 [1764593.455498] CPU1: hi: 186, btch: 31 usd: 0 [1764593.455500] CPU2: hi: 186, btch: 31 usd: 0 [1764593.455501] CPU3: hi: 186, btch: 31 usd: 0 [1764593.455503] CPU4: hi: 186, btch: 31 usd: 0 [1764593.455504] CPU5: hi: 186, btch: 31 usd: 30 [1764593.455505] CPU6: hi: 186, btch: 31 usd: 0 [1764593.455507] CPU7: hi: 186, btch: 31 usd: 0 [1764593.455511]
[Kernel-packages] [Bug 1319244] Re: iostat: Cannot open /proc/stat: Cannot allocate memory
So far after 21 days of uptime the issue hasn't come back. # cat /proc/buddyinfo Node 0, zone DMA 0 0 0 1 1 1 1 0 1 1 3 Node 0, zoneDMA32 9544583 7936174 3 1 1 0 0 0 0 Node 0, zone Normal 36669197 1 0 0 0 0 0 0 0 0 Node 1, zone Normal 103431 13022845105 20 4 2 1 1 0 0 Unfortunately I'll have to bring the computer down tomorrow morning as there is a planned power outage. I'll setup the patched kernel on the 2nd computer that is affected by the issue. -- You received this bug notification because you are a member of Kernel Packages, which is subscribed to linux in Ubuntu. https://bugs.launchpad.net/bugs/1319244 Title: iostat: Cannot open /proc/stat: Cannot allocate memory Status in “linux” package in Ubuntu: Confirmed Bug description: Intermitently I get errors stating that various programs cannot allocate memory when reading /proc/stat I have 2 servers that are affected by the issue. Probably a duplicate of 1226172 [1764593.455329] top: page allocation failure: order:4, mode:0x1040d0 [1764593.455335] CPU: 3 PID: 10323 Comm: top Tainted: GF O 3.11.0-18-generic #32-Ubuntu [1764593.455338] Hardware name: Intel Corporation S2400SC/S2400SC, BIOS SE5C600.86B.02.02.0002.122320131210 12/23/2013 [1764593.455340] 88042670b9d0 816e8571 001040d0 [1764593.455345] 88042670ba58 81144ae0 880a3fffcb48 [1764593.455348] 000e 88042670ba28 0040 0007 [1764593.455351] Call Trace: [1764593.455361] [816e8571] dump_stack+0x45/0x56 [1764593.455367] [81144ae0] warn_alloc_failed+0xf0/0x140 [1764593.455371] [81148a15] __alloc_pages_nodemask+0x725/0x920 [1764593.455376] [81184589] alloc_pages_current+0xa9/0x160 [1764593.455379] [81143bfe] __get_free_pages+0xe/0x50 [1764593.455384] [8118d75e] kmalloc_order_trace+0x2e/0xa0 [1764593.455388] [811c9960] ? single_open+0xb0/0xb0 [1764593.455391] [8118ee19] __kmalloc+0x159/0x180 [1764593.455393] [811c9960] ? single_open+0xb0/0xb0 [1764593.455398] [81213c10] stat_open+0x50/0xc0 [1764593.455401] [8120a700] proc_reg_open+0x70/0x110 [1764593.455405] [811a5d4b] do_dentry_open+0x1eb/0x280 [1764593.455408] [8120a690] ? proc_reg_release+0x70/0x70 [1764593.455411] [811a5e69] vfs_open+0x49/0x50 [1764593.455415] [811b5e13] do_last+0x1c3/0xe50 [1764593.455418] [8118e5d8] ? kmem_cache_alloc_trace+0x108/0x130 [1764593.455421] [811b6b61] path_openat+0xc1/0x630 [1764593.455426] [811689d9] ? handle_mm_fault+0x299/0x670 [1764593.455429] [811b7eda] do_filp_open+0x3a/0x90 [1764593.455433] [816ef78e] ? _raw_spin_lock+0xe/0x20 [1764593.455437] [811c4847] ? __alloc_fd+0xa7/0x130 [1764593.455440] [811a704c] do_sys_open+0x12c/0x270 [1764593.455445] [81074989] ? __set_current_blocked+0x49/0x60 [1764593.455448] [811a71ae] SyS_open+0x1e/0x20 [1764593.455452] [816f841d] system_call_fastpath+0x1a/0x1f [1764593.455454] Mem-Info: [1764593.455455] Node 0 DMA per-cpu: [1764593.455458] CPU0: hi:0, btch: 1 usd: 0 [1764593.455459] CPU1: hi:0, btch: 1 usd: 0 [1764593.455461] CPU2: hi:0, btch: 1 usd: 0 [1764593.455462] CPU3: hi:0, btch: 1 usd: 0 [1764593.455463] CPU4: hi:0, btch: 1 usd: 0 [1764593.455465] CPU5: hi:0, btch: 1 usd: 0 [1764593.455466] CPU6: hi:0, btch: 1 usd: 0 [1764593.455468] CPU7: hi:0, btch: 1 usd: 0 [1764593.455469] Node 0 DMA32 per-cpu: [1764593.455471] CPU0: hi: 186, btch: 31 usd: 0 [1764593.455472] CPU1: hi: 186, btch: 31 usd: 0 [1764593.455474] CPU2: hi: 186, btch: 31 usd: 0 [1764593.455475] CPU3: hi: 186, btch: 31 usd: 0 [1764593.455477] CPU4: hi: 186, btch: 31 usd: 0 [1764593.455478] CPU5: hi: 186, btch: 31 usd: 0 [1764593.455480] CPU6: hi: 186, btch: 31 usd: 0 [1764593.455481] CPU7: hi: 186, btch: 31 usd: 0 [1764593.455482] Node 0 Normal per-cpu: [1764593.455484] CPU0: hi: 186, btch: 31 usd: 0 [1764593.455485] CPU1: hi: 186, btch: 31 usd: 0 [1764593.455487] CPU2: hi: 186, btch: 31 usd: 0 [1764593.455488] CPU3: hi: 186, btch: 31 usd: 0 [1764593.455490] CPU4: hi: 186, btch: 31 usd: 0 [1764593.455491] CPU5: hi: 186, btch: 31 usd: 0 [1764593.455492] CPU6: hi: 186, btch: 31 usd: 0 [1764593.455494] CPU7: hi: 186, btch: 31 usd: 0 [1764593.455495] Node 1 Normal per-cpu: [1764593.455497] CPU
[Kernel-packages] [Bug 1319244] Re: iostat: Cannot open /proc/stat: Cannot allocate memory
I don't think we've had enough uptime with it as the buddyinfo still looks like the bug wouldn't trigger. May 22: cat /proc/buddyinfo Node 0, zone DMA 0 0 0 1 1 1 1 0 1 1 3 Node 0, zoneDMA32 84335 20475 5469995125 78 23 2 1 1 0 Node 0, zone Normal 116375 4708229 27 41 12 13 2 0 0 0 Node 1, zone Normal 185773 42193 5699 1997 1017510235 85 24 0 0 May 26 (uptime 11 days) # cat /proc/buddyinfo Node 0, zone DMA 0 0 0 1 1 1 1 0 1 1 3 Node 0, zoneDMA32 81329 25081 6593 1272210 13 0 0 0 0 0 Node 0, zone Normal 334689 3247 3 0 0 0 0 0 0 0 0 Node 1, zone Normal 84556 109611 7577 1366381127 55 6 2 0 0 Slowly getting there... For information this is the buddyinfo on an unpatched server with the same hardware (32 day uptime) Node 0, zone DMA 0 1 0 1 1 1 1 0 1 1 3 Node 0, zoneDMA32 60621 32499 9670 10 0 0 1 0 0 0 0 Node 0, zone Normal 11045 7738471 33 10 10 0 0 0 0 0 Node 1, zone Normal 113751 37130 5882202 12 0 0 0 0 0 0 -- You received this bug notification because you are a member of Kernel Packages, which is subscribed to linux in Ubuntu. https://bugs.launchpad.net/bugs/1319244 Title: iostat: Cannot open /proc/stat: Cannot allocate memory Status in “linux” package in Ubuntu: Confirmed Bug description: Intermitently I get errors stating that various programs cannot allocate memory when reading /proc/stat I have 2 servers that are affected by the issue. Probably a duplicate of 1226172 [1764593.455329] top: page allocation failure: order:4, mode:0x1040d0 [1764593.455335] CPU: 3 PID: 10323 Comm: top Tainted: GF O 3.11.0-18-generic #32-Ubuntu [1764593.455338] Hardware name: Intel Corporation S2400SC/S2400SC, BIOS SE5C600.86B.02.02.0002.122320131210 12/23/2013 [1764593.455340] 88042670b9d0 816e8571 001040d0 [1764593.455345] 88042670ba58 81144ae0 880a3fffcb48 [1764593.455348] 000e 88042670ba28 0040 0007 [1764593.455351] Call Trace: [1764593.455361] [816e8571] dump_stack+0x45/0x56 [1764593.455367] [81144ae0] warn_alloc_failed+0xf0/0x140 [1764593.455371] [81148a15] __alloc_pages_nodemask+0x725/0x920 [1764593.455376] [81184589] alloc_pages_current+0xa9/0x160 [1764593.455379] [81143bfe] __get_free_pages+0xe/0x50 [1764593.455384] [8118d75e] kmalloc_order_trace+0x2e/0xa0 [1764593.455388] [811c9960] ? single_open+0xb0/0xb0 [1764593.455391] [8118ee19] __kmalloc+0x159/0x180 [1764593.455393] [811c9960] ? single_open+0xb0/0xb0 [1764593.455398] [81213c10] stat_open+0x50/0xc0 [1764593.455401] [8120a700] proc_reg_open+0x70/0x110 [1764593.455405] [811a5d4b] do_dentry_open+0x1eb/0x280 [1764593.455408] [8120a690] ? proc_reg_release+0x70/0x70 [1764593.455411] [811a5e69] vfs_open+0x49/0x50 [1764593.455415] [811b5e13] do_last+0x1c3/0xe50 [1764593.455418] [8118e5d8] ? kmem_cache_alloc_trace+0x108/0x130 [1764593.455421] [811b6b61] path_openat+0xc1/0x630 [1764593.455426] [811689d9] ? handle_mm_fault+0x299/0x670 [1764593.455429] [811b7eda] do_filp_open+0x3a/0x90 [1764593.455433] [816ef78e] ? _raw_spin_lock+0xe/0x20 [1764593.455437] [811c4847] ? __alloc_fd+0xa7/0x130 [1764593.455440] [811a704c] do_sys_open+0x12c/0x270 [1764593.455445] [81074989] ? __set_current_blocked+0x49/0x60 [1764593.455448] [811a71ae] SyS_open+0x1e/0x20 [1764593.455452] [816f841d] system_call_fastpath+0x1a/0x1f [1764593.455454] Mem-Info: [1764593.455455] Node 0 DMA per-cpu: [1764593.455458] CPU0: hi:0, btch: 1 usd: 0 [1764593.455459] CPU1: hi:0, btch: 1 usd: 0 [1764593.455461] CPU2: hi:0, btch: 1 usd: 0 [1764593.455462] CPU3: hi:0, btch: 1 usd: 0 [1764593.455463] CPU4: hi:0, btch: 1 usd: 0 [1764593.455465] CPU5: hi:0, btch: 1 usd: 0 [1764593.455466] CPU6: hi:0, btch: 1 usd: 0 [1764593.455468] CPU7: hi:0, btch: 1 usd: 0 [1764593.455469] Node 0 DMA32 per-cpu: [1764593.455471] CPU0: hi: 186, btch: 31 usd: 0 [1764593.455472] CPU1: hi: 186, btch: 31 usd: 0 [1764593.455474] CPU2: hi: 186, btch: 31 usd: 0 [1764593.455475] CPU3:
[Kernel-packages] [Bug 1319244] Re: iostat: Cannot open /proc/stat: Cannot allocate memory
I've installed the kernel on one of the servers that is affected. It might take a few days before there are any results though. -- You received this bug notification because you are a member of Kernel Packages, which is subscribed to linux in Ubuntu. https://bugs.launchpad.net/bugs/1319244 Title: iostat: Cannot open /proc/stat: Cannot allocate memory Status in “linux” package in Ubuntu: Confirmed Bug description: Intermitently I get errors stating that various programs cannot allocate memory when reading /proc/stat I have 2 servers that are affected by the issue. Probably a duplicate of 1226172 [1764593.455329] top: page allocation failure: order:4, mode:0x1040d0 [1764593.455335] CPU: 3 PID: 10323 Comm: top Tainted: GF O 3.11.0-18-generic #32-Ubuntu [1764593.455338] Hardware name: Intel Corporation S2400SC/S2400SC, BIOS SE5C600.86B.02.02.0002.122320131210 12/23/2013 [1764593.455340] 88042670b9d0 816e8571 001040d0 [1764593.455345] 88042670ba58 81144ae0 880a3fffcb48 [1764593.455348] 000e 88042670ba28 0040 0007 [1764593.455351] Call Trace: [1764593.455361] [816e8571] dump_stack+0x45/0x56 [1764593.455367] [81144ae0] warn_alloc_failed+0xf0/0x140 [1764593.455371] [81148a15] __alloc_pages_nodemask+0x725/0x920 [1764593.455376] [81184589] alloc_pages_current+0xa9/0x160 [1764593.455379] [81143bfe] __get_free_pages+0xe/0x50 [1764593.455384] [8118d75e] kmalloc_order_trace+0x2e/0xa0 [1764593.455388] [811c9960] ? single_open+0xb0/0xb0 [1764593.455391] [8118ee19] __kmalloc+0x159/0x180 [1764593.455393] [811c9960] ? single_open+0xb0/0xb0 [1764593.455398] [81213c10] stat_open+0x50/0xc0 [1764593.455401] [8120a700] proc_reg_open+0x70/0x110 [1764593.455405] [811a5d4b] do_dentry_open+0x1eb/0x280 [1764593.455408] [8120a690] ? proc_reg_release+0x70/0x70 [1764593.455411] [811a5e69] vfs_open+0x49/0x50 [1764593.455415] [811b5e13] do_last+0x1c3/0xe50 [1764593.455418] [8118e5d8] ? kmem_cache_alloc_trace+0x108/0x130 [1764593.455421] [811b6b61] path_openat+0xc1/0x630 [1764593.455426] [811689d9] ? handle_mm_fault+0x299/0x670 [1764593.455429] [811b7eda] do_filp_open+0x3a/0x90 [1764593.455433] [816ef78e] ? _raw_spin_lock+0xe/0x20 [1764593.455437] [811c4847] ? __alloc_fd+0xa7/0x130 [1764593.455440] [811a704c] do_sys_open+0x12c/0x270 [1764593.455445] [81074989] ? __set_current_blocked+0x49/0x60 [1764593.455448] [811a71ae] SyS_open+0x1e/0x20 [1764593.455452] [816f841d] system_call_fastpath+0x1a/0x1f [1764593.455454] Mem-Info: [1764593.455455] Node 0 DMA per-cpu: [1764593.455458] CPU0: hi:0, btch: 1 usd: 0 [1764593.455459] CPU1: hi:0, btch: 1 usd: 0 [1764593.455461] CPU2: hi:0, btch: 1 usd: 0 [1764593.455462] CPU3: hi:0, btch: 1 usd: 0 [1764593.455463] CPU4: hi:0, btch: 1 usd: 0 [1764593.455465] CPU5: hi:0, btch: 1 usd: 0 [1764593.455466] CPU6: hi:0, btch: 1 usd: 0 [1764593.455468] CPU7: hi:0, btch: 1 usd: 0 [1764593.455469] Node 0 DMA32 per-cpu: [1764593.455471] CPU0: hi: 186, btch: 31 usd: 0 [1764593.455472] CPU1: hi: 186, btch: 31 usd: 0 [1764593.455474] CPU2: hi: 186, btch: 31 usd: 0 [1764593.455475] CPU3: hi: 186, btch: 31 usd: 0 [1764593.455477] CPU4: hi: 186, btch: 31 usd: 0 [1764593.455478] CPU5: hi: 186, btch: 31 usd: 0 [1764593.455480] CPU6: hi: 186, btch: 31 usd: 0 [1764593.455481] CPU7: hi: 186, btch: 31 usd: 0 [1764593.455482] Node 0 Normal per-cpu: [1764593.455484] CPU0: hi: 186, btch: 31 usd: 0 [1764593.455485] CPU1: hi: 186, btch: 31 usd: 0 [1764593.455487] CPU2: hi: 186, btch: 31 usd: 0 [1764593.455488] CPU3: hi: 186, btch: 31 usd: 0 [1764593.455490] CPU4: hi: 186, btch: 31 usd: 0 [1764593.455491] CPU5: hi: 186, btch: 31 usd: 0 [1764593.455492] CPU6: hi: 186, btch: 31 usd: 0 [1764593.455494] CPU7: hi: 186, btch: 31 usd: 0 [1764593.455495] Node 1 Normal per-cpu: [1764593.455497] CPU0: hi: 186, btch: 31 usd: 0 [1764593.455498] CPU1: hi: 186, btch: 31 usd: 0 [1764593.455500] CPU2: hi: 186, btch: 31 usd: 0 [1764593.455501] CPU3: hi: 186, btch: 31 usd: 0 [1764593.455503] CPU4: hi: 186, btch: 31 usd: 0 [1764593.455504] CPU5: hi: 186, btch: 31 usd: 30 [1764593.455505] CPU6: hi: 186, btch: 31 usd: 0 [1764593.455507] CPU7: hi: 186, btch: 31 usd: 0 [1764593.455511] active_anon:4739030 inactive_anon:2482840 isolated_anon:0 [1764593.455511]
[Kernel-packages] [Bug 1319244] Re: iostat: Cannot open /proc/stat: Cannot allocate memory
On a freshish reboot (42 minutes) with some of the qemu VMs started root@lg-host2:~# cat /proc/buddyinfo Node 0, zone DMA 0 0 0 1 1 1 1 0 1 1 3 Node 0, zoneDMA32 6 4 9 7 7 7 5 3 4 1702 Node 0, zone Normal 47259 43506 37987 31332 23517 15376 8779 4479 2145 0 0 Node 1, zone Normal377112 54335 86 19 21 8 3 12 4008 -- You received this bug notification because you are a member of Kernel Packages, which is subscribed to linux in Ubuntu. https://bugs.launchpad.net/bugs/1319244 Title: iostat: Cannot open /proc/stat: Cannot allocate memory Status in “linux” package in Ubuntu: Confirmed Bug description: Intermitently I get errors stating that various programs cannot allocate memory when reading /proc/stat I have 2 servers that are affected by the issue. Probably a duplicate of 1226172 [1764593.455329] top: page allocation failure: order:4, mode:0x1040d0 [1764593.455335] CPU: 3 PID: 10323 Comm: top Tainted: GF O 3.11.0-18-generic #32-Ubuntu [1764593.455338] Hardware name: Intel Corporation S2400SC/S2400SC, BIOS SE5C600.86B.02.02.0002.122320131210 12/23/2013 [1764593.455340] 88042670b9d0 816e8571 001040d0 [1764593.455345] 88042670ba58 81144ae0 880a3fffcb48 [1764593.455348] 000e 88042670ba28 0040 0007 [1764593.455351] Call Trace: [1764593.455361] [816e8571] dump_stack+0x45/0x56 [1764593.455367] [81144ae0] warn_alloc_failed+0xf0/0x140 [1764593.455371] [81148a15] __alloc_pages_nodemask+0x725/0x920 [1764593.455376] [81184589] alloc_pages_current+0xa9/0x160 [1764593.455379] [81143bfe] __get_free_pages+0xe/0x50 [1764593.455384] [8118d75e] kmalloc_order_trace+0x2e/0xa0 [1764593.455388] [811c9960] ? single_open+0xb0/0xb0 [1764593.455391] [8118ee19] __kmalloc+0x159/0x180 [1764593.455393] [811c9960] ? single_open+0xb0/0xb0 [1764593.455398] [81213c10] stat_open+0x50/0xc0 [1764593.455401] [8120a700] proc_reg_open+0x70/0x110 [1764593.455405] [811a5d4b] do_dentry_open+0x1eb/0x280 [1764593.455408] [8120a690] ? proc_reg_release+0x70/0x70 [1764593.455411] [811a5e69] vfs_open+0x49/0x50 [1764593.455415] [811b5e13] do_last+0x1c3/0xe50 [1764593.455418] [8118e5d8] ? kmem_cache_alloc_trace+0x108/0x130 [1764593.455421] [811b6b61] path_openat+0xc1/0x630 [1764593.455426] [811689d9] ? handle_mm_fault+0x299/0x670 [1764593.455429] [811b7eda] do_filp_open+0x3a/0x90 [1764593.455433] [816ef78e] ? _raw_spin_lock+0xe/0x20 [1764593.455437] [811c4847] ? __alloc_fd+0xa7/0x130 [1764593.455440] [811a704c] do_sys_open+0x12c/0x270 [1764593.455445] [81074989] ? __set_current_blocked+0x49/0x60 [1764593.455448] [811a71ae] SyS_open+0x1e/0x20 [1764593.455452] [816f841d] system_call_fastpath+0x1a/0x1f [1764593.455454] Mem-Info: [1764593.455455] Node 0 DMA per-cpu: [1764593.455458] CPU0: hi:0, btch: 1 usd: 0 [1764593.455459] CPU1: hi:0, btch: 1 usd: 0 [1764593.455461] CPU2: hi:0, btch: 1 usd: 0 [1764593.455462] CPU3: hi:0, btch: 1 usd: 0 [1764593.455463] CPU4: hi:0, btch: 1 usd: 0 [1764593.455465] CPU5: hi:0, btch: 1 usd: 0 [1764593.455466] CPU6: hi:0, btch: 1 usd: 0 [1764593.455468] CPU7: hi:0, btch: 1 usd: 0 [1764593.455469] Node 0 DMA32 per-cpu: [1764593.455471] CPU0: hi: 186, btch: 31 usd: 0 [1764593.455472] CPU1: hi: 186, btch: 31 usd: 0 [1764593.455474] CPU2: hi: 186, btch: 31 usd: 0 [1764593.455475] CPU3: hi: 186, btch: 31 usd: 0 [1764593.455477] CPU4: hi: 186, btch: 31 usd: 0 [1764593.455478] CPU5: hi: 186, btch: 31 usd: 0 [1764593.455480] CPU6: hi: 186, btch: 31 usd: 0 [1764593.455481] CPU7: hi: 186, btch: 31 usd: 0 [1764593.455482] Node 0 Normal per-cpu: [1764593.455484] CPU0: hi: 186, btch: 31 usd: 0 [1764593.455485] CPU1: hi: 186, btch: 31 usd: 0 [1764593.455487] CPU2: hi: 186, btch: 31 usd: 0 [1764593.455488] CPU3: hi: 186, btch: 31 usd: 0 [1764593.455490] CPU4: hi: 186, btch: 31 usd: 0 [1764593.455491] CPU5: hi: 186, btch: 31 usd: 0 [1764593.455492] CPU6: hi: 186, btch: 31 usd: 0 [1764593.455494] CPU7: hi: 186, btch: 31 usd: 0 [1764593.455495] Node 1 Normal per-cpu: [1764593.455497] CPU0: hi: 186, btch: 31 usd: 0 [1764593.455498] CPU1: hi: 186, btch: 31 usd: 0 [1764593.455500] CPU2: hi: 186, btch: 31 usd: 0 [1764593.455501]
[Kernel-packages] [Bug 1319244] Re: iostat: Cannot open /proc/stat: Cannot allocate memory
The main use of the system is as a QEMU/KVM host, with currently 14 VMs running and some other processes. -- You received this bug notification because you are a member of Kernel Packages, which is subscribed to linux in Ubuntu. https://bugs.launchpad.net/bugs/1319244 Title: iostat: Cannot open /proc/stat: Cannot allocate memory Status in “linux” package in Ubuntu: Confirmed Bug description: Intermitently I get errors stating that various programs cannot allocate memory when reading /proc/stat I have 2 servers that are affected by the issue. Probably a duplicate of 1226172 [1764593.455329] top: page allocation failure: order:4, mode:0x1040d0 [1764593.455335] CPU: 3 PID: 10323 Comm: top Tainted: GF O 3.11.0-18-generic #32-Ubuntu [1764593.455338] Hardware name: Intel Corporation S2400SC/S2400SC, BIOS SE5C600.86B.02.02.0002.122320131210 12/23/2013 [1764593.455340] 88042670b9d0 816e8571 001040d0 [1764593.455345] 88042670ba58 81144ae0 880a3fffcb48 [1764593.455348] 000e 88042670ba28 0040 0007 [1764593.455351] Call Trace: [1764593.455361] [816e8571] dump_stack+0x45/0x56 [1764593.455367] [81144ae0] warn_alloc_failed+0xf0/0x140 [1764593.455371] [81148a15] __alloc_pages_nodemask+0x725/0x920 [1764593.455376] [81184589] alloc_pages_current+0xa9/0x160 [1764593.455379] [81143bfe] __get_free_pages+0xe/0x50 [1764593.455384] [8118d75e] kmalloc_order_trace+0x2e/0xa0 [1764593.455388] [811c9960] ? single_open+0xb0/0xb0 [1764593.455391] [8118ee19] __kmalloc+0x159/0x180 [1764593.455393] [811c9960] ? single_open+0xb0/0xb0 [1764593.455398] [81213c10] stat_open+0x50/0xc0 [1764593.455401] [8120a700] proc_reg_open+0x70/0x110 [1764593.455405] [811a5d4b] do_dentry_open+0x1eb/0x280 [1764593.455408] [8120a690] ? proc_reg_release+0x70/0x70 [1764593.455411] [811a5e69] vfs_open+0x49/0x50 [1764593.455415] [811b5e13] do_last+0x1c3/0xe50 [1764593.455418] [8118e5d8] ? kmem_cache_alloc_trace+0x108/0x130 [1764593.455421] [811b6b61] path_openat+0xc1/0x630 [1764593.455426] [811689d9] ? handle_mm_fault+0x299/0x670 [1764593.455429] [811b7eda] do_filp_open+0x3a/0x90 [1764593.455433] [816ef78e] ? _raw_spin_lock+0xe/0x20 [1764593.455437] [811c4847] ? __alloc_fd+0xa7/0x130 [1764593.455440] [811a704c] do_sys_open+0x12c/0x270 [1764593.455445] [81074989] ? __set_current_blocked+0x49/0x60 [1764593.455448] [811a71ae] SyS_open+0x1e/0x20 [1764593.455452] [816f841d] system_call_fastpath+0x1a/0x1f [1764593.455454] Mem-Info: [1764593.455455] Node 0 DMA per-cpu: [1764593.455458] CPU0: hi:0, btch: 1 usd: 0 [1764593.455459] CPU1: hi:0, btch: 1 usd: 0 [1764593.455461] CPU2: hi:0, btch: 1 usd: 0 [1764593.455462] CPU3: hi:0, btch: 1 usd: 0 [1764593.455463] CPU4: hi:0, btch: 1 usd: 0 [1764593.455465] CPU5: hi:0, btch: 1 usd: 0 [1764593.455466] CPU6: hi:0, btch: 1 usd: 0 [1764593.455468] CPU7: hi:0, btch: 1 usd: 0 [1764593.455469] Node 0 DMA32 per-cpu: [1764593.455471] CPU0: hi: 186, btch: 31 usd: 0 [1764593.455472] CPU1: hi: 186, btch: 31 usd: 0 [1764593.455474] CPU2: hi: 186, btch: 31 usd: 0 [1764593.455475] CPU3: hi: 186, btch: 31 usd: 0 [1764593.455477] CPU4: hi: 186, btch: 31 usd: 0 [1764593.455478] CPU5: hi: 186, btch: 31 usd: 0 [1764593.455480] CPU6: hi: 186, btch: 31 usd: 0 [1764593.455481] CPU7: hi: 186, btch: 31 usd: 0 [1764593.455482] Node 0 Normal per-cpu: [1764593.455484] CPU0: hi: 186, btch: 31 usd: 0 [1764593.455485] CPU1: hi: 186, btch: 31 usd: 0 [1764593.455487] CPU2: hi: 186, btch: 31 usd: 0 [1764593.455488] CPU3: hi: 186, btch: 31 usd: 0 [1764593.455490] CPU4: hi: 186, btch: 31 usd: 0 [1764593.455491] CPU5: hi: 186, btch: 31 usd: 0 [1764593.455492] CPU6: hi: 186, btch: 31 usd: 0 [1764593.455494] CPU7: hi: 186, btch: 31 usd: 0 [1764593.455495] Node 1 Normal per-cpu: [1764593.455497] CPU0: hi: 186, btch: 31 usd: 0 [1764593.455498] CPU1: hi: 186, btch: 31 usd: 0 [1764593.455500] CPU2: hi: 186, btch: 31 usd: 0 [1764593.455501] CPU3: hi: 186, btch: 31 usd: 0 [1764593.455503] CPU4: hi: 186, btch: 31 usd: 0 [1764593.455504] CPU5: hi: 186, btch: 31 usd: 30 [1764593.455505] CPU6: hi: 186, btch: 31 usd: 0 [1764593.455507] CPU7: hi: 186, btch: 31 usd: 0 [1764593.455511] active_anon:4739030 inactive_anon:2482840 isolated_anon:0 [1764593.455511] active_file:6228818
[Kernel-packages] [Bug 1319244] [NEW] iostat: Cannot open /proc/stat: Cannot allocate memory
Public bug reported: Intermitently I get errors stating that various programs cannot allocate memory when reading /proc/stat I have 2 servers that are affected by the issue. Probably a duplicate of 1226172 [1764593.455329] top: page allocation failure: order:4, mode:0x1040d0 [1764593.455335] CPU: 3 PID: 10323 Comm: top Tainted: GF O 3.11.0-18-generic #32-Ubuntu [1764593.455338] Hardware name: Intel Corporation S2400SC/S2400SC, BIOS SE5C600.86B.02.02.0002.122320131210 12/23/2013 [1764593.455340] 88042670b9d0 816e8571 001040d0 [1764593.455345] 88042670ba58 81144ae0 880a3fffcb48 [1764593.455348] 000e 88042670ba28 0040 0007 [1764593.455351] Call Trace: [1764593.455361] [816e8571] dump_stack+0x45/0x56 [1764593.455367] [81144ae0] warn_alloc_failed+0xf0/0x140 [1764593.455371] [81148a15] __alloc_pages_nodemask+0x725/0x920 [1764593.455376] [81184589] alloc_pages_current+0xa9/0x160 [1764593.455379] [81143bfe] __get_free_pages+0xe/0x50 [1764593.455384] [8118d75e] kmalloc_order_trace+0x2e/0xa0 [1764593.455388] [811c9960] ? single_open+0xb0/0xb0 [1764593.455391] [8118ee19] __kmalloc+0x159/0x180 [1764593.455393] [811c9960] ? single_open+0xb0/0xb0 [1764593.455398] [81213c10] stat_open+0x50/0xc0 [1764593.455401] [8120a700] proc_reg_open+0x70/0x110 [1764593.455405] [811a5d4b] do_dentry_open+0x1eb/0x280 [1764593.455408] [8120a690] ? proc_reg_release+0x70/0x70 [1764593.455411] [811a5e69] vfs_open+0x49/0x50 [1764593.455415] [811b5e13] do_last+0x1c3/0xe50 [1764593.455418] [8118e5d8] ? kmem_cache_alloc_trace+0x108/0x130 [1764593.455421] [811b6b61] path_openat+0xc1/0x630 [1764593.455426] [811689d9] ? handle_mm_fault+0x299/0x670 [1764593.455429] [811b7eda] do_filp_open+0x3a/0x90 [1764593.455433] [816ef78e] ? _raw_spin_lock+0xe/0x20 [1764593.455437] [811c4847] ? __alloc_fd+0xa7/0x130 [1764593.455440] [811a704c] do_sys_open+0x12c/0x270 [1764593.455445] [81074989] ? __set_current_blocked+0x49/0x60 [1764593.455448] [811a71ae] SyS_open+0x1e/0x20 [1764593.455452] [816f841d] system_call_fastpath+0x1a/0x1f [1764593.455454] Mem-Info: [1764593.455455] Node 0 DMA per-cpu: [1764593.455458] CPU0: hi:0, btch: 1 usd: 0 [1764593.455459] CPU1: hi:0, btch: 1 usd: 0 [1764593.455461] CPU2: hi:0, btch: 1 usd: 0 [1764593.455462] CPU3: hi:0, btch: 1 usd: 0 [1764593.455463] CPU4: hi:0, btch: 1 usd: 0 [1764593.455465] CPU5: hi:0, btch: 1 usd: 0 [1764593.455466] CPU6: hi:0, btch: 1 usd: 0 [1764593.455468] CPU7: hi:0, btch: 1 usd: 0 [1764593.455469] Node 0 DMA32 per-cpu: [1764593.455471] CPU0: hi: 186, btch: 31 usd: 0 [1764593.455472] CPU1: hi: 186, btch: 31 usd: 0 [1764593.455474] CPU2: hi: 186, btch: 31 usd: 0 [1764593.455475] CPU3: hi: 186, btch: 31 usd: 0 [1764593.455477] CPU4: hi: 186, btch: 31 usd: 0 [1764593.455478] CPU5: hi: 186, btch: 31 usd: 0 [1764593.455480] CPU6: hi: 186, btch: 31 usd: 0 [1764593.455481] CPU7: hi: 186, btch: 31 usd: 0 [1764593.455482] Node 0 Normal per-cpu: [1764593.455484] CPU0: hi: 186, btch: 31 usd: 0 [1764593.455485] CPU1: hi: 186, btch: 31 usd: 0 [1764593.455487] CPU2: hi: 186, btch: 31 usd: 0 [1764593.455488] CPU3: hi: 186, btch: 31 usd: 0 [1764593.455490] CPU4: hi: 186, btch: 31 usd: 0 [1764593.455491] CPU5: hi: 186, btch: 31 usd: 0 [1764593.455492] CPU6: hi: 186, btch: 31 usd: 0 [1764593.455494] CPU7: hi: 186, btch: 31 usd: 0 [1764593.455495] Node 1 Normal per-cpu: [1764593.455497] CPU0: hi: 186, btch: 31 usd: 0 [1764593.455498] CPU1: hi: 186, btch: 31 usd: 0 [1764593.455500] CPU2: hi: 186, btch: 31 usd: 0 [1764593.455501] CPU3: hi: 186, btch: 31 usd: 0 [1764593.455503] CPU4: hi: 186, btch: 31 usd: 0 [1764593.455504] CPU5: hi: 186, btch: 31 usd: 30 [1764593.455505] CPU6: hi: 186, btch: 31 usd: 0 [1764593.455507] CPU7: hi: 186, btch: 31 usd: 0 [1764593.455511] active_anon:4739030 inactive_anon:2482840 isolated_anon:0 [1764593.455511] active_file:6228818 inactive_file:5945293 isolated_file:0 [1764593.455511] unevictable:1459 dirty:61 writeback:0 unstable:0 [1764593.455511] free:318692 slab_reclaimable:462577 slab_unreclaimable:149699 [1764593.455511] mapped:25851 shmem:2934 pagetables:27313 bounce:0 [1764593.455511] free_cma:0 [1764593.455514] Node 0 DMA free:15848kB min:16kB low:20kB high:24kB active_anon:0kB inactive_anon:0kB active_file:0kB inactive_file:0kB unevictable:0kB isolated(anon):0kB isolated(file):0kB present:15932kB managed:15848kB mlocked:0kB dirty:0kB writeback:0kB
