[Kernel-packages] [Bug 1319244] Re: iostat: Cannot open /proc/stat: Cannot allocate memory
** Changed in: linux (Ubuntu Trusty) Status: Fix Committed => Fix Released ** Tags removed: kernel-bug-break-fix -- You received this bug notification because you are a member of Kernel Packages, which is subscribed to linux in Ubuntu. https://bugs.launchpad.net/bugs/1319244 Title: iostat: Cannot open /proc/stat: Cannot allocate memory Status in “linux” package in Ubuntu: Fix Released Status in “linux” source package in Trusty: Fix Released Bug description: break-fix: 59a32e2ce5eb809967cac4e718bc527beca83c59 f74373a5cc7a0155d232c4e999648c7a95435bb2 break-fix: 59a32e2ce5eb809967cac4e718bc527beca83c59 058504edd02667eef8fac9be27ab3ea74332e9b4 Intermitently I get errors stating that various programs cannot allocate memory when reading /proc/stat I have 2 servers that are affected by the issue. Probably a duplicate of 1226172 [1764593.455329] top: page allocation failure: order:4, mode:0x1040d0 [1764593.455335] CPU: 3 PID: 10323 Comm: top Tainted: GF O 3.11.0-18-generic #32-Ubuntu [1764593.455338] Hardware name: Intel Corporation S2400SC/S2400SC, BIOS SE5C600.86B.02.02.0002.122320131210 12/23/2013 [1764593.455340] 88042670b9d0 816e8571 001040d0 [1764593.455345] 88042670ba58 81144ae0 880a3fffcb48 [1764593.455348] 000e 88042670ba28 0040 0007 [1764593.455351] Call Trace: [1764593.455361] [] dump_stack+0x45/0x56 [1764593.455367] [] warn_alloc_failed+0xf0/0x140 [1764593.455371] [] __alloc_pages_nodemask+0x725/0x920 [1764593.455376] [] alloc_pages_current+0xa9/0x160 [1764593.455379] [] __get_free_pages+0xe/0x50 [1764593.455384] [] kmalloc_order_trace+0x2e/0xa0 [1764593.455388] [] ? single_open+0xb0/0xb0 [1764593.455391] [] __kmalloc+0x159/0x180 [1764593.455393] [] ? single_open+0xb0/0xb0 [1764593.455398] [] stat_open+0x50/0xc0 [1764593.455401] [] proc_reg_open+0x70/0x110 [1764593.455405] [] do_dentry_open+0x1eb/0x280 [1764593.455408] [] ? proc_reg_release+0x70/0x70 [1764593.455411] [] vfs_open+0x49/0x50 [1764593.455415] [] do_last+0x1c3/0xe50 [1764593.455418] [] ? kmem_cache_alloc_trace+0x108/0x130 [1764593.455421] [] path_openat+0xc1/0x630 [1764593.455426] [] ? handle_mm_fault+0x299/0x670 [1764593.455429] [] do_filp_open+0x3a/0x90 [1764593.455433] [] ? _raw_spin_lock+0xe/0x20 [1764593.455437] [] ? __alloc_fd+0xa7/0x130 [1764593.455440] [] do_sys_open+0x12c/0x270 [1764593.455445] [] ? __set_current_blocked+0x49/0x60 [1764593.455448] [] SyS_open+0x1e/0x20 [1764593.455452] [] system_call_fastpath+0x1a/0x1f [1764593.455454] Mem-Info: [1764593.455455] Node 0 DMA per-cpu: [1764593.455458] CPU0: hi:0, btch: 1 usd: 0 [1764593.455459] CPU1: hi:0, btch: 1 usd: 0 [1764593.455461] CPU2: hi:0, btch: 1 usd: 0 [1764593.455462] CPU3: hi:0, btch: 1 usd: 0 [1764593.455463] CPU4: hi:0, btch: 1 usd: 0 [1764593.455465] CPU5: hi:0, btch: 1 usd: 0 [1764593.455466] CPU6: hi:0, btch: 1 usd: 0 [1764593.455468] CPU7: hi:0, btch: 1 usd: 0 [1764593.455469] Node 0 DMA32 per-cpu: [1764593.455471] CPU0: hi: 186, btch: 31 usd: 0 [1764593.455472] CPU1: hi: 186, btch: 31 usd: 0 [1764593.455474] CPU2: hi: 186, btch: 31 usd: 0 [1764593.455475] CPU3: hi: 186, btch: 31 usd: 0 [1764593.455477] CPU4: hi: 186, btch: 31 usd: 0 [1764593.455478] CPU5: hi: 186, btch: 31 usd: 0 [1764593.455480] CPU6: hi: 186, btch: 31 usd: 0 [1764593.455481] CPU7: hi: 186, btch: 31 usd: 0 [1764593.455482] Node 0 Normal per-cpu: [1764593.455484] CPU0: hi: 186, btch: 31 usd: 0 [1764593.455485] CPU1: hi: 186, btch: 31 usd: 0 [1764593.455487] CPU2: hi: 186, btch: 31 usd: 0 [1764593.455488] CPU3: hi: 186, btch: 31 usd: 0 [1764593.455490] CPU4: hi: 186, btch: 31 usd: 0 [1764593.455491] CPU5: hi: 186, btch: 31 usd: 0 [1764593.455492] CPU6: hi: 186, btch: 31 usd: 0 [1764593.455494] CPU7: hi: 186, btch: 31 usd: 0 [1764593.455495] Node 1 Normal per-cpu: [1764593.455497] CPU0: hi: 186, btch: 31 usd: 0 [1764593.455498] CPU1: hi: 186, btch: 31 usd: 0 [1764593.455500] CPU2: hi: 186, btch: 31 usd: 0 [1764593.455501] CPU3: hi: 186, btch: 31 usd: 0 [1764593.455503] CPU4: hi: 186, btch: 31 usd: 0 [1764593.455504] CPU5: hi: 186, btch: 31 usd: 30 [1764593.455505] CPU6: hi: 186, btch: 31 usd: 0 [1764593.455507] CPU7: hi: 186, btch: 31 usd: 0 [1764593.455511] active_anon:4739030 inactive_anon:2482840 isolated_anon:0 [1764593.455511] active_file:6228818 inactive_file:5945293 isolated_file:0 [1764593.455511] unevictable:1459 dirty:61 writeback:0 unstable:0 [1764593.455511] free:318692 slab_
[Kernel-packages] [Bug 1319244] Re: iostat: Cannot open /proc/stat: Cannot allocate memory
** Changed in: linux (Ubuntu Trusty) Status: Confirmed => Fix Committed -- You received this bug notification because you are a member of Kernel Packages, which is subscribed to linux in Ubuntu. https://bugs.launchpad.net/bugs/1319244 Title: iostat: Cannot open /proc/stat: Cannot allocate memory Status in “linux” package in Ubuntu: Fix Released Status in “linux” source package in Trusty: Fix Committed Bug description: break-fix: 59a32e2ce5eb809967cac4e718bc527beca83c59 f74373a5cc7a0155d232c4e999648c7a95435bb2 break-fix: 59a32e2ce5eb809967cac4e718bc527beca83c59 058504edd02667eef8fac9be27ab3ea74332e9b4 Intermitently I get errors stating that various programs cannot allocate memory when reading /proc/stat I have 2 servers that are affected by the issue. Probably a duplicate of 1226172 [1764593.455329] top: page allocation failure: order:4, mode:0x1040d0 [1764593.455335] CPU: 3 PID: 10323 Comm: top Tainted: GF O 3.11.0-18-generic #32-Ubuntu [1764593.455338] Hardware name: Intel Corporation S2400SC/S2400SC, BIOS SE5C600.86B.02.02.0002.122320131210 12/23/2013 [1764593.455340] 88042670b9d0 816e8571 001040d0 [1764593.455345] 88042670ba58 81144ae0 880a3fffcb48 [1764593.455348] 000e 88042670ba28 0040 0007 [1764593.455351] Call Trace: [1764593.455361] [] dump_stack+0x45/0x56 [1764593.455367] [] warn_alloc_failed+0xf0/0x140 [1764593.455371] [] __alloc_pages_nodemask+0x725/0x920 [1764593.455376] [] alloc_pages_current+0xa9/0x160 [1764593.455379] [] __get_free_pages+0xe/0x50 [1764593.455384] [] kmalloc_order_trace+0x2e/0xa0 [1764593.455388] [] ? single_open+0xb0/0xb0 [1764593.455391] [] __kmalloc+0x159/0x180 [1764593.455393] [] ? single_open+0xb0/0xb0 [1764593.455398] [] stat_open+0x50/0xc0 [1764593.455401] [] proc_reg_open+0x70/0x110 [1764593.455405] [] do_dentry_open+0x1eb/0x280 [1764593.455408] [] ? proc_reg_release+0x70/0x70 [1764593.455411] [] vfs_open+0x49/0x50 [1764593.455415] [] do_last+0x1c3/0xe50 [1764593.455418] [] ? kmem_cache_alloc_trace+0x108/0x130 [1764593.455421] [] path_openat+0xc1/0x630 [1764593.455426] [] ? handle_mm_fault+0x299/0x670 [1764593.455429] [] do_filp_open+0x3a/0x90 [1764593.455433] [] ? _raw_spin_lock+0xe/0x20 [1764593.455437] [] ? __alloc_fd+0xa7/0x130 [1764593.455440] [] do_sys_open+0x12c/0x270 [1764593.455445] [] ? __set_current_blocked+0x49/0x60 [1764593.455448] [] SyS_open+0x1e/0x20 [1764593.455452] [] system_call_fastpath+0x1a/0x1f [1764593.455454] Mem-Info: [1764593.455455] Node 0 DMA per-cpu: [1764593.455458] CPU0: hi:0, btch: 1 usd: 0 [1764593.455459] CPU1: hi:0, btch: 1 usd: 0 [1764593.455461] CPU2: hi:0, btch: 1 usd: 0 [1764593.455462] CPU3: hi:0, btch: 1 usd: 0 [1764593.455463] CPU4: hi:0, btch: 1 usd: 0 [1764593.455465] CPU5: hi:0, btch: 1 usd: 0 [1764593.455466] CPU6: hi:0, btch: 1 usd: 0 [1764593.455468] CPU7: hi:0, btch: 1 usd: 0 [1764593.455469] Node 0 DMA32 per-cpu: [1764593.455471] CPU0: hi: 186, btch: 31 usd: 0 [1764593.455472] CPU1: hi: 186, btch: 31 usd: 0 [1764593.455474] CPU2: hi: 186, btch: 31 usd: 0 [1764593.455475] CPU3: hi: 186, btch: 31 usd: 0 [1764593.455477] CPU4: hi: 186, btch: 31 usd: 0 [1764593.455478] CPU5: hi: 186, btch: 31 usd: 0 [1764593.455480] CPU6: hi: 186, btch: 31 usd: 0 [1764593.455481] CPU7: hi: 186, btch: 31 usd: 0 [1764593.455482] Node 0 Normal per-cpu: [1764593.455484] CPU0: hi: 186, btch: 31 usd: 0 [1764593.455485] CPU1: hi: 186, btch: 31 usd: 0 [1764593.455487] CPU2: hi: 186, btch: 31 usd: 0 [1764593.455488] CPU3: hi: 186, btch: 31 usd: 0 [1764593.455490] CPU4: hi: 186, btch: 31 usd: 0 [1764593.455491] CPU5: hi: 186, btch: 31 usd: 0 [1764593.455492] CPU6: hi: 186, btch: 31 usd: 0 [1764593.455494] CPU7: hi: 186, btch: 31 usd: 0 [1764593.455495] Node 1 Normal per-cpu: [1764593.455497] CPU0: hi: 186, btch: 31 usd: 0 [1764593.455498] CPU1: hi: 186, btch: 31 usd: 0 [1764593.455500] CPU2: hi: 186, btch: 31 usd: 0 [1764593.455501] CPU3: hi: 186, btch: 31 usd: 0 [1764593.455503] CPU4: hi: 186, btch: 31 usd: 0 [1764593.455504] CPU5: hi: 186, btch: 31 usd: 30 [1764593.455505] CPU6: hi: 186, btch: 31 usd: 0 [1764593.455507] CPU7: hi: 186, btch: 31 usd: 0 [1764593.455511] active_anon:4739030 inactive_anon:2482840 isolated_anon:0 [1764593.455511] active_file:6228818 inactive_file:5945293 isolated_file:0 [1764593.455511] unevictable:1459 dirty:61 writeback:0 unstable:0 [1764593.455511] free:318692 slab_reclaimable:462577 slab_unreclaimable:14
[Kernel-packages] [Bug 1319244] Re: iostat: Cannot open /proc/stat: Cannot allocate memory
** Changed in: linux (Ubuntu Trusty) Status: Triaged => Confirmed -- You received this bug notification because you are a member of Kernel Packages, which is subscribed to linux in Ubuntu. https://bugs.launchpad.net/bugs/1319244 Title: iostat: Cannot open /proc/stat: Cannot allocate memory Status in “linux” package in Ubuntu: Fix Released Status in “linux” source package in Trusty: Confirmed Bug description: break-fix: 59a32e2ce5eb809967cac4e718bc527beca83c59 f74373a5cc7a0155d232c4e999648c7a95435bb2 break-fix: 59a32e2ce5eb809967cac4e718bc527beca83c59 058504edd02667eef8fac9be27ab3ea74332e9b4 Intermitently I get errors stating that various programs cannot allocate memory when reading /proc/stat I have 2 servers that are affected by the issue. Probably a duplicate of 1226172 [1764593.455329] top: page allocation failure: order:4, mode:0x1040d0 [1764593.455335] CPU: 3 PID: 10323 Comm: top Tainted: GF O 3.11.0-18-generic #32-Ubuntu [1764593.455338] Hardware name: Intel Corporation S2400SC/S2400SC, BIOS SE5C600.86B.02.02.0002.122320131210 12/23/2013 [1764593.455340] 88042670b9d0 816e8571 001040d0 [1764593.455345] 88042670ba58 81144ae0 880a3fffcb48 [1764593.455348] 000e 88042670ba28 0040 0007 [1764593.455351] Call Trace: [1764593.455361] [] dump_stack+0x45/0x56 [1764593.455367] [] warn_alloc_failed+0xf0/0x140 [1764593.455371] [] __alloc_pages_nodemask+0x725/0x920 [1764593.455376] [] alloc_pages_current+0xa9/0x160 [1764593.455379] [] __get_free_pages+0xe/0x50 [1764593.455384] [] kmalloc_order_trace+0x2e/0xa0 [1764593.455388] [] ? single_open+0xb0/0xb0 [1764593.455391] [] __kmalloc+0x159/0x180 [1764593.455393] [] ? single_open+0xb0/0xb0 [1764593.455398] [] stat_open+0x50/0xc0 [1764593.455401] [] proc_reg_open+0x70/0x110 [1764593.455405] [] do_dentry_open+0x1eb/0x280 [1764593.455408] [] ? proc_reg_release+0x70/0x70 [1764593.455411] [] vfs_open+0x49/0x50 [1764593.455415] [] do_last+0x1c3/0xe50 [1764593.455418] [] ? kmem_cache_alloc_trace+0x108/0x130 [1764593.455421] [] path_openat+0xc1/0x630 [1764593.455426] [] ? handle_mm_fault+0x299/0x670 [1764593.455429] [] do_filp_open+0x3a/0x90 [1764593.455433] [] ? _raw_spin_lock+0xe/0x20 [1764593.455437] [] ? __alloc_fd+0xa7/0x130 [1764593.455440] [] do_sys_open+0x12c/0x270 [1764593.455445] [] ? __set_current_blocked+0x49/0x60 [1764593.455448] [] SyS_open+0x1e/0x20 [1764593.455452] [] system_call_fastpath+0x1a/0x1f [1764593.455454] Mem-Info: [1764593.455455] Node 0 DMA per-cpu: [1764593.455458] CPU0: hi:0, btch: 1 usd: 0 [1764593.455459] CPU1: hi:0, btch: 1 usd: 0 [1764593.455461] CPU2: hi:0, btch: 1 usd: 0 [1764593.455462] CPU3: hi:0, btch: 1 usd: 0 [1764593.455463] CPU4: hi:0, btch: 1 usd: 0 [1764593.455465] CPU5: hi:0, btch: 1 usd: 0 [1764593.455466] CPU6: hi:0, btch: 1 usd: 0 [1764593.455468] CPU7: hi:0, btch: 1 usd: 0 [1764593.455469] Node 0 DMA32 per-cpu: [1764593.455471] CPU0: hi: 186, btch: 31 usd: 0 [1764593.455472] CPU1: hi: 186, btch: 31 usd: 0 [1764593.455474] CPU2: hi: 186, btch: 31 usd: 0 [1764593.455475] CPU3: hi: 186, btch: 31 usd: 0 [1764593.455477] CPU4: hi: 186, btch: 31 usd: 0 [1764593.455478] CPU5: hi: 186, btch: 31 usd: 0 [1764593.455480] CPU6: hi: 186, btch: 31 usd: 0 [1764593.455481] CPU7: hi: 186, btch: 31 usd: 0 [1764593.455482] Node 0 Normal per-cpu: [1764593.455484] CPU0: hi: 186, btch: 31 usd: 0 [1764593.455485] CPU1: hi: 186, btch: 31 usd: 0 [1764593.455487] CPU2: hi: 186, btch: 31 usd: 0 [1764593.455488] CPU3: hi: 186, btch: 31 usd: 0 [1764593.455490] CPU4: hi: 186, btch: 31 usd: 0 [1764593.455491] CPU5: hi: 186, btch: 31 usd: 0 [1764593.455492] CPU6: hi: 186, btch: 31 usd: 0 [1764593.455494] CPU7: hi: 186, btch: 31 usd: 0 [1764593.455495] Node 1 Normal per-cpu: [1764593.455497] CPU0: hi: 186, btch: 31 usd: 0 [1764593.455498] CPU1: hi: 186, btch: 31 usd: 0 [1764593.455500] CPU2: hi: 186, btch: 31 usd: 0 [1764593.455501] CPU3: hi: 186, btch: 31 usd: 0 [1764593.455503] CPU4: hi: 186, btch: 31 usd: 0 [1764593.455504] CPU5: hi: 186, btch: 31 usd: 30 [1764593.455505] CPU6: hi: 186, btch: 31 usd: 0 [1764593.455507] CPU7: hi: 186, btch: 31 usd: 0 [1764593.455511] active_anon:4739030 inactive_anon:2482840 isolated_anon:0 [1764593.455511] active_file:6228818 inactive_file:5945293 isolated_file:0 [1764593.455511] unevictable:1459 dirty:61 writeback:0 unstable:0 [1764593.455511] free:318692 slab_reclaimable:462577 slab_unreclaimable:149699 [17
[Kernel-packages] [Bug 1319244] Re: iostat: Cannot open /proc/stat: Cannot allocate memory
** Also affects: linux (Ubuntu Trusty) Importance: Undecided Status: New ** Changed in: linux (Ubuntu Trusty) Importance: Undecided => Medium ** Changed in: linux (Ubuntu Trusty) Status: New => Triaged ** Tags added: kernel-bug-break-fix -- You received this bug notification because you are a member of Kernel Packages, which is subscribed to linux in Ubuntu. https://bugs.launchpad.net/bugs/1319244 Title: iostat: Cannot open /proc/stat: Cannot allocate memory Status in “linux” package in Ubuntu: Fix Released Status in “linux” source package in Trusty: Triaged Bug description: break-fix: 59a32e2ce5eb809967cac4e718bc527beca83c59 f74373a5cc7a0155d232c4e999648c7a95435bb2 break-fix: 59a32e2ce5eb809967cac4e718bc527beca83c59 058504edd02667eef8fac9be27ab3ea74332e9b4 Intermitently I get errors stating that various programs cannot allocate memory when reading /proc/stat I have 2 servers that are affected by the issue. Probably a duplicate of 1226172 [1764593.455329] top: page allocation failure: order:4, mode:0x1040d0 [1764593.455335] CPU: 3 PID: 10323 Comm: top Tainted: GF O 3.11.0-18-generic #32-Ubuntu [1764593.455338] Hardware name: Intel Corporation S2400SC/S2400SC, BIOS SE5C600.86B.02.02.0002.122320131210 12/23/2013 [1764593.455340] 88042670b9d0 816e8571 001040d0 [1764593.455345] 88042670ba58 81144ae0 880a3fffcb48 [1764593.455348] 000e 88042670ba28 0040 0007 [1764593.455351] Call Trace: [1764593.455361] [] dump_stack+0x45/0x56 [1764593.455367] [] warn_alloc_failed+0xf0/0x140 [1764593.455371] [] __alloc_pages_nodemask+0x725/0x920 [1764593.455376] [] alloc_pages_current+0xa9/0x160 [1764593.455379] [] __get_free_pages+0xe/0x50 [1764593.455384] [] kmalloc_order_trace+0x2e/0xa0 [1764593.455388] [] ? single_open+0xb0/0xb0 [1764593.455391] [] __kmalloc+0x159/0x180 [1764593.455393] [] ? single_open+0xb0/0xb0 [1764593.455398] [] stat_open+0x50/0xc0 [1764593.455401] [] proc_reg_open+0x70/0x110 [1764593.455405] [] do_dentry_open+0x1eb/0x280 [1764593.455408] [] ? proc_reg_release+0x70/0x70 [1764593.455411] [] vfs_open+0x49/0x50 [1764593.455415] [] do_last+0x1c3/0xe50 [1764593.455418] [] ? kmem_cache_alloc_trace+0x108/0x130 [1764593.455421] [] path_openat+0xc1/0x630 [1764593.455426] [] ? handle_mm_fault+0x299/0x670 [1764593.455429] [] do_filp_open+0x3a/0x90 [1764593.455433] [] ? _raw_spin_lock+0xe/0x20 [1764593.455437] [] ? __alloc_fd+0xa7/0x130 [1764593.455440] [] do_sys_open+0x12c/0x270 [1764593.455445] [] ? __set_current_blocked+0x49/0x60 [1764593.455448] [] SyS_open+0x1e/0x20 [1764593.455452] [] system_call_fastpath+0x1a/0x1f [1764593.455454] Mem-Info: [1764593.455455] Node 0 DMA per-cpu: [1764593.455458] CPU0: hi:0, btch: 1 usd: 0 [1764593.455459] CPU1: hi:0, btch: 1 usd: 0 [1764593.455461] CPU2: hi:0, btch: 1 usd: 0 [1764593.455462] CPU3: hi:0, btch: 1 usd: 0 [1764593.455463] CPU4: hi:0, btch: 1 usd: 0 [1764593.455465] CPU5: hi:0, btch: 1 usd: 0 [1764593.455466] CPU6: hi:0, btch: 1 usd: 0 [1764593.455468] CPU7: hi:0, btch: 1 usd: 0 [1764593.455469] Node 0 DMA32 per-cpu: [1764593.455471] CPU0: hi: 186, btch: 31 usd: 0 [1764593.455472] CPU1: hi: 186, btch: 31 usd: 0 [1764593.455474] CPU2: hi: 186, btch: 31 usd: 0 [1764593.455475] CPU3: hi: 186, btch: 31 usd: 0 [1764593.455477] CPU4: hi: 186, btch: 31 usd: 0 [1764593.455478] CPU5: hi: 186, btch: 31 usd: 0 [1764593.455480] CPU6: hi: 186, btch: 31 usd: 0 [1764593.455481] CPU7: hi: 186, btch: 31 usd: 0 [1764593.455482] Node 0 Normal per-cpu: [1764593.455484] CPU0: hi: 186, btch: 31 usd: 0 [1764593.455485] CPU1: hi: 186, btch: 31 usd: 0 [1764593.455487] CPU2: hi: 186, btch: 31 usd: 0 [1764593.455488] CPU3: hi: 186, btch: 31 usd: 0 [1764593.455490] CPU4: hi: 186, btch: 31 usd: 0 [1764593.455491] CPU5: hi: 186, btch: 31 usd: 0 [1764593.455492] CPU6: hi: 186, btch: 31 usd: 0 [1764593.455494] CPU7: hi: 186, btch: 31 usd: 0 [1764593.455495] Node 1 Normal per-cpu: [1764593.455497] CPU0: hi: 186, btch: 31 usd: 0 [1764593.455498] CPU1: hi: 186, btch: 31 usd: 0 [1764593.455500] CPU2: hi: 186, btch: 31 usd: 0 [1764593.455501] CPU3: hi: 186, btch: 31 usd: 0 [1764593.455503] CPU4: hi: 186, btch: 31 usd: 0 [1764593.455504] CPU5: hi: 186, btch: 31 usd: 30 [1764593.455505] CPU6: hi: 186, btch: 31 usd: 0 [1764593.455507] CPU7: hi: 186, btch: 31 usd: 0 [1764593.455511] active_anon:4739030 inactive_anon:2482840 isolated_anon:0 [1764593.455511] active_file:6228818 inactive_
[Kernel-packages] [Bug 1319244] Re: iostat: Cannot open /proc/stat: Cannot allocate memory
I would doubt Saucy by now since it is almost EOL due to the reduced support of non-LTS releases. Trusty should get it through the normal upstream-stable path. -- You received this bug notification because you are a member of Kernel Packages, which is subscribed to linux in Ubuntu. https://bugs.launchpad.net/bugs/1319244 Title: iostat: Cannot open /proc/stat: Cannot allocate memory Status in “linux” package in Ubuntu: Fix Released Bug description: break-fix: 59a32e2ce5eb809967cac4e718bc527beca83c59 f74373a5cc7a0155d232c4e999648c7a95435bb2 break-fix: 59a32e2ce5eb809967cac4e718bc527beca83c59 058504edd02667eef8fac9be27ab3ea74332e9b4 Intermitently I get errors stating that various programs cannot allocate memory when reading /proc/stat I have 2 servers that are affected by the issue. Probably a duplicate of 1226172 [1764593.455329] top: page allocation failure: order:4, mode:0x1040d0 [1764593.455335] CPU: 3 PID: 10323 Comm: top Tainted: GF O 3.11.0-18-generic #32-Ubuntu [1764593.455338] Hardware name: Intel Corporation S2400SC/S2400SC, BIOS SE5C600.86B.02.02.0002.122320131210 12/23/2013 [1764593.455340] 88042670b9d0 816e8571 001040d0 [1764593.455345] 88042670ba58 81144ae0 880a3fffcb48 [1764593.455348] 000e 88042670ba28 0040 0007 [1764593.455351] Call Trace: [1764593.455361] [] dump_stack+0x45/0x56 [1764593.455367] [] warn_alloc_failed+0xf0/0x140 [1764593.455371] [] __alloc_pages_nodemask+0x725/0x920 [1764593.455376] [] alloc_pages_current+0xa9/0x160 [1764593.455379] [] __get_free_pages+0xe/0x50 [1764593.455384] [] kmalloc_order_trace+0x2e/0xa0 [1764593.455388] [] ? single_open+0xb0/0xb0 [1764593.455391] [] __kmalloc+0x159/0x180 [1764593.455393] [] ? single_open+0xb0/0xb0 [1764593.455398] [] stat_open+0x50/0xc0 [1764593.455401] [] proc_reg_open+0x70/0x110 [1764593.455405] [] do_dentry_open+0x1eb/0x280 [1764593.455408] [] ? proc_reg_release+0x70/0x70 [1764593.455411] [] vfs_open+0x49/0x50 [1764593.455415] [] do_last+0x1c3/0xe50 [1764593.455418] [] ? kmem_cache_alloc_trace+0x108/0x130 [1764593.455421] [] path_openat+0xc1/0x630 [1764593.455426] [] ? handle_mm_fault+0x299/0x670 [1764593.455429] [] do_filp_open+0x3a/0x90 [1764593.455433] [] ? _raw_spin_lock+0xe/0x20 [1764593.455437] [] ? __alloc_fd+0xa7/0x130 [1764593.455440] [] do_sys_open+0x12c/0x270 [1764593.455445] [] ? __set_current_blocked+0x49/0x60 [1764593.455448] [] SyS_open+0x1e/0x20 [1764593.455452] [] system_call_fastpath+0x1a/0x1f [1764593.455454] Mem-Info: [1764593.455455] Node 0 DMA per-cpu: [1764593.455458] CPU0: hi:0, btch: 1 usd: 0 [1764593.455459] CPU1: hi:0, btch: 1 usd: 0 [1764593.455461] CPU2: hi:0, btch: 1 usd: 0 [1764593.455462] CPU3: hi:0, btch: 1 usd: 0 [1764593.455463] CPU4: hi:0, btch: 1 usd: 0 [1764593.455465] CPU5: hi:0, btch: 1 usd: 0 [1764593.455466] CPU6: hi:0, btch: 1 usd: 0 [1764593.455468] CPU7: hi:0, btch: 1 usd: 0 [1764593.455469] Node 0 DMA32 per-cpu: [1764593.455471] CPU0: hi: 186, btch: 31 usd: 0 [1764593.455472] CPU1: hi: 186, btch: 31 usd: 0 [1764593.455474] CPU2: hi: 186, btch: 31 usd: 0 [1764593.455475] CPU3: hi: 186, btch: 31 usd: 0 [1764593.455477] CPU4: hi: 186, btch: 31 usd: 0 [1764593.455478] CPU5: hi: 186, btch: 31 usd: 0 [1764593.455480] CPU6: hi: 186, btch: 31 usd: 0 [1764593.455481] CPU7: hi: 186, btch: 31 usd: 0 [1764593.455482] Node 0 Normal per-cpu: [1764593.455484] CPU0: hi: 186, btch: 31 usd: 0 [1764593.455485] CPU1: hi: 186, btch: 31 usd: 0 [1764593.455487] CPU2: hi: 186, btch: 31 usd: 0 [1764593.455488] CPU3: hi: 186, btch: 31 usd: 0 [1764593.455490] CPU4: hi: 186, btch: 31 usd: 0 [1764593.455491] CPU5: hi: 186, btch: 31 usd: 0 [1764593.455492] CPU6: hi: 186, btch: 31 usd: 0 [1764593.455494] CPU7: hi: 186, btch: 31 usd: 0 [1764593.455495] Node 1 Normal per-cpu: [1764593.455497] CPU0: hi: 186, btch: 31 usd: 0 [1764593.455498] CPU1: hi: 186, btch: 31 usd: 0 [1764593.455500] CPU2: hi: 186, btch: 31 usd: 0 [1764593.455501] CPU3: hi: 186, btch: 31 usd: 0 [1764593.455503] CPU4: hi: 186, btch: 31 usd: 0 [1764593.455504] CPU5: hi: 186, btch: 31 usd: 30 [1764593.455505] CPU6: hi: 186, btch: 31 usd: 0 [1764593.455507] CPU7: hi: 186, btch: 31 usd: 0 [1764593.455511] active_anon:4739030 inactive_anon:2482840 isolated_anon:0 [1764593.455511] active_file:6228818 inactive_file:5945293 isolated_file:0 [1764593.455511] unevictable:1459 dirty:61 writeback:0 unstable:0 [1764593.455511] free:318692 slab_reclaimable:462577
[Kernel-packages] [Bug 1319244] Re: iostat: Cannot open /proc/stat: Cannot allocate memory
Will the patch be integrated in Saucy Salamander? -- You received this bug notification because you are a member of Kernel Packages, which is subscribed to linux in Ubuntu. https://bugs.launchpad.net/bugs/1319244 Title: iostat: Cannot open /proc/stat: Cannot allocate memory Status in “linux” package in Ubuntu: Fix Released Bug description: break-fix: 59a32e2ce5eb809967cac4e718bc527beca83c59 f74373a5cc7a0155d232c4e999648c7a95435bb2 break-fix: 59a32e2ce5eb809967cac4e718bc527beca83c59 058504edd02667eef8fac9be27ab3ea74332e9b4 Intermitently I get errors stating that various programs cannot allocate memory when reading /proc/stat I have 2 servers that are affected by the issue. Probably a duplicate of 1226172 [1764593.455329] top: page allocation failure: order:4, mode:0x1040d0 [1764593.455335] CPU: 3 PID: 10323 Comm: top Tainted: GF O 3.11.0-18-generic #32-Ubuntu [1764593.455338] Hardware name: Intel Corporation S2400SC/S2400SC, BIOS SE5C600.86B.02.02.0002.122320131210 12/23/2013 [1764593.455340] 88042670b9d0 816e8571 001040d0 [1764593.455345] 88042670ba58 81144ae0 880a3fffcb48 [1764593.455348] 000e 88042670ba28 0040 0007 [1764593.455351] Call Trace: [1764593.455361] [] dump_stack+0x45/0x56 [1764593.455367] [] warn_alloc_failed+0xf0/0x140 [1764593.455371] [] __alloc_pages_nodemask+0x725/0x920 [1764593.455376] [] alloc_pages_current+0xa9/0x160 [1764593.455379] [] __get_free_pages+0xe/0x50 [1764593.455384] [] kmalloc_order_trace+0x2e/0xa0 [1764593.455388] [] ? single_open+0xb0/0xb0 [1764593.455391] [] __kmalloc+0x159/0x180 [1764593.455393] [] ? single_open+0xb0/0xb0 [1764593.455398] [] stat_open+0x50/0xc0 [1764593.455401] [] proc_reg_open+0x70/0x110 [1764593.455405] [] do_dentry_open+0x1eb/0x280 [1764593.455408] [] ? proc_reg_release+0x70/0x70 [1764593.455411] [] vfs_open+0x49/0x50 [1764593.455415] [] do_last+0x1c3/0xe50 [1764593.455418] [] ? kmem_cache_alloc_trace+0x108/0x130 [1764593.455421] [] path_openat+0xc1/0x630 [1764593.455426] [] ? handle_mm_fault+0x299/0x670 [1764593.455429] [] do_filp_open+0x3a/0x90 [1764593.455433] [] ? _raw_spin_lock+0xe/0x20 [1764593.455437] [] ? __alloc_fd+0xa7/0x130 [1764593.455440] [] do_sys_open+0x12c/0x270 [1764593.455445] [] ? __set_current_blocked+0x49/0x60 [1764593.455448] [] SyS_open+0x1e/0x20 [1764593.455452] [] system_call_fastpath+0x1a/0x1f [1764593.455454] Mem-Info: [1764593.455455] Node 0 DMA per-cpu: [1764593.455458] CPU0: hi:0, btch: 1 usd: 0 [1764593.455459] CPU1: hi:0, btch: 1 usd: 0 [1764593.455461] CPU2: hi:0, btch: 1 usd: 0 [1764593.455462] CPU3: hi:0, btch: 1 usd: 0 [1764593.455463] CPU4: hi:0, btch: 1 usd: 0 [1764593.455465] CPU5: hi:0, btch: 1 usd: 0 [1764593.455466] CPU6: hi:0, btch: 1 usd: 0 [1764593.455468] CPU7: hi:0, btch: 1 usd: 0 [1764593.455469] Node 0 DMA32 per-cpu: [1764593.455471] CPU0: hi: 186, btch: 31 usd: 0 [1764593.455472] CPU1: hi: 186, btch: 31 usd: 0 [1764593.455474] CPU2: hi: 186, btch: 31 usd: 0 [1764593.455475] CPU3: hi: 186, btch: 31 usd: 0 [1764593.455477] CPU4: hi: 186, btch: 31 usd: 0 [1764593.455478] CPU5: hi: 186, btch: 31 usd: 0 [1764593.455480] CPU6: hi: 186, btch: 31 usd: 0 [1764593.455481] CPU7: hi: 186, btch: 31 usd: 0 [1764593.455482] Node 0 Normal per-cpu: [1764593.455484] CPU0: hi: 186, btch: 31 usd: 0 [1764593.455485] CPU1: hi: 186, btch: 31 usd: 0 [1764593.455487] CPU2: hi: 186, btch: 31 usd: 0 [1764593.455488] CPU3: hi: 186, btch: 31 usd: 0 [1764593.455490] CPU4: hi: 186, btch: 31 usd: 0 [1764593.455491] CPU5: hi: 186, btch: 31 usd: 0 [1764593.455492] CPU6: hi: 186, btch: 31 usd: 0 [1764593.455494] CPU7: hi: 186, btch: 31 usd: 0 [1764593.455495] Node 1 Normal per-cpu: [1764593.455497] CPU0: hi: 186, btch: 31 usd: 0 [1764593.455498] CPU1: hi: 186, btch: 31 usd: 0 [1764593.455500] CPU2: hi: 186, btch: 31 usd: 0 [1764593.455501] CPU3: hi: 186, btch: 31 usd: 0 [1764593.455503] CPU4: hi: 186, btch: 31 usd: 0 [1764593.455504] CPU5: hi: 186, btch: 31 usd: 30 [1764593.455505] CPU6: hi: 186, btch: 31 usd: 0 [1764593.455507] CPU7: hi: 186, btch: 31 usd: 0 [1764593.455511] active_anon:4739030 inactive_anon:2482840 isolated_anon:0 [1764593.455511] active_file:6228818 inactive_file:5945293 isolated_file:0 [1764593.455511] unevictable:1459 dirty:61 writeback:0 unstable:0 [1764593.455511] free:318692 slab_reclaimable:462577 slab_unreclaimable:149699 [1764593.455511] mapped:25851 shmem:2934 pagetables:27313 bounce:0 [1764593.455
[Kernel-packages] [Bug 1319244] Re: iostat: Cannot open /proc/stat: Cannot allocate memory
** Changed in: linux (Ubuntu) Status: Confirmed => Fix Released ** Tags removed: kernel-bug-break-fix -- You received this bug notification because you are a member of Kernel Packages, which is subscribed to linux in Ubuntu. https://bugs.launchpad.net/bugs/1319244 Title: iostat: Cannot open /proc/stat: Cannot allocate memory Status in “linux” package in Ubuntu: Fix Released Bug description: break-fix: 59a32e2ce5eb809967cac4e718bc527beca83c59 f74373a5cc7a0155d232c4e999648c7a95435bb2 break-fix: 59a32e2ce5eb809967cac4e718bc527beca83c59 058504edd02667eef8fac9be27ab3ea74332e9b4 Intermitently I get errors stating that various programs cannot allocate memory when reading /proc/stat I have 2 servers that are affected by the issue. Probably a duplicate of 1226172 [1764593.455329] top: page allocation failure: order:4, mode:0x1040d0 [1764593.455335] CPU: 3 PID: 10323 Comm: top Tainted: GF O 3.11.0-18-generic #32-Ubuntu [1764593.455338] Hardware name: Intel Corporation S2400SC/S2400SC, BIOS SE5C600.86B.02.02.0002.122320131210 12/23/2013 [1764593.455340] 88042670b9d0 816e8571 001040d0 [1764593.455345] 88042670ba58 81144ae0 880a3fffcb48 [1764593.455348] 000e 88042670ba28 0040 0007 [1764593.455351] Call Trace: [1764593.455361] [] dump_stack+0x45/0x56 [1764593.455367] [] warn_alloc_failed+0xf0/0x140 [1764593.455371] [] __alloc_pages_nodemask+0x725/0x920 [1764593.455376] [] alloc_pages_current+0xa9/0x160 [1764593.455379] [] __get_free_pages+0xe/0x50 [1764593.455384] [] kmalloc_order_trace+0x2e/0xa0 [1764593.455388] [] ? single_open+0xb0/0xb0 [1764593.455391] [] __kmalloc+0x159/0x180 [1764593.455393] [] ? single_open+0xb0/0xb0 [1764593.455398] [] stat_open+0x50/0xc0 [1764593.455401] [] proc_reg_open+0x70/0x110 [1764593.455405] [] do_dentry_open+0x1eb/0x280 [1764593.455408] [] ? proc_reg_release+0x70/0x70 [1764593.455411] [] vfs_open+0x49/0x50 [1764593.455415] [] do_last+0x1c3/0xe50 [1764593.455418] [] ? kmem_cache_alloc_trace+0x108/0x130 [1764593.455421] [] path_openat+0xc1/0x630 [1764593.455426] [] ? handle_mm_fault+0x299/0x670 [1764593.455429] [] do_filp_open+0x3a/0x90 [1764593.455433] [] ? _raw_spin_lock+0xe/0x20 [1764593.455437] [] ? __alloc_fd+0xa7/0x130 [1764593.455440] [] do_sys_open+0x12c/0x270 [1764593.455445] [] ? __set_current_blocked+0x49/0x60 [1764593.455448] [] SyS_open+0x1e/0x20 [1764593.455452] [] system_call_fastpath+0x1a/0x1f [1764593.455454] Mem-Info: [1764593.455455] Node 0 DMA per-cpu: [1764593.455458] CPU0: hi:0, btch: 1 usd: 0 [1764593.455459] CPU1: hi:0, btch: 1 usd: 0 [1764593.455461] CPU2: hi:0, btch: 1 usd: 0 [1764593.455462] CPU3: hi:0, btch: 1 usd: 0 [1764593.455463] CPU4: hi:0, btch: 1 usd: 0 [1764593.455465] CPU5: hi:0, btch: 1 usd: 0 [1764593.455466] CPU6: hi:0, btch: 1 usd: 0 [1764593.455468] CPU7: hi:0, btch: 1 usd: 0 [1764593.455469] Node 0 DMA32 per-cpu: [1764593.455471] CPU0: hi: 186, btch: 31 usd: 0 [1764593.455472] CPU1: hi: 186, btch: 31 usd: 0 [1764593.455474] CPU2: hi: 186, btch: 31 usd: 0 [1764593.455475] CPU3: hi: 186, btch: 31 usd: 0 [1764593.455477] CPU4: hi: 186, btch: 31 usd: 0 [1764593.455478] CPU5: hi: 186, btch: 31 usd: 0 [1764593.455480] CPU6: hi: 186, btch: 31 usd: 0 [1764593.455481] CPU7: hi: 186, btch: 31 usd: 0 [1764593.455482] Node 0 Normal per-cpu: [1764593.455484] CPU0: hi: 186, btch: 31 usd: 0 [1764593.455485] CPU1: hi: 186, btch: 31 usd: 0 [1764593.455487] CPU2: hi: 186, btch: 31 usd: 0 [1764593.455488] CPU3: hi: 186, btch: 31 usd: 0 [1764593.455490] CPU4: hi: 186, btch: 31 usd: 0 [1764593.455491] CPU5: hi: 186, btch: 31 usd: 0 [1764593.455492] CPU6: hi: 186, btch: 31 usd: 0 [1764593.455494] CPU7: hi: 186, btch: 31 usd: 0 [1764593.455495] Node 1 Normal per-cpu: [1764593.455497] CPU0: hi: 186, btch: 31 usd: 0 [1764593.455498] CPU1: hi: 186, btch: 31 usd: 0 [1764593.455500] CPU2: hi: 186, btch: 31 usd: 0 [1764593.455501] CPU3: hi: 186, btch: 31 usd: 0 [1764593.455503] CPU4: hi: 186, btch: 31 usd: 0 [1764593.455504] CPU5: hi: 186, btch: 31 usd: 30 [1764593.455505] CPU6: hi: 186, btch: 31 usd: 0 [1764593.455507] CPU7: hi: 186, btch: 31 usd: 0 [1764593.455511] active_anon:4739030 inactive_anon:2482840 isolated_anon:0 [1764593.455511] active_file:6228818 inactive_file:5945293 isolated_file:0 [1764593.455511] unevictable:1459 dirty:61 writeback:0 unstable:0 [1764593.455511] free:318692 slab_reclaimable:462577 slab_unreclaimable:149699 [1764593.455511] mapp
[Kernel-packages] [Bug 1319244] Re: iostat: Cannot open /proc/stat: Cannot allocate memory
** Description changed: + break-fix: 59a32e2ce5eb809967cac4e718bc527beca83c59 f74373a5cc7a0155d232c4e999648c7a95435bb2 + break-fix: 59a32e2ce5eb809967cac4e718bc527beca83c59 058504edd02667eef8fac9be27ab3ea74332e9b4 + Intermitently I get errors stating that various programs cannot allocate memory when reading /proc/stat I have 2 servers that are affected by the issue. Probably a duplicate of 1226172 [1764593.455329] top: page allocation failure: order:4, mode:0x1040d0 [1764593.455335] CPU: 3 PID: 10323 Comm: top Tainted: GF O 3.11.0-18-generic #32-Ubuntu [1764593.455338] Hardware name: Intel Corporation S2400SC/S2400SC, BIOS SE5C600.86B.02.02.0002.122320131210 12/23/2013 [1764593.455340] 88042670b9d0 816e8571 001040d0 [1764593.455345] 88042670ba58 81144ae0 880a3fffcb48 [1764593.455348] 000e 88042670ba28 0040 0007 [1764593.455351] Call Trace: [1764593.455361] [] dump_stack+0x45/0x56 [1764593.455367] [] warn_alloc_failed+0xf0/0x140 [1764593.455371] [] __alloc_pages_nodemask+0x725/0x920 [1764593.455376] [] alloc_pages_current+0xa9/0x160 [1764593.455379] [] __get_free_pages+0xe/0x50 [1764593.455384] [] kmalloc_order_trace+0x2e/0xa0 [1764593.455388] [] ? single_open+0xb0/0xb0 [1764593.455391] [] __kmalloc+0x159/0x180 [1764593.455393] [] ? single_open+0xb0/0xb0 [1764593.455398] [] stat_open+0x50/0xc0 [1764593.455401] [] proc_reg_open+0x70/0x110 [1764593.455405] [] do_dentry_open+0x1eb/0x280 [1764593.455408] [] ? proc_reg_release+0x70/0x70 [1764593.455411] [] vfs_open+0x49/0x50 [1764593.455415] [] do_last+0x1c3/0xe50 [1764593.455418] [] ? kmem_cache_alloc_trace+0x108/0x130 [1764593.455421] [] path_openat+0xc1/0x630 [1764593.455426] [] ? handle_mm_fault+0x299/0x670 [1764593.455429] [] do_filp_open+0x3a/0x90 [1764593.455433] [] ? _raw_spin_lock+0xe/0x20 [1764593.455437] [] ? __alloc_fd+0xa7/0x130 [1764593.455440] [] do_sys_open+0x12c/0x270 [1764593.455445] [] ? __set_current_blocked+0x49/0x60 [1764593.455448] [] SyS_open+0x1e/0x20 [1764593.455452] [] system_call_fastpath+0x1a/0x1f [1764593.455454] Mem-Info: [1764593.455455] Node 0 DMA per-cpu: [1764593.455458] CPU0: hi:0, btch: 1 usd: 0 [1764593.455459] CPU1: hi:0, btch: 1 usd: 0 [1764593.455461] CPU2: hi:0, btch: 1 usd: 0 [1764593.455462] CPU3: hi:0, btch: 1 usd: 0 [1764593.455463] CPU4: hi:0, btch: 1 usd: 0 [1764593.455465] CPU5: hi:0, btch: 1 usd: 0 [1764593.455466] CPU6: hi:0, btch: 1 usd: 0 [1764593.455468] CPU7: hi:0, btch: 1 usd: 0 [1764593.455469] Node 0 DMA32 per-cpu: [1764593.455471] CPU0: hi: 186, btch: 31 usd: 0 [1764593.455472] CPU1: hi: 186, btch: 31 usd: 0 [1764593.455474] CPU2: hi: 186, btch: 31 usd: 0 [1764593.455475] CPU3: hi: 186, btch: 31 usd: 0 [1764593.455477] CPU4: hi: 186, btch: 31 usd: 0 [1764593.455478] CPU5: hi: 186, btch: 31 usd: 0 [1764593.455480] CPU6: hi: 186, btch: 31 usd: 0 [1764593.455481] CPU7: hi: 186, btch: 31 usd: 0 [1764593.455482] Node 0 Normal per-cpu: [1764593.455484] CPU0: hi: 186, btch: 31 usd: 0 [1764593.455485] CPU1: hi: 186, btch: 31 usd: 0 [1764593.455487] CPU2: hi: 186, btch: 31 usd: 0 [1764593.455488] CPU3: hi: 186, btch: 31 usd: 0 [1764593.455490] CPU4: hi: 186, btch: 31 usd: 0 [1764593.455491] CPU5: hi: 186, btch: 31 usd: 0 [1764593.455492] CPU6: hi: 186, btch: 31 usd: 0 [1764593.455494] CPU7: hi: 186, btch: 31 usd: 0 [1764593.455495] Node 1 Normal per-cpu: [1764593.455497] CPU0: hi: 186, btch: 31 usd: 0 [1764593.455498] CPU1: hi: 186, btch: 31 usd: 0 [1764593.455500] CPU2: hi: 186, btch: 31 usd: 0 [1764593.455501] CPU3: hi: 186, btch: 31 usd: 0 [1764593.455503] CPU4: hi: 186, btch: 31 usd: 0 [1764593.455504] CPU5: hi: 186, btch: 31 usd: 30 [1764593.455505] CPU6: hi: 186, btch: 31 usd: 0 [1764593.455507] CPU7: hi: 186, btch: 31 usd: 0 [1764593.455511] active_anon:4739030 inactive_anon:2482840 isolated_anon:0 [1764593.455511] active_file:6228818 inactive_file:5945293 isolated_file:0 [1764593.455511] unevictable:1459 dirty:61 writeback:0 unstable:0 [1764593.455511] free:318692 slab_reclaimable:462577 slab_unreclaimable:149699 [1764593.455511] mapped:25851 shmem:2934 pagetables:27313 bounce:0 [1764593.455511] free_cma:0 [1764593.455514] Node 0 DMA free:15848kB min:16kB low:20kB high:24kB active_anon:0kB inactive_anon:0kB active_file:0kB inactive_file:0kB unevictable:0kB isolated(anon):0kB isolated(file):0kB present:15932kB managed:15848kB mlocked:0kB dirty:0kB writeback:0kB mapped:0kB shmem:0kB slab_reclaimable:
[Kernel-packages] [Bug 1319244] Re: iostat: Cannot open /proc/stat: Cannot allocate memory
It turns out we (you) were not the first ones running into it. The IBM mainframe guys (obviously) have the same need to potentially allow many CPUs. The upstream discussion is here: https://lkml.org/lkml/2014/5/21/251 So, while the change I made does work in this case, it can cause issues. Firstly /proc/stat uses a open_single interface. That means the proc file is not seekable and has no iterator. So all output has to be done in one go. And that means the buffer _has_ to be big enough to hold all output. Which means the part that limits the maximum size to order-3 allocations can cause issue on systems that really have a lot of CPUs. The other part of changing the buffer from holding x*possible number of CPUs to x*online CPUs was also thought of in the upstream thread. The problem there is that between open (buffer gets allocated) and show (buffer is filled) it is possible than a bunch of CPUs are set online. So one needs to be extra careful what would happen then. Sounds like the most likely outcome could be to have a vmalloc fallback option. But the discussion does not seem to be finished, yet. -- You received this bug notification because you are a member of Kernel Packages, which is subscribed to linux in Ubuntu. https://bugs.launchpad.net/bugs/1319244 Title: iostat: Cannot open /proc/stat: Cannot allocate memory Status in “linux” package in Ubuntu: Confirmed Bug description: Intermitently I get errors stating that various programs cannot allocate memory when reading /proc/stat I have 2 servers that are affected by the issue. Probably a duplicate of 1226172 [1764593.455329] top: page allocation failure: order:4, mode:0x1040d0 [1764593.455335] CPU: 3 PID: 10323 Comm: top Tainted: GF O 3.11.0-18-generic #32-Ubuntu [1764593.455338] Hardware name: Intel Corporation S2400SC/S2400SC, BIOS SE5C600.86B.02.02.0002.122320131210 12/23/2013 [1764593.455340] 88042670b9d0 816e8571 001040d0 [1764593.455345] 88042670ba58 81144ae0 880a3fffcb48 [1764593.455348] 000e 88042670ba28 0040 0007 [1764593.455351] Call Trace: [1764593.455361] [] dump_stack+0x45/0x56 [1764593.455367] [] warn_alloc_failed+0xf0/0x140 [1764593.455371] [] __alloc_pages_nodemask+0x725/0x920 [1764593.455376] [] alloc_pages_current+0xa9/0x160 [1764593.455379] [] __get_free_pages+0xe/0x50 [1764593.455384] [] kmalloc_order_trace+0x2e/0xa0 [1764593.455388] [] ? single_open+0xb0/0xb0 [1764593.455391] [] __kmalloc+0x159/0x180 [1764593.455393] [] ? single_open+0xb0/0xb0 [1764593.455398] [] stat_open+0x50/0xc0 [1764593.455401] [] proc_reg_open+0x70/0x110 [1764593.455405] [] do_dentry_open+0x1eb/0x280 [1764593.455408] [] ? proc_reg_release+0x70/0x70 [1764593.455411] [] vfs_open+0x49/0x50 [1764593.455415] [] do_last+0x1c3/0xe50 [1764593.455418] [] ? kmem_cache_alloc_trace+0x108/0x130 [1764593.455421] [] path_openat+0xc1/0x630 [1764593.455426] [] ? handle_mm_fault+0x299/0x670 [1764593.455429] [] do_filp_open+0x3a/0x90 [1764593.455433] [] ? _raw_spin_lock+0xe/0x20 [1764593.455437] [] ? __alloc_fd+0xa7/0x130 [1764593.455440] [] do_sys_open+0x12c/0x270 [1764593.455445] [] ? __set_current_blocked+0x49/0x60 [1764593.455448] [] SyS_open+0x1e/0x20 [1764593.455452] [] system_call_fastpath+0x1a/0x1f [1764593.455454] Mem-Info: [1764593.455455] Node 0 DMA per-cpu: [1764593.455458] CPU0: hi:0, btch: 1 usd: 0 [1764593.455459] CPU1: hi:0, btch: 1 usd: 0 [1764593.455461] CPU2: hi:0, btch: 1 usd: 0 [1764593.455462] CPU3: hi:0, btch: 1 usd: 0 [1764593.455463] CPU4: hi:0, btch: 1 usd: 0 [1764593.455465] CPU5: hi:0, btch: 1 usd: 0 [1764593.455466] CPU6: hi:0, btch: 1 usd: 0 [1764593.455468] CPU7: hi:0, btch: 1 usd: 0 [1764593.455469] Node 0 DMA32 per-cpu: [1764593.455471] CPU0: hi: 186, btch: 31 usd: 0 [1764593.455472] CPU1: hi: 186, btch: 31 usd: 0 [1764593.455474] CPU2: hi: 186, btch: 31 usd: 0 [1764593.455475] CPU3: hi: 186, btch: 31 usd: 0 [1764593.455477] CPU4: hi: 186, btch: 31 usd: 0 [1764593.455478] CPU5: hi: 186, btch: 31 usd: 0 [1764593.455480] CPU6: hi: 186, btch: 31 usd: 0 [1764593.455481] CPU7: hi: 186, btch: 31 usd: 0 [1764593.455482] Node 0 Normal per-cpu: [1764593.455484] CPU0: hi: 186, btch: 31 usd: 0 [1764593.455485] CPU1: hi: 186, btch: 31 usd: 0 [1764593.455487] CPU2: hi: 186, btch: 31 usd: 0 [1764593.455488] CPU3: hi: 186, btch: 31 usd: 0 [1764593.455490] CPU4: hi: 186, btch: 31 usd: 0 [1764593.455491] CPU5: hi: 186, btch: 31 usd: 0 [1764593.455492] CPU6: hi: 186, btch: 31 usd: 0 [1764593.455494] CPU7: hi: 186, btch: 31 usd: 0 [1764593.455495
[Kernel-packages] [Bug 1319244] Re: iostat: Cannot open /proc/stat: Cannot allocate memory
Alright the test kernel clearly fixed the issue. My gut tells me that there might be some memory leak also at play with the non patched version, but I don't know kernel code well enough to analyze that. -- You received this bug notification because you are a member of Kernel Packages, which is subscribed to linux in Ubuntu. https://bugs.launchpad.net/bugs/1319244 Title: iostat: Cannot open /proc/stat: Cannot allocate memory Status in “linux” package in Ubuntu: Confirmed Bug description: Intermitently I get errors stating that various programs cannot allocate memory when reading /proc/stat I have 2 servers that are affected by the issue. Probably a duplicate of 1226172 [1764593.455329] top: page allocation failure: order:4, mode:0x1040d0 [1764593.455335] CPU: 3 PID: 10323 Comm: top Tainted: GF O 3.11.0-18-generic #32-Ubuntu [1764593.455338] Hardware name: Intel Corporation S2400SC/S2400SC, BIOS SE5C600.86B.02.02.0002.122320131210 12/23/2013 [1764593.455340] 88042670b9d0 816e8571 001040d0 [1764593.455345] 88042670ba58 81144ae0 880a3fffcb48 [1764593.455348] 000e 88042670ba28 0040 0007 [1764593.455351] Call Trace: [1764593.455361] [] dump_stack+0x45/0x56 [1764593.455367] [] warn_alloc_failed+0xf0/0x140 [1764593.455371] [] __alloc_pages_nodemask+0x725/0x920 [1764593.455376] [] alloc_pages_current+0xa9/0x160 [1764593.455379] [] __get_free_pages+0xe/0x50 [1764593.455384] [] kmalloc_order_trace+0x2e/0xa0 [1764593.455388] [] ? single_open+0xb0/0xb0 [1764593.455391] [] __kmalloc+0x159/0x180 [1764593.455393] [] ? single_open+0xb0/0xb0 [1764593.455398] [] stat_open+0x50/0xc0 [1764593.455401] [] proc_reg_open+0x70/0x110 [1764593.455405] [] do_dentry_open+0x1eb/0x280 [1764593.455408] [] ? proc_reg_release+0x70/0x70 [1764593.455411] [] vfs_open+0x49/0x50 [1764593.455415] [] do_last+0x1c3/0xe50 [1764593.455418] [] ? kmem_cache_alloc_trace+0x108/0x130 [1764593.455421] [] path_openat+0xc1/0x630 [1764593.455426] [] ? handle_mm_fault+0x299/0x670 [1764593.455429] [] do_filp_open+0x3a/0x90 [1764593.455433] [] ? _raw_spin_lock+0xe/0x20 [1764593.455437] [] ? __alloc_fd+0xa7/0x130 [1764593.455440] [] do_sys_open+0x12c/0x270 [1764593.455445] [] ? __set_current_blocked+0x49/0x60 [1764593.455448] [] SyS_open+0x1e/0x20 [1764593.455452] [] system_call_fastpath+0x1a/0x1f [1764593.455454] Mem-Info: [1764593.455455] Node 0 DMA per-cpu: [1764593.455458] CPU0: hi:0, btch: 1 usd: 0 [1764593.455459] CPU1: hi:0, btch: 1 usd: 0 [1764593.455461] CPU2: hi:0, btch: 1 usd: 0 [1764593.455462] CPU3: hi:0, btch: 1 usd: 0 [1764593.455463] CPU4: hi:0, btch: 1 usd: 0 [1764593.455465] CPU5: hi:0, btch: 1 usd: 0 [1764593.455466] CPU6: hi:0, btch: 1 usd: 0 [1764593.455468] CPU7: hi:0, btch: 1 usd: 0 [1764593.455469] Node 0 DMA32 per-cpu: [1764593.455471] CPU0: hi: 186, btch: 31 usd: 0 [1764593.455472] CPU1: hi: 186, btch: 31 usd: 0 [1764593.455474] CPU2: hi: 186, btch: 31 usd: 0 [1764593.455475] CPU3: hi: 186, btch: 31 usd: 0 [1764593.455477] CPU4: hi: 186, btch: 31 usd: 0 [1764593.455478] CPU5: hi: 186, btch: 31 usd: 0 [1764593.455480] CPU6: hi: 186, btch: 31 usd: 0 [1764593.455481] CPU7: hi: 186, btch: 31 usd: 0 [1764593.455482] Node 0 Normal per-cpu: [1764593.455484] CPU0: hi: 186, btch: 31 usd: 0 [1764593.455485] CPU1: hi: 186, btch: 31 usd: 0 [1764593.455487] CPU2: hi: 186, btch: 31 usd: 0 [1764593.455488] CPU3: hi: 186, btch: 31 usd: 0 [1764593.455490] CPU4: hi: 186, btch: 31 usd: 0 [1764593.455491] CPU5: hi: 186, btch: 31 usd: 0 [1764593.455492] CPU6: hi: 186, btch: 31 usd: 0 [1764593.455494] CPU7: hi: 186, btch: 31 usd: 0 [1764593.455495] Node 1 Normal per-cpu: [1764593.455497] CPU0: hi: 186, btch: 31 usd: 0 [1764593.455498] CPU1: hi: 186, btch: 31 usd: 0 [1764593.455500] CPU2: hi: 186, btch: 31 usd: 0 [1764593.455501] CPU3: hi: 186, btch: 31 usd: 0 [1764593.455503] CPU4: hi: 186, btch: 31 usd: 0 [1764593.455504] CPU5: hi: 186, btch: 31 usd: 30 [1764593.455505] CPU6: hi: 186, btch: 31 usd: 0 [1764593.455507] CPU7: hi: 186, btch: 31 usd: 0 [1764593.455511] active_anon:4739030 inactive_anon:2482840 isolated_anon:0 [1764593.455511] active_file:6228818 inactive_file:5945293 isolated_file:0 [1764593.455511] unevictable:1459 dirty:61 writeback:0 unstable:0 [1764593.455511] free:318692 slab_reclaimable:462577 slab_unreclaimable:149699 [1764593.455511] mapped:25851 shmem:2934 pagetables:27313 bounce:0 [1764593.455511] free_cma:0 [1764593.455514] Node 0
[Kernel-packages] [Bug 1319244] Re: iostat: Cannot open /proc/stat: Cannot allocate memory
So far after 21 days of uptime the issue hasn't come back. # cat /proc/buddyinfo Node 0, zone DMA 0 0 0 1 1 1 1 0 1 1 3 Node 0, zoneDMA32 9544583 7936174 3 1 1 0 0 0 0 Node 0, zone Normal 36669197 1 0 0 0 0 0 0 0 0 Node 1, zone Normal 103431 13022845105 20 4 2 1 1 0 0 Unfortunately I'll have to bring the computer down tomorrow morning as there is a planned power outage. I'll setup the patched kernel on the 2nd computer that is affected by the issue. -- You received this bug notification because you are a member of Kernel Packages, which is subscribed to linux in Ubuntu. https://bugs.launchpad.net/bugs/1319244 Title: iostat: Cannot open /proc/stat: Cannot allocate memory Status in “linux” package in Ubuntu: Confirmed Bug description: Intermitently I get errors stating that various programs cannot allocate memory when reading /proc/stat I have 2 servers that are affected by the issue. Probably a duplicate of 1226172 [1764593.455329] top: page allocation failure: order:4, mode:0x1040d0 [1764593.455335] CPU: 3 PID: 10323 Comm: top Tainted: GF O 3.11.0-18-generic #32-Ubuntu [1764593.455338] Hardware name: Intel Corporation S2400SC/S2400SC, BIOS SE5C600.86B.02.02.0002.122320131210 12/23/2013 [1764593.455340] 88042670b9d0 816e8571 001040d0 [1764593.455345] 88042670ba58 81144ae0 880a3fffcb48 [1764593.455348] 000e 88042670ba28 0040 0007 [1764593.455351] Call Trace: [1764593.455361] [] dump_stack+0x45/0x56 [1764593.455367] [] warn_alloc_failed+0xf0/0x140 [1764593.455371] [] __alloc_pages_nodemask+0x725/0x920 [1764593.455376] [] alloc_pages_current+0xa9/0x160 [1764593.455379] [] __get_free_pages+0xe/0x50 [1764593.455384] [] kmalloc_order_trace+0x2e/0xa0 [1764593.455388] [] ? single_open+0xb0/0xb0 [1764593.455391] [] __kmalloc+0x159/0x180 [1764593.455393] [] ? single_open+0xb0/0xb0 [1764593.455398] [] stat_open+0x50/0xc0 [1764593.455401] [] proc_reg_open+0x70/0x110 [1764593.455405] [] do_dentry_open+0x1eb/0x280 [1764593.455408] [] ? proc_reg_release+0x70/0x70 [1764593.455411] [] vfs_open+0x49/0x50 [1764593.455415] [] do_last+0x1c3/0xe50 [1764593.455418] [] ? kmem_cache_alloc_trace+0x108/0x130 [1764593.455421] [] path_openat+0xc1/0x630 [1764593.455426] [] ? handle_mm_fault+0x299/0x670 [1764593.455429] [] do_filp_open+0x3a/0x90 [1764593.455433] [] ? _raw_spin_lock+0xe/0x20 [1764593.455437] [] ? __alloc_fd+0xa7/0x130 [1764593.455440] [] do_sys_open+0x12c/0x270 [1764593.455445] [] ? __set_current_blocked+0x49/0x60 [1764593.455448] [] SyS_open+0x1e/0x20 [1764593.455452] [] system_call_fastpath+0x1a/0x1f [1764593.455454] Mem-Info: [1764593.455455] Node 0 DMA per-cpu: [1764593.455458] CPU0: hi:0, btch: 1 usd: 0 [1764593.455459] CPU1: hi:0, btch: 1 usd: 0 [1764593.455461] CPU2: hi:0, btch: 1 usd: 0 [1764593.455462] CPU3: hi:0, btch: 1 usd: 0 [1764593.455463] CPU4: hi:0, btch: 1 usd: 0 [1764593.455465] CPU5: hi:0, btch: 1 usd: 0 [1764593.455466] CPU6: hi:0, btch: 1 usd: 0 [1764593.455468] CPU7: hi:0, btch: 1 usd: 0 [1764593.455469] Node 0 DMA32 per-cpu: [1764593.455471] CPU0: hi: 186, btch: 31 usd: 0 [1764593.455472] CPU1: hi: 186, btch: 31 usd: 0 [1764593.455474] CPU2: hi: 186, btch: 31 usd: 0 [1764593.455475] CPU3: hi: 186, btch: 31 usd: 0 [1764593.455477] CPU4: hi: 186, btch: 31 usd: 0 [1764593.455478] CPU5: hi: 186, btch: 31 usd: 0 [1764593.455480] CPU6: hi: 186, btch: 31 usd: 0 [1764593.455481] CPU7: hi: 186, btch: 31 usd: 0 [1764593.455482] Node 0 Normal per-cpu: [1764593.455484] CPU0: hi: 186, btch: 31 usd: 0 [1764593.455485] CPU1: hi: 186, btch: 31 usd: 0 [1764593.455487] CPU2: hi: 186, btch: 31 usd: 0 [1764593.455488] CPU3: hi: 186, btch: 31 usd: 0 [1764593.455490] CPU4: hi: 186, btch: 31 usd: 0 [1764593.455491] CPU5: hi: 186, btch: 31 usd: 0 [1764593.455492] CPU6: hi: 186, btch: 31 usd: 0 [1764593.455494] CPU7: hi: 186, btch: 31 usd: 0 [1764593.455495] Node 1 Normal per-cpu: [1764593.455497] CPU0: hi: 186, btch: 31 usd: 0 [1764593.455498] CPU1: hi: 186, btch: 31 usd: 0 [1764593.455500] CPU2: hi: 186, btch: 31 usd: 0 [1764593.455501] CPU3: hi: 186, btch: 31 usd: 0 [1764593.455503] CPU4: hi: 186, btch: 31 usd: 0 [1764593.455504] CPU5: hi: 186, btch: 31 usd: 30 [1764593.455505] CPU6: hi: 186, btch: 31 usd: 0 [1764593.455507] CP
[Kernel-packages] [Bug 1319244] Re: iostat: Cannot open /proc/stat: Cannot allocate memory
I don't think we've had enough uptime with it as the buddyinfo still looks like the bug wouldn't trigger. May 22: cat /proc/buddyinfo Node 0, zone DMA 0 0 0 1 1 1 1 0 1 1 3 Node 0, zoneDMA32 84335 20475 5469995125 78 23 2 1 1 0 Node 0, zone Normal 116375 4708229 27 41 12 13 2 0 0 0 Node 1, zone Normal 185773 42193 5699 1997 1017510235 85 24 0 0 May 26 (uptime 11 days) # cat /proc/buddyinfo Node 0, zone DMA 0 0 0 1 1 1 1 0 1 1 3 Node 0, zoneDMA32 81329 25081 6593 1272210 13 0 0 0 0 0 Node 0, zone Normal 334689 3247 3 0 0 0 0 0 0 0 0 Node 1, zone Normal 84556 109611 7577 1366381127 55 6 2 0 0 Slowly getting there... For information this is the buddyinfo on an unpatched server with the same hardware (32 day uptime) Node 0, zone DMA 0 1 0 1 1 1 1 0 1 1 3 Node 0, zoneDMA32 60621 32499 9670 10 0 0 1 0 0 0 0 Node 0, zone Normal 11045 7738471 33 10 10 0 0 0 0 0 Node 1, zone Normal 113751 37130 5882202 12 0 0 0 0 0 0 -- You received this bug notification because you are a member of Kernel Packages, which is subscribed to linux in Ubuntu. https://bugs.launchpad.net/bugs/1319244 Title: iostat: Cannot open /proc/stat: Cannot allocate memory Status in “linux” package in Ubuntu: Confirmed Bug description: Intermitently I get errors stating that various programs cannot allocate memory when reading /proc/stat I have 2 servers that are affected by the issue. Probably a duplicate of 1226172 [1764593.455329] top: page allocation failure: order:4, mode:0x1040d0 [1764593.455335] CPU: 3 PID: 10323 Comm: top Tainted: GF O 3.11.0-18-generic #32-Ubuntu [1764593.455338] Hardware name: Intel Corporation S2400SC/S2400SC, BIOS SE5C600.86B.02.02.0002.122320131210 12/23/2013 [1764593.455340] 88042670b9d0 816e8571 001040d0 [1764593.455345] 88042670ba58 81144ae0 880a3fffcb48 [1764593.455348] 000e 88042670ba28 0040 0007 [1764593.455351] Call Trace: [1764593.455361] [] dump_stack+0x45/0x56 [1764593.455367] [] warn_alloc_failed+0xf0/0x140 [1764593.455371] [] __alloc_pages_nodemask+0x725/0x920 [1764593.455376] [] alloc_pages_current+0xa9/0x160 [1764593.455379] [] __get_free_pages+0xe/0x50 [1764593.455384] [] kmalloc_order_trace+0x2e/0xa0 [1764593.455388] [] ? single_open+0xb0/0xb0 [1764593.455391] [] __kmalloc+0x159/0x180 [1764593.455393] [] ? single_open+0xb0/0xb0 [1764593.455398] [] stat_open+0x50/0xc0 [1764593.455401] [] proc_reg_open+0x70/0x110 [1764593.455405] [] do_dentry_open+0x1eb/0x280 [1764593.455408] [] ? proc_reg_release+0x70/0x70 [1764593.455411] [] vfs_open+0x49/0x50 [1764593.455415] [] do_last+0x1c3/0xe50 [1764593.455418] [] ? kmem_cache_alloc_trace+0x108/0x130 [1764593.455421] [] path_openat+0xc1/0x630 [1764593.455426] [] ? handle_mm_fault+0x299/0x670 [1764593.455429] [] do_filp_open+0x3a/0x90 [1764593.455433] [] ? _raw_spin_lock+0xe/0x20 [1764593.455437] [] ? __alloc_fd+0xa7/0x130 [1764593.455440] [] do_sys_open+0x12c/0x270 [1764593.455445] [] ? __set_current_blocked+0x49/0x60 [1764593.455448] [] SyS_open+0x1e/0x20 [1764593.455452] [] system_call_fastpath+0x1a/0x1f [1764593.455454] Mem-Info: [1764593.455455] Node 0 DMA per-cpu: [1764593.455458] CPU0: hi:0, btch: 1 usd: 0 [1764593.455459] CPU1: hi:0, btch: 1 usd: 0 [1764593.455461] CPU2: hi:0, btch: 1 usd: 0 [1764593.455462] CPU3: hi:0, btch: 1 usd: 0 [1764593.455463] CPU4: hi:0, btch: 1 usd: 0 [1764593.455465] CPU5: hi:0, btch: 1 usd: 0 [1764593.455466] CPU6: hi:0, btch: 1 usd: 0 [1764593.455468] CPU7: hi:0, btch: 1 usd: 0 [1764593.455469] Node 0 DMA32 per-cpu: [1764593.455471] CPU0: hi: 186, btch: 31 usd: 0 [1764593.455472] CPU1: hi: 186, btch: 31 usd: 0 [1764593.455474] CPU2: hi: 186, btch: 31 usd: 0 [1764593.455475] CPU3: hi: 186, btch: 31 usd: 0 [1764593.455477] CPU4: hi: 186, btch: 31 usd: 0 [1764593.455478] CPU5: hi: 186, btch: 31 usd: 0 [1764593.455480] CPU6: hi: 186, btch: 31 usd: 0 [1764593.455481] CPU7: hi: 186, btch: 31 usd: 0 [1764593.455482] Node 0 Normal per-cpu: [1764593.455484] CPU0: hi: 186, btch: 31 usd: 0 [1764593.455485] CPU1: hi: 186,
[Kernel-packages] [Bug 1319244] Re: iostat: Cannot open /proc/stat: Cannot allocate memory
Any news about how the test kernels did fare? -- You received this bug notification because you are a member of Kernel Packages, which is subscribed to linux in Ubuntu. https://bugs.launchpad.net/bugs/1319244 Title: iostat: Cannot open /proc/stat: Cannot allocate memory Status in “linux” package in Ubuntu: Confirmed Bug description: Intermitently I get errors stating that various programs cannot allocate memory when reading /proc/stat I have 2 servers that are affected by the issue. Probably a duplicate of 1226172 [1764593.455329] top: page allocation failure: order:4, mode:0x1040d0 [1764593.455335] CPU: 3 PID: 10323 Comm: top Tainted: GF O 3.11.0-18-generic #32-Ubuntu [1764593.455338] Hardware name: Intel Corporation S2400SC/S2400SC, BIOS SE5C600.86B.02.02.0002.122320131210 12/23/2013 [1764593.455340] 88042670b9d0 816e8571 001040d0 [1764593.455345] 88042670ba58 81144ae0 880a3fffcb48 [1764593.455348] 000e 88042670ba28 0040 0007 [1764593.455351] Call Trace: [1764593.455361] [] dump_stack+0x45/0x56 [1764593.455367] [] warn_alloc_failed+0xf0/0x140 [1764593.455371] [] __alloc_pages_nodemask+0x725/0x920 [1764593.455376] [] alloc_pages_current+0xa9/0x160 [1764593.455379] [] __get_free_pages+0xe/0x50 [1764593.455384] [] kmalloc_order_trace+0x2e/0xa0 [1764593.455388] [] ? single_open+0xb0/0xb0 [1764593.455391] [] __kmalloc+0x159/0x180 [1764593.455393] [] ? single_open+0xb0/0xb0 [1764593.455398] [] stat_open+0x50/0xc0 [1764593.455401] [] proc_reg_open+0x70/0x110 [1764593.455405] [] do_dentry_open+0x1eb/0x280 [1764593.455408] [] ? proc_reg_release+0x70/0x70 [1764593.455411] [] vfs_open+0x49/0x50 [1764593.455415] [] do_last+0x1c3/0xe50 [1764593.455418] [] ? kmem_cache_alloc_trace+0x108/0x130 [1764593.455421] [] path_openat+0xc1/0x630 [1764593.455426] [] ? handle_mm_fault+0x299/0x670 [1764593.455429] [] do_filp_open+0x3a/0x90 [1764593.455433] [] ? _raw_spin_lock+0xe/0x20 [1764593.455437] [] ? __alloc_fd+0xa7/0x130 [1764593.455440] [] do_sys_open+0x12c/0x270 [1764593.455445] [] ? __set_current_blocked+0x49/0x60 [1764593.455448] [] SyS_open+0x1e/0x20 [1764593.455452] [] system_call_fastpath+0x1a/0x1f [1764593.455454] Mem-Info: [1764593.455455] Node 0 DMA per-cpu: [1764593.455458] CPU0: hi:0, btch: 1 usd: 0 [1764593.455459] CPU1: hi:0, btch: 1 usd: 0 [1764593.455461] CPU2: hi:0, btch: 1 usd: 0 [1764593.455462] CPU3: hi:0, btch: 1 usd: 0 [1764593.455463] CPU4: hi:0, btch: 1 usd: 0 [1764593.455465] CPU5: hi:0, btch: 1 usd: 0 [1764593.455466] CPU6: hi:0, btch: 1 usd: 0 [1764593.455468] CPU7: hi:0, btch: 1 usd: 0 [1764593.455469] Node 0 DMA32 per-cpu: [1764593.455471] CPU0: hi: 186, btch: 31 usd: 0 [1764593.455472] CPU1: hi: 186, btch: 31 usd: 0 [1764593.455474] CPU2: hi: 186, btch: 31 usd: 0 [1764593.455475] CPU3: hi: 186, btch: 31 usd: 0 [1764593.455477] CPU4: hi: 186, btch: 31 usd: 0 [1764593.455478] CPU5: hi: 186, btch: 31 usd: 0 [1764593.455480] CPU6: hi: 186, btch: 31 usd: 0 [1764593.455481] CPU7: hi: 186, btch: 31 usd: 0 [1764593.455482] Node 0 Normal per-cpu: [1764593.455484] CPU0: hi: 186, btch: 31 usd: 0 [1764593.455485] CPU1: hi: 186, btch: 31 usd: 0 [1764593.455487] CPU2: hi: 186, btch: 31 usd: 0 [1764593.455488] CPU3: hi: 186, btch: 31 usd: 0 [1764593.455490] CPU4: hi: 186, btch: 31 usd: 0 [1764593.455491] CPU5: hi: 186, btch: 31 usd: 0 [1764593.455492] CPU6: hi: 186, btch: 31 usd: 0 [1764593.455494] CPU7: hi: 186, btch: 31 usd: 0 [1764593.455495] Node 1 Normal per-cpu: [1764593.455497] CPU0: hi: 186, btch: 31 usd: 0 [1764593.455498] CPU1: hi: 186, btch: 31 usd: 0 [1764593.455500] CPU2: hi: 186, btch: 31 usd: 0 [1764593.455501] CPU3: hi: 186, btch: 31 usd: 0 [1764593.455503] CPU4: hi: 186, btch: 31 usd: 0 [1764593.455504] CPU5: hi: 186, btch: 31 usd: 30 [1764593.455505] CPU6: hi: 186, btch: 31 usd: 0 [1764593.455507] CPU7: hi: 186, btch: 31 usd: 0 [1764593.455511] active_anon:4739030 inactive_anon:2482840 isolated_anon:0 [1764593.455511] active_file:6228818 inactive_file:5945293 isolated_file:0 [1764593.455511] unevictable:1459 dirty:61 writeback:0 unstable:0 [1764593.455511] free:318692 slab_reclaimable:462577 slab_unreclaimable:149699 [1764593.455511] mapped:25851 shmem:2934 pagetables:27313 bounce:0 [1764593.455511] free_cma:0 [1764593.455514] Node 0 DMA free:15848kB min:16kB low:20kB high:24kB active_anon:0kB inactive_anon:0kB active_file:0kB inactive_file:0kB unevictable:0kB isolated(anon):0kB isolate
[Kernel-packages] [Bug 1319244] Re: iostat: Cannot open /proc/stat: Cannot allocate memory
The main use of the system is as a QEMU/KVM host, with currently 14 VMs running and some other processes. -- You received this bug notification because you are a member of Kernel Packages, which is subscribed to linux in Ubuntu. https://bugs.launchpad.net/bugs/1319244 Title: iostat: Cannot open /proc/stat: Cannot allocate memory Status in “linux” package in Ubuntu: Confirmed Bug description: Intermitently I get errors stating that various programs cannot allocate memory when reading /proc/stat I have 2 servers that are affected by the issue. Probably a duplicate of 1226172 [1764593.455329] top: page allocation failure: order:4, mode:0x1040d0 [1764593.455335] CPU: 3 PID: 10323 Comm: top Tainted: GF O 3.11.0-18-generic #32-Ubuntu [1764593.455338] Hardware name: Intel Corporation S2400SC/S2400SC, BIOS SE5C600.86B.02.02.0002.122320131210 12/23/2013 [1764593.455340] 88042670b9d0 816e8571 001040d0 [1764593.455345] 88042670ba58 81144ae0 880a3fffcb48 [1764593.455348] 000e 88042670ba28 0040 0007 [1764593.455351] Call Trace: [1764593.455361] [] dump_stack+0x45/0x56 [1764593.455367] [] warn_alloc_failed+0xf0/0x140 [1764593.455371] [] __alloc_pages_nodemask+0x725/0x920 [1764593.455376] [] alloc_pages_current+0xa9/0x160 [1764593.455379] [] __get_free_pages+0xe/0x50 [1764593.455384] [] kmalloc_order_trace+0x2e/0xa0 [1764593.455388] [] ? single_open+0xb0/0xb0 [1764593.455391] [] __kmalloc+0x159/0x180 [1764593.455393] [] ? single_open+0xb0/0xb0 [1764593.455398] [] stat_open+0x50/0xc0 [1764593.455401] [] proc_reg_open+0x70/0x110 [1764593.455405] [] do_dentry_open+0x1eb/0x280 [1764593.455408] [] ? proc_reg_release+0x70/0x70 [1764593.455411] [] vfs_open+0x49/0x50 [1764593.455415] [] do_last+0x1c3/0xe50 [1764593.455418] [] ? kmem_cache_alloc_trace+0x108/0x130 [1764593.455421] [] path_openat+0xc1/0x630 [1764593.455426] [] ? handle_mm_fault+0x299/0x670 [1764593.455429] [] do_filp_open+0x3a/0x90 [1764593.455433] [] ? _raw_spin_lock+0xe/0x20 [1764593.455437] [] ? __alloc_fd+0xa7/0x130 [1764593.455440] [] do_sys_open+0x12c/0x270 [1764593.455445] [] ? __set_current_blocked+0x49/0x60 [1764593.455448] [] SyS_open+0x1e/0x20 [1764593.455452] [] system_call_fastpath+0x1a/0x1f [1764593.455454] Mem-Info: [1764593.455455] Node 0 DMA per-cpu: [1764593.455458] CPU0: hi:0, btch: 1 usd: 0 [1764593.455459] CPU1: hi:0, btch: 1 usd: 0 [1764593.455461] CPU2: hi:0, btch: 1 usd: 0 [1764593.455462] CPU3: hi:0, btch: 1 usd: 0 [1764593.455463] CPU4: hi:0, btch: 1 usd: 0 [1764593.455465] CPU5: hi:0, btch: 1 usd: 0 [1764593.455466] CPU6: hi:0, btch: 1 usd: 0 [1764593.455468] CPU7: hi:0, btch: 1 usd: 0 [1764593.455469] Node 0 DMA32 per-cpu: [1764593.455471] CPU0: hi: 186, btch: 31 usd: 0 [1764593.455472] CPU1: hi: 186, btch: 31 usd: 0 [1764593.455474] CPU2: hi: 186, btch: 31 usd: 0 [1764593.455475] CPU3: hi: 186, btch: 31 usd: 0 [1764593.455477] CPU4: hi: 186, btch: 31 usd: 0 [1764593.455478] CPU5: hi: 186, btch: 31 usd: 0 [1764593.455480] CPU6: hi: 186, btch: 31 usd: 0 [1764593.455481] CPU7: hi: 186, btch: 31 usd: 0 [1764593.455482] Node 0 Normal per-cpu: [1764593.455484] CPU0: hi: 186, btch: 31 usd: 0 [1764593.455485] CPU1: hi: 186, btch: 31 usd: 0 [1764593.455487] CPU2: hi: 186, btch: 31 usd: 0 [1764593.455488] CPU3: hi: 186, btch: 31 usd: 0 [1764593.455490] CPU4: hi: 186, btch: 31 usd: 0 [1764593.455491] CPU5: hi: 186, btch: 31 usd: 0 [1764593.455492] CPU6: hi: 186, btch: 31 usd: 0 [1764593.455494] CPU7: hi: 186, btch: 31 usd: 0 [1764593.455495] Node 1 Normal per-cpu: [1764593.455497] CPU0: hi: 186, btch: 31 usd: 0 [1764593.455498] CPU1: hi: 186, btch: 31 usd: 0 [1764593.455500] CPU2: hi: 186, btch: 31 usd: 0 [1764593.455501] CPU3: hi: 186, btch: 31 usd: 0 [1764593.455503] CPU4: hi: 186, btch: 31 usd: 0 [1764593.455504] CPU5: hi: 186, btch: 31 usd: 30 [1764593.455505] CPU6: hi: 186, btch: 31 usd: 0 [1764593.455507] CPU7: hi: 186, btch: 31 usd: 0 [1764593.455511] active_anon:4739030 inactive_anon:2482840 isolated_anon:0 [1764593.455511] active_file:6228818 inactive_file:5945293 isolated_file:0 [1764593.455511] unevictable:1459 dirty:61 writeback:0 unstable:0 [1764593.455511] free:318692 slab_reclaimable:462577 slab_unreclaimable:149699 [1764593.455511] mapped:25851 shmem:2934 pagetables:27313 bounce:0 [1764593.455511] free_cma:0 [1764593.455514] Node 0 DMA free:15848kB min:16kB low:20kB high:24kB active_anon:0kB inactive_anon:0kB active_file:0kB i
[Kernel-packages] [Bug 1319244] Re: iostat: Cannot open /proc/stat: Cannot allocate memory
** Tags added: patch -- You received this bug notification because you are a member of Kernel Packages, which is subscribed to linux in Ubuntu. https://bugs.launchpad.net/bugs/1319244 Title: iostat: Cannot open /proc/stat: Cannot allocate memory Status in “linux” package in Ubuntu: Confirmed Bug description: Intermitently I get errors stating that various programs cannot allocate memory when reading /proc/stat I have 2 servers that are affected by the issue. Probably a duplicate of 1226172 [1764593.455329] top: page allocation failure: order:4, mode:0x1040d0 [1764593.455335] CPU: 3 PID: 10323 Comm: top Tainted: GF O 3.11.0-18-generic #32-Ubuntu [1764593.455338] Hardware name: Intel Corporation S2400SC/S2400SC, BIOS SE5C600.86B.02.02.0002.122320131210 12/23/2013 [1764593.455340] 88042670b9d0 816e8571 001040d0 [1764593.455345] 88042670ba58 81144ae0 880a3fffcb48 [1764593.455348] 000e 88042670ba28 0040 0007 [1764593.455351] Call Trace: [1764593.455361] [] dump_stack+0x45/0x56 [1764593.455367] [] warn_alloc_failed+0xf0/0x140 [1764593.455371] [] __alloc_pages_nodemask+0x725/0x920 [1764593.455376] [] alloc_pages_current+0xa9/0x160 [1764593.455379] [] __get_free_pages+0xe/0x50 [1764593.455384] [] kmalloc_order_trace+0x2e/0xa0 [1764593.455388] [] ? single_open+0xb0/0xb0 [1764593.455391] [] __kmalloc+0x159/0x180 [1764593.455393] [] ? single_open+0xb0/0xb0 [1764593.455398] [] stat_open+0x50/0xc0 [1764593.455401] [] proc_reg_open+0x70/0x110 [1764593.455405] [] do_dentry_open+0x1eb/0x280 [1764593.455408] [] ? proc_reg_release+0x70/0x70 [1764593.455411] [] vfs_open+0x49/0x50 [1764593.455415] [] do_last+0x1c3/0xe50 [1764593.455418] [] ? kmem_cache_alloc_trace+0x108/0x130 [1764593.455421] [] path_openat+0xc1/0x630 [1764593.455426] [] ? handle_mm_fault+0x299/0x670 [1764593.455429] [] do_filp_open+0x3a/0x90 [1764593.455433] [] ? _raw_spin_lock+0xe/0x20 [1764593.455437] [] ? __alloc_fd+0xa7/0x130 [1764593.455440] [] do_sys_open+0x12c/0x270 [1764593.455445] [] ? __set_current_blocked+0x49/0x60 [1764593.455448] [] SyS_open+0x1e/0x20 [1764593.455452] [] system_call_fastpath+0x1a/0x1f [1764593.455454] Mem-Info: [1764593.455455] Node 0 DMA per-cpu: [1764593.455458] CPU0: hi:0, btch: 1 usd: 0 [1764593.455459] CPU1: hi:0, btch: 1 usd: 0 [1764593.455461] CPU2: hi:0, btch: 1 usd: 0 [1764593.455462] CPU3: hi:0, btch: 1 usd: 0 [1764593.455463] CPU4: hi:0, btch: 1 usd: 0 [1764593.455465] CPU5: hi:0, btch: 1 usd: 0 [1764593.455466] CPU6: hi:0, btch: 1 usd: 0 [1764593.455468] CPU7: hi:0, btch: 1 usd: 0 [1764593.455469] Node 0 DMA32 per-cpu: [1764593.455471] CPU0: hi: 186, btch: 31 usd: 0 [1764593.455472] CPU1: hi: 186, btch: 31 usd: 0 [1764593.455474] CPU2: hi: 186, btch: 31 usd: 0 [1764593.455475] CPU3: hi: 186, btch: 31 usd: 0 [1764593.455477] CPU4: hi: 186, btch: 31 usd: 0 [1764593.455478] CPU5: hi: 186, btch: 31 usd: 0 [1764593.455480] CPU6: hi: 186, btch: 31 usd: 0 [1764593.455481] CPU7: hi: 186, btch: 31 usd: 0 [1764593.455482] Node 0 Normal per-cpu: [1764593.455484] CPU0: hi: 186, btch: 31 usd: 0 [1764593.455485] CPU1: hi: 186, btch: 31 usd: 0 [1764593.455487] CPU2: hi: 186, btch: 31 usd: 0 [1764593.455488] CPU3: hi: 186, btch: 31 usd: 0 [1764593.455490] CPU4: hi: 186, btch: 31 usd: 0 [1764593.455491] CPU5: hi: 186, btch: 31 usd: 0 [1764593.455492] CPU6: hi: 186, btch: 31 usd: 0 [1764593.455494] CPU7: hi: 186, btch: 31 usd: 0 [1764593.455495] Node 1 Normal per-cpu: [1764593.455497] CPU0: hi: 186, btch: 31 usd: 0 [1764593.455498] CPU1: hi: 186, btch: 31 usd: 0 [1764593.455500] CPU2: hi: 186, btch: 31 usd: 0 [1764593.455501] CPU3: hi: 186, btch: 31 usd: 0 [1764593.455503] CPU4: hi: 186, btch: 31 usd: 0 [1764593.455504] CPU5: hi: 186, btch: 31 usd: 30 [1764593.455505] CPU6: hi: 186, btch: 31 usd: 0 [1764593.455507] CPU7: hi: 186, btch: 31 usd: 0 [1764593.455511] active_anon:4739030 inactive_anon:2482840 isolated_anon:0 [1764593.455511] active_file:6228818 inactive_file:5945293 isolated_file:0 [1764593.455511] unevictable:1459 dirty:61 writeback:0 unstable:0 [1764593.455511] free:318692 slab_reclaimable:462577 slab_unreclaimable:149699 [1764593.455511] mapped:25851 shmem:2934 pagetables:27313 bounce:0 [1764593.455511] free_cma:0 [1764593.455514] Node 0 DMA free:15848kB min:16kB low:20kB high:24kB active_anon:0kB inactive_anon:0kB active_file:0kB inactive_file:0kB unevictable:0kB isolated(anon):0kB isolated(file):0kB present:15932
[Kernel-packages] [Bug 1319244] Re: iostat: Cannot open /proc/stat: Cannot allocate memory
On a freshish reboot (42 minutes) with some of the qemu VMs started root@lg-host2:~# cat /proc/buddyinfo Node 0, zone DMA 0 0 0 1 1 1 1 0 1 1 3 Node 0, zoneDMA32 6 4 9 7 7 7 5 3 4 1702 Node 0, zone Normal 47259 43506 37987 31332 23517 15376 8779 4479 2145 0 0 Node 1, zone Normal377112 54335 86 19 21 8 3 12 4008 -- You received this bug notification because you are a member of Kernel Packages, which is subscribed to linux in Ubuntu. https://bugs.launchpad.net/bugs/1319244 Title: iostat: Cannot open /proc/stat: Cannot allocate memory Status in “linux” package in Ubuntu: Confirmed Bug description: Intermitently I get errors stating that various programs cannot allocate memory when reading /proc/stat I have 2 servers that are affected by the issue. Probably a duplicate of 1226172 [1764593.455329] top: page allocation failure: order:4, mode:0x1040d0 [1764593.455335] CPU: 3 PID: 10323 Comm: top Tainted: GF O 3.11.0-18-generic #32-Ubuntu [1764593.455338] Hardware name: Intel Corporation S2400SC/S2400SC, BIOS SE5C600.86B.02.02.0002.122320131210 12/23/2013 [1764593.455340] 88042670b9d0 816e8571 001040d0 [1764593.455345] 88042670ba58 81144ae0 880a3fffcb48 [1764593.455348] 000e 88042670ba28 0040 0007 [1764593.455351] Call Trace: [1764593.455361] [] dump_stack+0x45/0x56 [1764593.455367] [] warn_alloc_failed+0xf0/0x140 [1764593.455371] [] __alloc_pages_nodemask+0x725/0x920 [1764593.455376] [] alloc_pages_current+0xa9/0x160 [1764593.455379] [] __get_free_pages+0xe/0x50 [1764593.455384] [] kmalloc_order_trace+0x2e/0xa0 [1764593.455388] [] ? single_open+0xb0/0xb0 [1764593.455391] [] __kmalloc+0x159/0x180 [1764593.455393] [] ? single_open+0xb0/0xb0 [1764593.455398] [] stat_open+0x50/0xc0 [1764593.455401] [] proc_reg_open+0x70/0x110 [1764593.455405] [] do_dentry_open+0x1eb/0x280 [1764593.455408] [] ? proc_reg_release+0x70/0x70 [1764593.455411] [] vfs_open+0x49/0x50 [1764593.455415] [] do_last+0x1c3/0xe50 [1764593.455418] [] ? kmem_cache_alloc_trace+0x108/0x130 [1764593.455421] [] path_openat+0xc1/0x630 [1764593.455426] [] ? handle_mm_fault+0x299/0x670 [1764593.455429] [] do_filp_open+0x3a/0x90 [1764593.455433] [] ? _raw_spin_lock+0xe/0x20 [1764593.455437] [] ? __alloc_fd+0xa7/0x130 [1764593.455440] [] do_sys_open+0x12c/0x270 [1764593.455445] [] ? __set_current_blocked+0x49/0x60 [1764593.455448] [] SyS_open+0x1e/0x20 [1764593.455452] [] system_call_fastpath+0x1a/0x1f [1764593.455454] Mem-Info: [1764593.455455] Node 0 DMA per-cpu: [1764593.455458] CPU0: hi:0, btch: 1 usd: 0 [1764593.455459] CPU1: hi:0, btch: 1 usd: 0 [1764593.455461] CPU2: hi:0, btch: 1 usd: 0 [1764593.455462] CPU3: hi:0, btch: 1 usd: 0 [1764593.455463] CPU4: hi:0, btch: 1 usd: 0 [1764593.455465] CPU5: hi:0, btch: 1 usd: 0 [1764593.455466] CPU6: hi:0, btch: 1 usd: 0 [1764593.455468] CPU7: hi:0, btch: 1 usd: 0 [1764593.455469] Node 0 DMA32 per-cpu: [1764593.455471] CPU0: hi: 186, btch: 31 usd: 0 [1764593.455472] CPU1: hi: 186, btch: 31 usd: 0 [1764593.455474] CPU2: hi: 186, btch: 31 usd: 0 [1764593.455475] CPU3: hi: 186, btch: 31 usd: 0 [1764593.455477] CPU4: hi: 186, btch: 31 usd: 0 [1764593.455478] CPU5: hi: 186, btch: 31 usd: 0 [1764593.455480] CPU6: hi: 186, btch: 31 usd: 0 [1764593.455481] CPU7: hi: 186, btch: 31 usd: 0 [1764593.455482] Node 0 Normal per-cpu: [1764593.455484] CPU0: hi: 186, btch: 31 usd: 0 [1764593.455485] CPU1: hi: 186, btch: 31 usd: 0 [1764593.455487] CPU2: hi: 186, btch: 31 usd: 0 [1764593.455488] CPU3: hi: 186, btch: 31 usd: 0 [1764593.455490] CPU4: hi: 186, btch: 31 usd: 0 [1764593.455491] CPU5: hi: 186, btch: 31 usd: 0 [1764593.455492] CPU6: hi: 186, btch: 31 usd: 0 [1764593.455494] CPU7: hi: 186, btch: 31 usd: 0 [1764593.455495] Node 1 Normal per-cpu: [1764593.455497] CPU0: hi: 186, btch: 31 usd: 0 [1764593.455498] CPU1: hi: 186, btch: 31 usd: 0 [1764593.455500] CPU2: hi: 186, btch: 31 usd: 0 [1764593.455501] CPU3: hi: 186, btch: 31 usd: 0 [1764593.455503] CPU4: hi: 186, btch: 31 usd: 0 [1764593.455504] CPU5: hi: 186, btch: 31 usd: 30 [1764593.455505] CPU6: hi: 186, btch: 31 usd: 0 [1764593.455507] CPU7: hi: 186, btch: 31 usd: 0 [1764593.455511] active_anon:4739030 inactive_anon:2482840 isolated_anon:0 [1764593.455511] active_file:6228818 inactive_file:
[Kernel-packages] [Bug 1319244] Re: iostat: Cannot open /proc/stat: Cannot allocate memory
I've installed the kernel on one of the servers that is affected. It might take a few days before there are any results though. -- You received this bug notification because you are a member of Kernel Packages, which is subscribed to linux in Ubuntu. https://bugs.launchpad.net/bugs/1319244 Title: iostat: Cannot open /proc/stat: Cannot allocate memory Status in “linux” package in Ubuntu: Confirmed Bug description: Intermitently I get errors stating that various programs cannot allocate memory when reading /proc/stat I have 2 servers that are affected by the issue. Probably a duplicate of 1226172 [1764593.455329] top: page allocation failure: order:4, mode:0x1040d0 [1764593.455335] CPU: 3 PID: 10323 Comm: top Tainted: GF O 3.11.0-18-generic #32-Ubuntu [1764593.455338] Hardware name: Intel Corporation S2400SC/S2400SC, BIOS SE5C600.86B.02.02.0002.122320131210 12/23/2013 [1764593.455340] 88042670b9d0 816e8571 001040d0 [1764593.455345] 88042670ba58 81144ae0 880a3fffcb48 [1764593.455348] 000e 88042670ba28 0040 0007 [1764593.455351] Call Trace: [1764593.455361] [] dump_stack+0x45/0x56 [1764593.455367] [] warn_alloc_failed+0xf0/0x140 [1764593.455371] [] __alloc_pages_nodemask+0x725/0x920 [1764593.455376] [] alloc_pages_current+0xa9/0x160 [1764593.455379] [] __get_free_pages+0xe/0x50 [1764593.455384] [] kmalloc_order_trace+0x2e/0xa0 [1764593.455388] [] ? single_open+0xb0/0xb0 [1764593.455391] [] __kmalloc+0x159/0x180 [1764593.455393] [] ? single_open+0xb0/0xb0 [1764593.455398] [] stat_open+0x50/0xc0 [1764593.455401] [] proc_reg_open+0x70/0x110 [1764593.455405] [] do_dentry_open+0x1eb/0x280 [1764593.455408] [] ? proc_reg_release+0x70/0x70 [1764593.455411] [] vfs_open+0x49/0x50 [1764593.455415] [] do_last+0x1c3/0xe50 [1764593.455418] [] ? kmem_cache_alloc_trace+0x108/0x130 [1764593.455421] [] path_openat+0xc1/0x630 [1764593.455426] [] ? handle_mm_fault+0x299/0x670 [1764593.455429] [] do_filp_open+0x3a/0x90 [1764593.455433] [] ? _raw_spin_lock+0xe/0x20 [1764593.455437] [] ? __alloc_fd+0xa7/0x130 [1764593.455440] [] do_sys_open+0x12c/0x270 [1764593.455445] [] ? __set_current_blocked+0x49/0x60 [1764593.455448] [] SyS_open+0x1e/0x20 [1764593.455452] [] system_call_fastpath+0x1a/0x1f [1764593.455454] Mem-Info: [1764593.455455] Node 0 DMA per-cpu: [1764593.455458] CPU0: hi:0, btch: 1 usd: 0 [1764593.455459] CPU1: hi:0, btch: 1 usd: 0 [1764593.455461] CPU2: hi:0, btch: 1 usd: 0 [1764593.455462] CPU3: hi:0, btch: 1 usd: 0 [1764593.455463] CPU4: hi:0, btch: 1 usd: 0 [1764593.455465] CPU5: hi:0, btch: 1 usd: 0 [1764593.455466] CPU6: hi:0, btch: 1 usd: 0 [1764593.455468] CPU7: hi:0, btch: 1 usd: 0 [1764593.455469] Node 0 DMA32 per-cpu: [1764593.455471] CPU0: hi: 186, btch: 31 usd: 0 [1764593.455472] CPU1: hi: 186, btch: 31 usd: 0 [1764593.455474] CPU2: hi: 186, btch: 31 usd: 0 [1764593.455475] CPU3: hi: 186, btch: 31 usd: 0 [1764593.455477] CPU4: hi: 186, btch: 31 usd: 0 [1764593.455478] CPU5: hi: 186, btch: 31 usd: 0 [1764593.455480] CPU6: hi: 186, btch: 31 usd: 0 [1764593.455481] CPU7: hi: 186, btch: 31 usd: 0 [1764593.455482] Node 0 Normal per-cpu: [1764593.455484] CPU0: hi: 186, btch: 31 usd: 0 [1764593.455485] CPU1: hi: 186, btch: 31 usd: 0 [1764593.455487] CPU2: hi: 186, btch: 31 usd: 0 [1764593.455488] CPU3: hi: 186, btch: 31 usd: 0 [1764593.455490] CPU4: hi: 186, btch: 31 usd: 0 [1764593.455491] CPU5: hi: 186, btch: 31 usd: 0 [1764593.455492] CPU6: hi: 186, btch: 31 usd: 0 [1764593.455494] CPU7: hi: 186, btch: 31 usd: 0 [1764593.455495] Node 1 Normal per-cpu: [1764593.455497] CPU0: hi: 186, btch: 31 usd: 0 [1764593.455498] CPU1: hi: 186, btch: 31 usd: 0 [1764593.455500] CPU2: hi: 186, btch: 31 usd: 0 [1764593.455501] CPU3: hi: 186, btch: 31 usd: 0 [1764593.455503] CPU4: hi: 186, btch: 31 usd: 0 [1764593.455504] CPU5: hi: 186, btch: 31 usd: 30 [1764593.455505] CPU6: hi: 186, btch: 31 usd: 0 [1764593.455507] CPU7: hi: 186, btch: 31 usd: 0 [1764593.455511] active_anon:4739030 inactive_anon:2482840 isolated_anon:0 [1764593.455511] active_file:6228818 inactive_file:5945293 isolated_file:0 [1764593.455511] unevictable:1459 dirty:61 writeback:0 unstable:0 [1764593.455511] free:318692 slab_reclaimable:462577 slab_unreclaimable:149699 [1764593.455511] mapped:25851 shmem:2934 pagetables:27313 bounce:0 [1764593.455511] free_cma:0 [1764593.455514] Node 0 DMA free:15848kB min:16kB low:20kB high:24kB active_anon:0kB inactive_ano
[Kernel-packages] [Bug 1319244] Re: iostat: Cannot open /proc/stat: Cannot allocate memory
This would be the proposed way of fixing the issue. I took a current 3.11 kernel version with the patch applied and prepared packages which can be found at http://people.canonical.com/~smb/lp1319244/ Please could you try how this works on your system and report back here with the results? Thanks. ** Patch added: "Proposed fix" https://bugs.launchpad.net/ubuntu/+source/linux/+bug/1319244/+attachment/4112313/+files/0001-UBUNTU-SAUCE-fs-stat-Reduce-memory-requirements-for-.patch -- You received this bug notification because you are a member of Kernel Packages, which is subscribed to linux in Ubuntu. https://bugs.launchpad.net/bugs/1319244 Title: iostat: Cannot open /proc/stat: Cannot allocate memory Status in “linux” package in Ubuntu: Confirmed Bug description: Intermitently I get errors stating that various programs cannot allocate memory when reading /proc/stat I have 2 servers that are affected by the issue. Probably a duplicate of 1226172 [1764593.455329] top: page allocation failure: order:4, mode:0x1040d0 [1764593.455335] CPU: 3 PID: 10323 Comm: top Tainted: GF O 3.11.0-18-generic #32-Ubuntu [1764593.455338] Hardware name: Intel Corporation S2400SC/S2400SC, BIOS SE5C600.86B.02.02.0002.122320131210 12/23/2013 [1764593.455340] 88042670b9d0 816e8571 001040d0 [1764593.455345] 88042670ba58 81144ae0 880a3fffcb48 [1764593.455348] 000e 88042670ba28 0040 0007 [1764593.455351] Call Trace: [1764593.455361] [] dump_stack+0x45/0x56 [1764593.455367] [] warn_alloc_failed+0xf0/0x140 [1764593.455371] [] __alloc_pages_nodemask+0x725/0x920 [1764593.455376] [] alloc_pages_current+0xa9/0x160 [1764593.455379] [] __get_free_pages+0xe/0x50 [1764593.455384] [] kmalloc_order_trace+0x2e/0xa0 [1764593.455388] [] ? single_open+0xb0/0xb0 [1764593.455391] [] __kmalloc+0x159/0x180 [1764593.455393] [] ? single_open+0xb0/0xb0 [1764593.455398] [] stat_open+0x50/0xc0 [1764593.455401] [] proc_reg_open+0x70/0x110 [1764593.455405] [] do_dentry_open+0x1eb/0x280 [1764593.455408] [] ? proc_reg_release+0x70/0x70 [1764593.455411] [] vfs_open+0x49/0x50 [1764593.455415] [] do_last+0x1c3/0xe50 [1764593.455418] [] ? kmem_cache_alloc_trace+0x108/0x130 [1764593.455421] [] path_openat+0xc1/0x630 [1764593.455426] [] ? handle_mm_fault+0x299/0x670 [1764593.455429] [] do_filp_open+0x3a/0x90 [1764593.455433] [] ? _raw_spin_lock+0xe/0x20 [1764593.455437] [] ? __alloc_fd+0xa7/0x130 [1764593.455440] [] do_sys_open+0x12c/0x270 [1764593.455445] [] ? __set_current_blocked+0x49/0x60 [1764593.455448] [] SyS_open+0x1e/0x20 [1764593.455452] [] system_call_fastpath+0x1a/0x1f [1764593.455454] Mem-Info: [1764593.455455] Node 0 DMA per-cpu: [1764593.455458] CPU0: hi:0, btch: 1 usd: 0 [1764593.455459] CPU1: hi:0, btch: 1 usd: 0 [1764593.455461] CPU2: hi:0, btch: 1 usd: 0 [1764593.455462] CPU3: hi:0, btch: 1 usd: 0 [1764593.455463] CPU4: hi:0, btch: 1 usd: 0 [1764593.455465] CPU5: hi:0, btch: 1 usd: 0 [1764593.455466] CPU6: hi:0, btch: 1 usd: 0 [1764593.455468] CPU7: hi:0, btch: 1 usd: 0 [1764593.455469] Node 0 DMA32 per-cpu: [1764593.455471] CPU0: hi: 186, btch: 31 usd: 0 [1764593.455472] CPU1: hi: 186, btch: 31 usd: 0 [1764593.455474] CPU2: hi: 186, btch: 31 usd: 0 [1764593.455475] CPU3: hi: 186, btch: 31 usd: 0 [1764593.455477] CPU4: hi: 186, btch: 31 usd: 0 [1764593.455478] CPU5: hi: 186, btch: 31 usd: 0 [1764593.455480] CPU6: hi: 186, btch: 31 usd: 0 [1764593.455481] CPU7: hi: 186, btch: 31 usd: 0 [1764593.455482] Node 0 Normal per-cpu: [1764593.455484] CPU0: hi: 186, btch: 31 usd: 0 [1764593.455485] CPU1: hi: 186, btch: 31 usd: 0 [1764593.455487] CPU2: hi: 186, btch: 31 usd: 0 [1764593.455488] CPU3: hi: 186, btch: 31 usd: 0 [1764593.455490] CPU4: hi: 186, btch: 31 usd: 0 [1764593.455491] CPU5: hi: 186, btch: 31 usd: 0 [1764593.455492] CPU6: hi: 186, btch: 31 usd: 0 [1764593.455494] CPU7: hi: 186, btch: 31 usd: 0 [1764593.455495] Node 1 Normal per-cpu: [1764593.455497] CPU0: hi: 186, btch: 31 usd: 0 [1764593.455498] CPU1: hi: 186, btch: 31 usd: 0 [1764593.455500] CPU2: hi: 186, btch: 31 usd: 0 [1764593.455501] CPU3: hi: 186, btch: 31 usd: 0 [1764593.455503] CPU4: hi: 186, btch: 31 usd: 0 [1764593.455504] CPU5: hi: 186, btch: 31 usd: 30 [1764593.455505] CPU6: hi: 186, btch: 31 usd: 0 [1764593.455507] CPU7: hi: 186, btch: 31 usd: 0 [1764593.455511] active_anon:4739030 inactive_anon:2482840 isolated_anon:0 [1764593.455511] active_file:6228818 inactive_file:5945293 isolated_
[Kernel-packages] [Bug 1319244] Re: iostat: Cannot open /proc/stat: Cannot allocate memory
It looks like two things at play: 1. Something in the way the system is set up seems to the DMA/DMA32 pool under higher pressure 2. Reading /proc/stat ends up requesting a 64kB memory area (order-4) in the DMA32 pool on node0 While there are still two elements in the 64kB slot, they both are emergency reserve, which open_stat did not ask for. So while there is not much that can easily be done about the memory pressure in general, it looks like open_stat could very well be more conservative about its memory requirement. First the calculation reserves 128 bytes for each possible cpu, while the actual output only produces one line of overall stats, plus one for each online cpu. So it seems to make sense to use the number of online cpus for the allocation. Second the upper limit for the buffer is set to the maximum that kmalloc can do. However it is known that anything beyond order-3 allocations (32kB) are costly and prone to fail due to memory pressure. And having a smaller buffer is not world ending for the stat output either. Since the proc file uses the seq_file functions it only would cause more read calls instead of filling all stats into one single buffer. ** Changed in: linux (Ubuntu) Importance: Undecided => Medium ** Changed in: linux (Ubuntu) Assignee: (unassigned) => Stefan Bader (smb) -- You received this bug notification because you are a member of Kernel Packages, which is subscribed to linux in Ubuntu. https://bugs.launchpad.net/bugs/1319244 Title: iostat: Cannot open /proc/stat: Cannot allocate memory Status in “linux” package in Ubuntu: Confirmed Bug description: Intermitently I get errors stating that various programs cannot allocate memory when reading /proc/stat I have 2 servers that are affected by the issue. Probably a duplicate of 1226172 [1764593.455329] top: page allocation failure: order:4, mode:0x1040d0 [1764593.455335] CPU: 3 PID: 10323 Comm: top Tainted: GF O 3.11.0-18-generic #32-Ubuntu [1764593.455338] Hardware name: Intel Corporation S2400SC/S2400SC, BIOS SE5C600.86B.02.02.0002.122320131210 12/23/2013 [1764593.455340] 88042670b9d0 816e8571 001040d0 [1764593.455345] 88042670ba58 81144ae0 880a3fffcb48 [1764593.455348] 000e 88042670ba28 0040 0007 [1764593.455351] Call Trace: [1764593.455361] [] dump_stack+0x45/0x56 [1764593.455367] [] warn_alloc_failed+0xf0/0x140 [1764593.455371] [] __alloc_pages_nodemask+0x725/0x920 [1764593.455376] [] alloc_pages_current+0xa9/0x160 [1764593.455379] [] __get_free_pages+0xe/0x50 [1764593.455384] [] kmalloc_order_trace+0x2e/0xa0 [1764593.455388] [] ? single_open+0xb0/0xb0 [1764593.455391] [] __kmalloc+0x159/0x180 [1764593.455393] [] ? single_open+0xb0/0xb0 [1764593.455398] [] stat_open+0x50/0xc0 [1764593.455401] [] proc_reg_open+0x70/0x110 [1764593.455405] [] do_dentry_open+0x1eb/0x280 [1764593.455408] [] ? proc_reg_release+0x70/0x70 [1764593.455411] [] vfs_open+0x49/0x50 [1764593.455415] [] do_last+0x1c3/0xe50 [1764593.455418] [] ? kmem_cache_alloc_trace+0x108/0x130 [1764593.455421] [] path_openat+0xc1/0x630 [1764593.455426] [] ? handle_mm_fault+0x299/0x670 [1764593.455429] [] do_filp_open+0x3a/0x90 [1764593.455433] [] ? _raw_spin_lock+0xe/0x20 [1764593.455437] [] ? __alloc_fd+0xa7/0x130 [1764593.455440] [] do_sys_open+0x12c/0x270 [1764593.455445] [] ? __set_current_blocked+0x49/0x60 [1764593.455448] [] SyS_open+0x1e/0x20 [1764593.455452] [] system_call_fastpath+0x1a/0x1f [1764593.455454] Mem-Info: [1764593.455455] Node 0 DMA per-cpu: [1764593.455458] CPU0: hi:0, btch: 1 usd: 0 [1764593.455459] CPU1: hi:0, btch: 1 usd: 0 [1764593.455461] CPU2: hi:0, btch: 1 usd: 0 [1764593.455462] CPU3: hi:0, btch: 1 usd: 0 [1764593.455463] CPU4: hi:0, btch: 1 usd: 0 [1764593.455465] CPU5: hi:0, btch: 1 usd: 0 [1764593.455466] CPU6: hi:0, btch: 1 usd: 0 [1764593.455468] CPU7: hi:0, btch: 1 usd: 0 [1764593.455469] Node 0 DMA32 per-cpu: [1764593.455471] CPU0: hi: 186, btch: 31 usd: 0 [1764593.455472] CPU1: hi: 186, btch: 31 usd: 0 [1764593.455474] CPU2: hi: 186, btch: 31 usd: 0 [1764593.455475] CPU3: hi: 186, btch: 31 usd: 0 [1764593.455477] CPU4: hi: 186, btch: 31 usd: 0 [1764593.455478] CPU5: hi: 186, btch: 31 usd: 0 [1764593.455480] CPU6: hi: 186, btch: 31 usd: 0 [1764593.455481] CPU7: hi: 186, btch: 31 usd: 0 [1764593.455482] Node 0 Normal per-cpu: [1764593.455484] CPU0: hi: 186, btch: 31 usd: 0 [1764593.455485] CPU1: hi: 186, btch: 31 usd: 0 [1764593.455487] CPU2: hi: 186, btch: 31 usd: 0 [1764593.455488] CPU3: hi: 186, btch: 31 usd: 0 [1764593.455490] CPU4: hi: 186, btch: 3