After upgrading to latest kernel (and rebooting) a node start complain (they are warnings, i know) about OOM:
Nov 4 17:15:46 capitanamerica kernel: [1579205.912120] swapper/2: page allocation failure: order:2, mode:0x2084020 Nov 4 17:15:46 capitanamerica kernel: [1579205.912126] CPU: 2 PID: 0 Comm: swapper/2 Tainted: G IO 4.4.19-1-pve #1 Nov 4 17:15:46 capitanamerica kernel: [1579205.912128] Hardware name: HP ProLiant ML350 G6, BIOS D22 07/02/2013 Nov 4 17:15:46 capitanamerica kernel: [1579205.912130] 0000000000000286 efd902fe15dedf88 ffff880317483a40 ffffffff813f3de3 Nov 4 17:15:46 capitanamerica kernel: [1579205.912133] 0000000002084020 0000000000000000 ffff880317483ad0 ffffffff811937ec Nov 4 17:15:46 capitanamerica kernel: [1579205.912136] 0000000000000001 ffff880317ffc6f0 ffff880317483a98 ffffffff00000030 Nov 4 17:15:46 capitanamerica kernel: [1579205.912139] Call Trace: Nov 4 17:15:46 capitanamerica kernel: [1579205.912140] <IRQ> [<ffffffff813f3de3>] dump_stack+0x63/0x90 Nov 4 17:15:46 capitanamerica kernel: [1579205.912154] [<ffffffff811937ec>] warn_alloc_failed+0xfc/0x150 Nov 4 17:15:46 capitanamerica kernel: [1579205.912157] [<ffffffff8119793f>] __alloc_pages_nodemask+0x99f/0xba0 Nov 4 17:15:46 capitanamerica kernel: [1579205.912163] [<ffffffff81827e10>] ? br_port_flags_change+0x20/0x20 Nov 4 17:15:46 capitanamerica kernel: [1579205.912167] [<ffffffff811e0e92>] alloc_pages_current+0x92/0x120 Nov 4 17:15:46 capitanamerica kernel: [1579205.912170] [<ffffffff81195919>] alloc_kmem_pages+0x19/0x90 Nov 4 17:15:46 capitanamerica kernel: [1579205.912173] [<ffffffff811b2fa8>] kmalloc_order+0x18/0x50 Nov 4 17:15:46 capitanamerica kernel: [1579205.912175] [<ffffffff811b3004>] kmalloc_order_trace+0x24/0xb0 Nov 4 17:15:46 capitanamerica kernel: [1579205.912179] [<ffffffff811ec843>] __kmalloc+0x1e3/0x260 Nov 4 17:15:46 capitanamerica kernel: [1579205.912186] [<ffffffffc00c1d51>] tg3_alloc_rx_data+0x71/0x260 [tg3] Nov 4 17:15:46 capitanamerica kernel: [1579205.912189] [<ffffffffc00c44d0>] tg3_poll_work+0x960/0xf20 [tg3] Nov 4 17:15:46 capitanamerica kernel: [1579205.912193] [<ffffffffc00cff1e>] tg3_poll+0x7e/0x390 [tg3] Nov 4 17:15:46 capitanamerica kernel: [1579205.912197] [<ffffffff81734085>] net_rx_action+0x215/0x350 Nov 4 17:15:46 capitanamerica kernel: [1579205.912201] [<ffffffff8108629e>] __do_softirq+0x10e/0x2a0 Nov 4 17:15:46 capitanamerica kernel: [1579205.912203] [<ffffffff8108658e>] irq_exit+0x8e/0x90 Nov 4 17:15:46 capitanamerica kernel: [1579205.912206] [<ffffffff81856ea4>] do_IRQ+0x54/0xd0 Nov 4 17:15:46 capitanamerica kernel: [1579205.912209] [<ffffffff81854f82>] common_interrupt+0x82/0x82 Nov 4 17:15:46 capitanamerica kernel: [1579205.912210] <EOI> [<ffffffff816d1ee7>] ? cpuidle_enter_state+0x107/0x260 Nov 4 17:15:46 capitanamerica kernel: [1579205.912218] [<ffffffff816d1ec6>] ? cpuidle_enter_state+0xe6/0x260 Nov 4 17:15:46 capitanamerica kernel: [1579205.912220] [<ffffffff816d2077>] cpuidle_enter+0x17/0x20 Nov 4 17:15:46 capitanamerica kernel: [1579205.912225] [<ffffffff810c44db>] call_cpuidle+0x3b/0x70 Nov 4 17:15:46 capitanamerica kernel: [1579205.912226] [<ffffffff816d2053>] ? cpuidle_select+0x13/0x20 Nov 4 17:15:46 capitanamerica kernel: [1579205.912229] [<ffffffff810c47cf>] cpu_startup_entry+0x2bf/0x380 Nov 4 17:15:46 capitanamerica kernel: [1579205.912233] [<ffffffff81051a34>] start_secondary+0x154/0x190 Nov 4 17:15:46 capitanamerica kernel: [1579205.912234] Mem-Info: Nov 4 17:15:46 capitanamerica kernel: [1579205.912240] active_anon:403338 inactive_anon:195604 isolated_anon:0 Nov 4 17:15:46 capitanamerica kernel: [1579205.912240] active_file:1057018 inactive_file:1058794 isolated_file:0 Nov 4 17:15:46 capitanamerica kernel: [1579205.912240] unevictable:880 dirty:213 writeback:10 unstable:0 Nov 4 17:15:46 capitanamerica kernel: [1579205.912240] slab_reclaimable:145369 slab_unreclaimable:21168 Nov 4 17:15:46 capitanamerica kernel: [1579205.912240] mapped:26756 shmem:31941 pagetables:4341 bounce:0 Nov 4 17:15:46 capitanamerica kernel: [1579205.912240] free:67272 free_pcp:943 free_cma:0 Nov 4 17:15:46 capitanamerica kernel: [1579205.912244] Node 0 DMA free:15796kB min:84kB low:104kB high:124kB active_anon:0kB inactive_anon:0kB active_file:0kB inactive_file:0kB unevictable:0kB isolated(anon):0kB isolated(file):0kB present:15992kB managed:15908kB mlocked:0kB dirty:0kB writeback:0kB mapped:0kB shmem:0kB slab_reclaimable:0kB slab_unreclaimable:80kB kernel_stack:0kB pagetables:0kB unstable:0kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB writeback_tmp:0kB pages_scanned:0 all_unreclaimable? yes Nov 4 17:15:46 capitanamerica kernel: [1579205.912251] lowmem_reserve[]: 0 3581 11960 11960 11960 Nov 4 17:15:46 capitanamerica kernel: [1579205.912254] Node 0 DMA32 free:94632kB min:19696kB low:24620kB high:29544kB active_anon:326488kB inactive_anon:336872kB active_file:1346844kB inactive_file:1347320kB unevictable:1324kB isolated(anon):0kB isolated(file):0kB present:3774592kB managed:3693788kB mlocked:1324kB dirty:92kB writeback:0kB mapped:33964kB shmem:41468kB slab_reclaimable:171952kB slab_unreclaimable:21528kB kernel_stack:2320kB pagetables:6068kB unstable:0kB bounce:0kB free_pcp:1928kB local_pcp:520kB free_cma:0kB writeback_tmp:0kB pages_scanned:72 all_unreclaimable? no Nov 4 17:15:46 capitanamerica kernel: [1579205.912261] lowmem_reserve[]: 0 0 8378 8378 8378 Nov 4 17:15:46 capitanamerica kernel: [1579205.912264] Node 0 Normal free:158660kB min:45752kB low:57188kB high:68628kB active_anon:1286864kB inactive_anon:445544kB active_file:2881228kB inactive_file:2887856kB unevictable:2196kB isolated(anon):0kB isolated(file):0kB present:8781820kB managed:8580064kB mlocked:2196kB dirty:760kB writeback:40kB mapped:73060kB shmem:86296kB slab_reclaimable:409524kB slab_unreclaimable:63064kB kernel_stack:7184kB pagetables:11296kB unstable:0kB bounce:0kB free_pcp:1832kB local_pcp:116kB free_cma:0kB writeback_tmp:0kB pages_scanned:0 all_unreclaimable? no Nov 4 17:15:46 capitanamerica kernel: [1579205.912270] lowmem_reserve[]: 0 0 0 0 0 Nov 4 17:15:46 capitanamerica kernel: [1579205.912273] Node 0 DMA: 1*4kB (U) 0*8kB 1*16kB (U) 1*32kB (U) 0*64kB 1*128kB (U) 1*256kB (U) 0*512kB 1*1024kB (U) 1*2048kB (M) 3*4096kB (M) = 15796kB Nov 4 17:15:46 capitanamerica kernel: [1579205.912284] Node 0 DMA32: 9736*4kB (UMEH) 6961*8kB (UMEH) 0*16kB 0*32kB 0*64kB 0*128kB 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 94632kB Nov 4 17:15:46 capitanamerica kernel: [1579205.912291] Node 0 Normal: 23247*4kB (UMEH) 8205*8kB (UMEH) 0*16kB 0*32kB 0*64kB 0*128kB 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 158628kB Nov 4 17:15:46 capitanamerica kernel: [1579205.912300] Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=2048kB Nov 4 17:15:46 capitanamerica kernel: [1579205.912301] 2148328 total pagecache pages Nov 4 17:15:46 capitanamerica kernel: [1579205.912303] 4 pages in swap cache Nov 4 17:15:46 capitanamerica kernel: [1579205.912305] Swap cache stats: add 316, delete 312, find 2/3 Nov 4 17:15:46 capitanamerica kernel: [1579205.912306] Free swap = 29279028kB Nov 4 17:15:46 capitanamerica kernel: [1579205.912307] Total swap = 29280252kB Nov 4 17:15:46 capitanamerica kernel: [1579205.912308] 3143101 pages RAM Nov 4 17:15:46 capitanamerica kernel: [1579205.912309] 0 pages HighMem/MovableOnly Nov 4 17:15:46 capitanamerica kernel: [1579205.912310] 70661 pages reserved Nov 4 17:15:46 capitanamerica kernel: [1579205.912311] 0 pages cma reserved Nov 4 17:15:46 capitanamerica kernel: [1579205.912312] 0 pages hwpoisoned That node is a ceph storage node: have the full pve stack installed and it is joined to the cluster, but have no VM running. The only strange Vm settings is: root@capitanamerica:~# cat /proc/sys/vm/swappiness 1 because the OS is on a SSD disk. I've tried also to enlarge the min VM: root@capitanamerica:~# cat /proc/sys/vm/min_free_kbytes 65536 (was roughly 17MBytes) but nothing change. The strange thing is that the other ceph node in the cluster is a box with 4GB of RAM... and this one have 12GB! ;-( Happy WE. Thanks. -- dott. Marco Gaiarin GNUPG Key ID: 240A3D66 Associazione ``La Nostra Famiglia'' http://www.lanostrafamiglia.it/ Polo FVG - Via della Bontà, 7 - 33078 - San Vito al Tagliamento (PN) marco.gaiarin(at)lanostrafamiglia.it t +39-0434-842711 f +39-0434-842797 Dona il 5 PER MILLE a LA NOSTRA FAMIGLIA! http://www.lanostrafamiglia.it/25/index.php/component/k2/item/123 (cf 00307430132, categoria ONLUS oppure RICERCA SANITARIA) _______________________________________________ pve-user mailing list [email protected] http://pve.proxmox.com/cgi-bin/mailman/listinfo/pve-user
