[
https://issues.apache.org/jira/browse/METRON-354?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15837582#comment-15837582
]
Anand Subramanian commented on METRON-354:
------------------------------------------
[[email protected]] - sorry about the delay in responding. I spun up a quick
dev recently and haven't seen this issue after running for a couple of hours.
This indeed could be due to the various housekeeping activities that has
happened since this ticket was logged.
Please feel free to go ahead and resolve the issue as not reproducible.
> Java OOMs are seen with single node quick-dev deployment
> --------------------------------------------------------
>
> Key: METRON-354
> URL: https://issues.apache.org/jira/browse/METRON-354
> Project: Metron
> Issue Type: Bug
> Affects Versions: 0.2.1BETA
> Environment: Quick dev setup installation using vagrant from HEAD
> Reporter: Anand Subramanian
> Priority: Critical
> Labels: metronqe
> Attachments: messages, messages-20160725, output-platform-info.rtf
>
>
> This is a single node quick-dev deployment from HEAD using vagrant on a
> Macbook Pro. The platform-info output is attached.
> After startup, I noticed multiple java process OOM’s due to lack of swap
> space. Here’s one pasted below for reference and the full /var/log/messages
> files are attached (see messages-20160725 for the OOM errors).
> I did not observe the OOM with earlier with single node vagrant deployments.
> Note that I have not added additional topologies.
> Is this possibly due to the new changes that was introduced related to
> separating out indexing? Please let us know. Also, I was considering
> increasing the # of CPUs and RAM on the vagrant and re-try the single node
> setup. Please advice if it is good to try that route.
> {code}
> Jul 25 10:41:28 node1 kernel: java invoked oom-killer: gfp_mask=0x280da,
> order=0, oom_adj=0, oom_score_adj=0
> Jul 25 10:41:28 node1 kernel: java cpuset=/ mems_allowed=0
> Jul 25 10:41:28 node1 kernel: Pid: 27968, comm: java Not tainted
> 2.6.32-573.22.1.el6.x86_64 #1
> Jul 25 10:41:28 node1 kernel: Call Trace:
> Jul 25 10:41:28 node1 kernel: [<ffffffff810d7151>] ?
> cpuset_print_task_mems_allowed+0x91/0xb0
> Jul 25 10:41:28 node1 kernel: [<ffffffff8112a950>] ? dump_header+0x90/0x1b0
> Jul 25 10:41:28 node1 kernel: [<ffffffff812335ec>] ?
> security_real_capable_noaudit+0x3c/0x70
> Jul 25 10:41:28 node1 kernel: [<ffffffff8112add2>] ?
> oom_kill_process+0x82/0x2a0
> Jul 25 10:41:28 node1 kernel: [<ffffffff8112ad11>] ?
> select_bad_process+0xe1/0x120
> Jul 25 10:41:28 node1 kernel: [<ffffffff8112b210>] ? out_of_memory+0x220/0x3c0
> Jul 25 10:41:28 node1 kernel: [<ffffffff81137bec>] ?
> __alloc_pages_nodemask+0x93c/0x950
> Jul 25 10:41:28 node1 kernel: [<ffffffff810a18a0>] ?
> wake_bit_function+0x0/0x50
> Jul 25 10:41:28 node1 kernel: [<ffffffff81170a7a>] ?
> alloc_pages_vma+0x9a/0x150
> Jul 25 10:41:28 node1 kernel: [<ffffffff81152edd>] ?
> handle_pte_fault+0x73d/0xb20
> Jul 25 10:41:28 node1 kernel: [<ffffffff8115bee4>] ?
> page_remove_rmap+0x54/0xa0
> Jul 25 10:41:28 node1 kernel: [<ffffffff8113e4f8>] ? release_pages+0x178/0x250
> Jul 25 10:41:28 node1 kernel: [<ffffffff81153559>] ?
> handle_mm_fault+0x299/0x3d0
> Jul 25 10:41:28 node1 kernel: [<ffffffff8104f156>] ?
> __do_page_fault+0x146/0x500
> Jul 25 10:41:28 node1 kernel: [<ffffffff8153933e>] ? thread_return+0x4e/0x7d0
> Jul 25 10:41:28 node1 kernel: [<ffffffff8153f96e>] ? do_page_fault+0x3e/0xa0
> Jul 25 10:41:28 node1 kernel: [<ffffffff8153cd15>] ? page_fault+0x25/0x30
> Jul 25 10:41:28 node1 kernel: Mem-Info:
> Jul 25 10:41:28 node1 kernel: Node 0 DMA per-cpu:
> Jul 25 10:41:28 node1 kernel: CPU 0: hi: 0, btch: 1 usd: 0
> Jul 25 10:41:28 node1 kernel: CPU 1: hi: 0, btch: 1 usd: 0
> Jul 25 10:41:28 node1 kernel: CPU 2: hi: 0, btch: 1 usd: 0
> Jul 25 10:41:28 node1 kernel: CPU 3: hi: 0, btch: 1 usd: 0
> Jul 25 10:41:28 node1 kernel: Node 0 DMA32 per-cpu:
> Jul 25 10:41:28 node1 kernel: CPU 0: hi: 186, btch: 31 usd: 0
> Jul 25 10:41:28 node1 kernel: CPU 1: hi: 186, btch: 31 usd: 0
> Jul 25 10:41:28 node1 kernel: CPU 2: hi: 186, btch: 31 usd: 0
> Jul 25 10:41:28 node1 kernel: CPU 3: hi: 186, btch: 31 usd: 0
> Jul 25 10:41:28 node1 kernel: Node 0 Normal per-cpu:
> Jul 25 10:41:28 node1 kernel: CPU 0: hi: 186, btch: 31 usd: 0
> Jul 25 10:41:28 node1 kernel: CPU 1: hi: 186, btch: 31 usd: 0
> Jul 25 10:41:28 node1 kernel: CPU 2: hi: 186, btch: 31 usd: 0
> Jul 25 10:41:28 node1 kernel: CPU 3: hi: 186, btch: 31 usd: 0
> Jul 25 10:41:28 node1 kernel: active_anon:1652718 inactive_anon:271396
> isolated_anon:0
> Jul 25 10:41:28 node1 kernel: active_file:180 inactive_file:250
> isolated_file:0
> Jul 25 10:41:28 node1 kernel: unevictable:0 dirty:78 writeback:194 unstable:0
> Jul 25 10:41:28 node1 kernel: free:25337 slab_reclaimable:6085
> slab_unreclaimable:20565
> Jul 25 10:41:28 node1 kernel: mapped:2265 shmem:758 pagetables:10191 bounce:0
> Jul 25 10:41:28 node1 kernel: Node 0 DMA free:15724kB min:124kB low:152kB
> high:184kB active_anon:0kB inactive_anon:0kB active_file:0kB
> inactive_file:0kB unevictable:0kB isolated(anon):0kB isolated(file):0kB
> present:15336kB mlocked:0kB dirty:0kB writeback:0kB mapped:0kB shmem:0kB
> slab_reclaimable:0kB slab_unreclaimable:0kB kernel_stack:0kB pagetables:0kB
> unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:0 all_unreclaimable?
> yes
> Jul 25 10:41:28 node1 kernel: lowmem_reserve[]: 0 3512 8057 8057
> Jul 25 10:41:28 node1 kernel: Node 0 DMA32 free:47592kB min:29404kB
> low:36752kB high:44104kB active_anon:2789228kB inactive_anon:448972kB
> active_file:408kB inactive_file:608kB unevictable:0kB isolated(anon):0kB
> isolated(file):0kB present:3596448kB mlocked:0kB dirty:84kB writeback:212kB
> mapped:4188kB shmem:92kB slab_reclaimable:7252kB slab_unreclaimable:6108kB
> kernel_stack:7008kB pagetables:8584kB unstable:0kB bounce:0kB
> writeback_tmp:0kB pages_scanned:7840 all_unreclaimable? No
> Jul 25 10:41:28 node1 kernel: lowmem_reserve[]: 0 0 0 0
> Jul 25 10:41:28 node1 kernel: Node 0 DMA: 3*4kB 2*8kB 1*16kB 2*32kB 2*64kB
> 1*128kB 0*256kB 0*512kB 1*1024kB 1*2048kB 3*4096kB = 15724kB
> Jul 25 10:41:28 node1 kernel: Node 0 DMA32: 771*4kB 669*8kB 495*16kB 324*32kB
> 176*64kB 41*128kB 7*256kB 5*512kB 0*1024kB 0*2048kB 0*4096kB = 47588kB
> Jul 25 10:41:28 node1 kernel: Node 0 Normal: 1389*4kB 858*8kB 484*16kB
> 211*32kB 98*64kB 27*128kB 5*256kB 1*512kB 0*1024kB 0*2048kB 0*4096kB = 38436kB
> Jul 25 10:41:28 node1 kernel: 4827 total pagecache pages
> Jul 25 10:41:28 node1 kernel: 3487 pages in swap cache
> Jul 25 10:41:28 node1 kernel: Swap cache stats: add 344321, delete 340834,
> find 83244/91373
> Jul 25 10:41:28 node1 kernel: Free swap = 0kB
> Jul 25 10:41:28 node1 kernel: Total swap = 950268kB
> Jul 25 10:41:28 node1 kernel: 2097151 pages RAM
> Jul 25 10:41:28 node1 kernel: 82377 pages reserved
> Jul 25 10:41:28 node1 kernel: 24151 pages shared
> Jul 25 10:41:28 node1 kernel: 1968100 pages non-shared
> Jul 25 10:41:28 node1 kernel: [ pid ] uid tgid total_vm rss cpu
> oom_adj oom_score_adj name
> Jul 25 10:41:28 node1 kernel: [ 421] 0 421 2813 54 2
> -17 -1000 udevd
> Jul 25 10:41:28 node1 kernel: [ 957] 0 957 2280 5 2
> 0 0 dhclient
> Jul 25 10:41:28 node1 kernel: [ 1074] 0 1074 6899 41 3
> -17 -1000 auditd
> Jul 25 10:41:28 node1 kernel: [ 1108] 0 1108 62799 103 1
> 0 0 rsyslogd
> Jul 25 10:41:28 node1 kernel: [ 1130] 32 1130 4744 23 0
> 0 0 rpcbind
> Jul 25 10:41:28 node1 kernel: [ 1152] 29 1152 5837 12 2
> 0 0 rpc.statd
> Jul 25 10:41:28 node1 kernel: [ 1186] 81 1186 7919 49 1
> 0 0 dbus-daemon
> Jul 25 10:41:28 node1 kernel: [ 1208] 0 1208 47238 13 1
> 0 0 cupsd
> Jul 25 10:41:28 node1 kernel: [ 1302] 0 1302 83885 63 1
> 0 0 VBoxService
> Jul 25 10:41:28 node1 kernel: [ 1430] 0 1430 16558 18 2
> -17 -1000 sshd
> Jul 25 10:41:28 node1 kernel: [ 1442] 38 1442 7685 58 0
> 0 0 ntpd
> Jul 25 10:41:28 node1 kernel: [ 1523] 0 1523 20222 34 0
> 0 0 master
> Jul 25 10:41:28 node1 kernel: [ 1526] 89 1526 20242 26 0
> 0 0 pickup
> Jul 25 10:41:28 node1 kernel: [ 1527] 89 1527 20284 27 0
> 0 0 qmgr
> Jul 25 10:41:28 node1 kernel: [ 1538] 0 1538 29223 108 1
> 0 0 crond
> Jul 25 10:41:28 node1 kernel: [ 1591] 0 1591 54260 14 2
> 0 0 python2.6
> Jul 25 10:41:28 node1 kernel: [ 1655] 0 1655 502740 6571 1
> 0 0 python2.6
> Jul 25 10:41:28 node1 kernel: [ 2803] 26 2803 53974 198 2
> -17 -1000 postmaster
> Jul 25 10:41:28 node1 kernel: [ 2944] 26 2944 44727 24 3
> -17 -1000 postmaster
> Jul 25 10:41:28 node1 kernel: [ 2958] 26 2958 54003 293 1
> -17 -1000 postmaster
> Jul 25 10:41:28 node1 kernel: [ 2959] 26 2959 53974 29 3
> -17 -1000 postmaster
> Jul 25 10:41:28 node1 kernel: [ 2960] 26 2960 54053 112 1
> -17 -1000 postmaster
> Jul 25 10:41:28 node1 kernel: [ 2961] 26 2961 44795 79 3
> -17 -1000 postmaster
> Jul 25 10:41:28 node1 kernel: [ 3427] 0 3427 1053531 119893 1
> 0 0 java
> Jul 25 10:41:28 node1 kernel: [ 3713] 26 3713 54276 136 0
> -17 -1000 postmaster
> Jul 25 10:41:28 node1 kernel: [ 4241] 26 4241 54894 960 1
> -17 -1000 postmaster
> Jul 25 10:41:28 node1 kernel: [ 4396] 26 4396 54834 886 2
> -17 -1000 postmaster
> Jul 25 10:41:28 node1 kernel: [ 4442] 0 4442 5276 4 3
> 0 0 atd
> Jul 25 10:41:28 node1 kernel: [ 4455] 0 4455 1016 7 0
> 0 0 mingetty
> Jul 25 10:41:28 node1 kernel: [ 4457] 0 4457 1016 7 3
> 0 0 mingetty
> Jul 25 10:41:28 node1 kernel: [ 4459] 0 4459 1016 7 0
> 0 0 mingetty
> Jul 25 10:41:28 node1 kernel: [ 4461] 0 4461 1016 7 0
> 0 0 mingetty
> Jul 25 10:41:28 node1 kernel: [ 4463] 0 4463 1016 7 3
> 0 0 mingetty
> Jul 25 10:41:28 node1 kernel: [ 4465] 0 4465 1016 7 3
> 0 0 mingetty
> Jul 25 10:41:28 node1 kernel: [ 4788] 26 4788 54354 286 1
> -17 -1000 postmaster
> Jul 25 10:41:28 node1 kernel: [ 4789] 26 4789 54479 354 2
> -17 -1000 postmaster
> Jul 25 10:41:28 node1 kernel: [ 4790] 26 4790 54337 281 2
> -17 -1000 postmaster
> Jul 25 10:41:28 node1 kernel: [ 5020] 0 5020 24477 20 2
> 0 0 sshd
> Jul 25 10:41:28 node1 kernel: [ 5023] 500 5023 24477 108 0
> 0 0 sshd
> Jul 25 10:41:28 node1 kernel: [ 5024] 500 5024 27076 76 0
> 0 0 bash
> Jul 25 10:41:28 node1 kernel: [ 5170] 506 5170 593404 48898 2
> 0 0 java
> Jul 25 10:41:28 node1 kernel: [ 5348] 506 5348 617924 70789 2
> 0 0 java
> Jul 25 10:41:28 node1 kernel: [ 6495] 502 6495 972509 22341 0
> 0 0 java
> Jul 25 10:41:28 node1 kernel: [ 6642] 507 6642 575084 35142 0
> 0 0 java
> Jul 25 10:41:28 node1 kernel: [ 6828] 1002 6828 26516 7 2
> 0 0 bash
> Jul 25 10:41:28 node1 kernel: [ 6842] 1002 6842 608705 43409 3
> 0 0 java
> Jul 25 10:41:28 node1 kernel: [ 7185] 508 7185 514908 48484 1
> 0 0 java
> Jul 25 10:41:28 node1 kernel: [ 7456] 0 7456 2825 7 0
> 0 0 ambari-sudo.sh
> Jul 25 10:41:28 node1 kernel: [ 7458] 0 7458 12034 7 2
> 0 0 su
> Jul 25 10:41:28 node1 kernel: [ 7459] 501 7459 27041 7 0
> 0 0 bash
> Jul 25 10:41:28 node1 kernel: [ 7492] 501 7492 1194732 104633 1
> 0 0 java
> Jul 25 10:41:28 node1 kernel: [ 7860] 507 7860 759910 105574 3
> 0 0 java
> Jul 25 10:41:28 node1 kernel: [ 8032] 506 8032 576393 26870 2
> 0 0 java
> Jul 25 10:41:28 node1 kernel: [ 8385] 0 8385 2825 54 0
> 0 0 ambari-sudo.sh
> Jul 25 10:41:28 node1 kernel: [ 8387] 0 8387 12034 94 0
> 0 0 su
> Jul 25 10:41:28 node1 kernel: [ 8388] 501 8388 27041 66 1
> 0 0 bash
> Jul 25 10:41:28 node1 kernel: [ 8419] 501 8419 1008287 48414 1
> 0 0 java
> Jul 25 10:41:28 node1 kernel: [ 8699] 1002 8699 26516 71 1
> 0 0 bash
> Jul 25 10:41:28 node1 kernel: [ 8713] 1002 8713 610581 69006 2
> 0 0 java
> Jul 25 10:41:28 node1 kernel: [ 8913] 507 8913 591451 74240 0
> 0 0 java
> Jul 25 10:41:28 node1 kernel: [ 9079] 0 9079 2825 55 0
> 0 0 ambari-sudo.sh
> Jul 25 10:41:28 node1 kernel: [ 9081] 0 9081 12034 94 0
> 0 0 su
> Jul 25 10:41:28 node1 kernel: [ 9082] 501 9082 27041 67 1
> 0 0 bash
> Jul 25 10:41:28 node1 kernel: [ 9101] 501 9101 959388 65132 1
> 0 0 java
> Jul 25 10:41:28 node1 kernel: [ 9564] 0 9564 2825 55 0
> 0 0 ambari-sudo.sh
> Jul 25 10:41:28 node1 kernel: [ 9566] 0 9566 12034 95 3
> 0 0 su
> Jul 25 10:41:28 node1 kernel: [ 9568] 501 9568 27041 66 3
> 0 0 bash
> Jul 25 10:41:28 node1 kernel: [ 9598] 501 9598 959295 56682 3
> 0 0 java
> Jul 25 10:41:28 node1 kernel: [ 9829] 0 9829 2825 54 3
> 0 0 ambari-sudo.sh
> Jul 25 10:41:28 node1 kernel: [ 9831] 0 9831 12034 95 2
> 0 0 su
> Jul 25 10:41:28 node1 kernel: [ 9833] 501 9833 27041 66 3
> 0 0 bash
> Jul 25 10:41:28 node1 kernel: [ 9865] 501 9865 789563 42776 1
> 0 0 java
> Jul 25 10:41:28 node1 kernel: [10954] 504 10954 991402 65001 3
> 0 0 java
> Jul 25 10:41:28 node1 kernel: [14542] 0 14542 4237 3 1
> 0 0 anacron
> Jul 25 10:41:28 node1 kernel: [25128] 0 25128 2812 62 3
> -17 -1000 udevd
> Jul 25 10:41:28 node1 kernel: [25521] 0 25521 31242 364 1
> 0 0 monit
> Jul 25 10:41:28 node1 kernel: [25527] 0 25527 27041 53 0
> 0 0 bash
> Jul 25 10:41:28 node1 kernel: [25528] 0 25528 9025 695 0
> 0 0 yaf
> Jul 25 10:41:28 node1 kernel: [25529] 0 25529 7925 168 0
> 0 0 yafscii
> Jul 25 10:41:28 node1 kernel: [25530] 0 25530 876167 16671 0
> 0 0 java
> Jul 25 10:41:28 node1 kernel: [25627] 0 25627 2845 218 2
> -17 -1000 udevd
> Jul 25 10:41:28 node1 kernel: [25732] 1004 25732 118269 29889 2
> 0 0 snort
> Jul 25 10:41:28 node1 kernel: [27936] 497 27936 1177487 85773 2
> 0 0 java
> Jul 25 10:41:28 node1 kernel: [28665] 0 28665 27042 63 1
> 0 0 run-bro
> Jul 25 10:41:28 node1 kernel: [28671] 0 28671 405709 12732 0
> 0 0 bro
> Jul 25 10:41:28 node1 kernel: [28673] 0 28673 44479 9835 1
> 0 0 bro
> Jul 25 10:41:28 node1 kernel: [28762] 495 28762 895293 18501 1
> 0 0 java
> Jul 25 10:41:28 node1 kernel: [30153] 495 30153 25236 31 3
> 0 0 tail
> Jul 25 10:41:28 node1 kernel: [30163] 0 30163 564471 75910 0
> 0 0 java
> Jul 25 10:41:28 node1 kernel: [30203] 0 30203 4923 1246 3
> 0 0 tcpreplay
> Jul 25 10:41:28 node1 kernel: [30528] 496 30528 320663 23077 0
> 0 0 node
> Jul 25 10:41:28 node1 kernel: [31274] 501 31274 1174199 14254 1
> 0 0 java
> Jul 25 10:41:28 node1 kernel: [31291] 501 31291 1106081 105413 3
> 0 0 java
> Jul 25 10:41:28 node1 kernel: [ 1688] 501 1688 1174579 14296 2
> 0 0 java
> Jul 25 10:41:28 node1 kernel: [ 1742] 501 1742 1119146 119485 3
> 0 0 java
> Jul 25 10:41:28 node1 kernel: [ 2025] 501 2025 1174199 14393 2
> 0 0 java
> Jul 25 10:41:28 node1 kernel: [ 2083] 501 2083 1106593 93424 1
> 0 0 java
> Jul 25 10:41:28 node1 kernel: [ 3206] 26 3206 54329 592 1
> -17 -1000 postmaster
> Jul 25 10:41:28 node1 kernel: [ 3209] 26 3209 54330 590 1
> -17 -1000 postmaster
> Jul 25 10:41:28 node1 kernel: [ 3210] 26 3210 54493 864 3
> -17 -1000 postmaster
> Jul 25 10:41:28 node1 kernel: [ 3211] 26 3211 54333 711 2
> -17 -1000 postmaster
> Jul 25 10:41:28 node1 kernel: [ 3212] 26 3212 54493 843 3
> -17 -1000 postmaster
> Jul 25 10:41:28 node1 kernel: [ 3213] 26 3213 54330 597 2
> -17 -1000 postmaster
> Jul 25 10:41:28 node1 kernel: [ 3214] 26 3214 54330 588 1
> -17 -1000 postmaster
> Jul 25 10:41:28 node1 kernel: [ 3215] 26 3215 54513 865 2
> -17 -1000 postmaster
> Jul 25 10:41:28 node1 kernel: [ 3216] 26 3216 54330 591 1
> -17 -1000 postmaster
> Jul 25 10:41:28 node1 kernel: [ 3494] 0 3494 27074 80 1
> 0 0 mysqld_safe
> Jul 25 10:41:28 node1 kernel: [ 3696] 27 3696 323243 42522 0
> 0 0 mysqld
> Jul 25 10:41:28 node1 kernel: [ 3733] 501 3733 1174356 13505 3
> 0 0 java
> Jul 25 10:41:28 node1 kernel: [ 3749] 501 3749 1124623 97922 1
> 0 0 java
> Jul 25 10:41:28 node1 kernel: [ 4243] 0 4243 27041 52 3
> 0 0 status_bro_topo
> Jul 25 10:41:28 node1 kernel: [ 4244] 0 4244 27041 51 1
> 0 0 status_snort_to
> Jul 25 10:41:28 node1 kernel: [ 4245] 0 4245 27041 53 3
> 0 0 status_indexing
> Jul 25 10:41:28 node1 kernel: [ 4246] 0 4246 27041 47 1
> 0 0 status_snort_to
> Jul 25 10:41:28 node1 kernel: [ 4248] 0 4248 43673 1085 3
> 0 0 python2.6
> Jul 25 10:41:28 node1 kernel: [ 4249] 0 4249 25826 32 1
> 0 0 grep
> Jul 25 10:41:28 node1 kernel: [ 4250] 0 4250 26487 42 0
> 0 0 awk
> Jul 25 10:41:28 node1 kernel: [ 4251] 0 4251 27041 48 3
> 0 0 status_bro_topo
> Jul 25 10:41:28 node1 kernel: [ 4252] 0 4252 43673 1085 3
> 0 0 python2.6
> Jul 25 10:41:28 node1 kernel: [ 4253] 0 4253 25826 32 0
> 0 0 grep
> Jul 25 10:41:28 node1 kernel: [ 4254] 0 4254 26487 42 3
> 0 0 awk
> Jul 25 10:41:28 node1 kernel: [ 4255] 0 4255 27041 51 1
> 0 0 status_enrichme
> Jul 25 10:41:28 node1 kernel: [ 4256] 0 4256 27041 47 0
> 0 0 status_enrichme
> Jul 25 10:41:28 node1 kernel: [ 4257] 0 4257 43674 1086 1
> 0 0 python2.6
> Jul 25 10:41:28 node1 kernel: [ 4258] 0 4258 25826 33 1
> 0 0 grep
> Jul 25 10:41:28 node1 kernel: [ 4259] 0 4259 26487 41 3
> 0 0 awk
> Jul 25 10:41:28 node1 kernel: [ 4260] 0 4260 27041 49 3
> 0 0 status_indexing
> Jul 25 10:41:28 node1 kernel: [ 4261] 0 4261 43673 1085 3
> 0 0 python2.6
> Jul 25 10:41:28 node1 kernel: [ 4262] 0 4262 25826 33 1
> 0 0 grep
> Jul 25 10:41:28 node1 kernel: [ 4263] 0 4263 26487 42 0
> 0 0 awk
> Jul 25 10:41:28 node1 kernel: [ 4304] 0 4304 1121811 19208 3
> 0 0 java
> Jul 25 10:41:28 node1 kernel: [ 4305] 0 4305 1121811 18439 3
> 0 0 java
> Jul 25 10:41:28 node1 kernel: [ 4306] 0 4306 1121811 19719 3
> 0 0 java
> Jul 25 10:41:28 node1 kernel: [ 4308] 0 4308 1121287 18137 3
> 0 0 java
> Jul 25 10:41:28 node1 kernel: [ 4385] 500 4385 28922 61 3
> 0 0 ls
> Jul 25 10:41:28 node1 kernel: Out of memory: Kill process 7860 (java) score
> 53 or sacrifice child
> Jul 25 10:41:28 node1 kernel: Killed process 7860, UID 507, (java)
> total-vm:3039640kB, anon-rss:422096kB, file-rss:200kB
> <snip>
> {code}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
