> > What I have been hoping to see is the exact text of an OutOfMemoryError > in solr.log so I can tell whether it's happening because of heap space > or some other problem, like stack space. The stacktrace on such an > error might be helpfultoo. >
Hi, I did understand what you need, I'm newbie to Solr and Java but not to Linux. So please believe me, the only data that gets written on OOM is # solr_oom_killer-8983-2016-10-10_00_02_46.log Running OOM killer script for process 116987 for Solr on port 8983 Killed process 116987 # solr.log <long warning about temporary segment, that I've posted ago> # solr_gc_log_20161010_0810 2016-10-10T00:02:26.331+0200: 25715,434: [GC (CMS Initial Mark) [1 CMS-initial-mark: 12114331K(16777216K)] 12163041K(30758272K), 0,0036996 secs] [Times: user=0,01 sys=0,00, real=0,01 secs] 2016-10-10T00:02:26.335+0200: 25715,438: Total time for which application threads were stopped: 0,1433940 seconds, Stopping threads took: 0,1393095 seconds 2016-10-10T00:02:26.335+0200: 25715,438: [CMS-concurrent-mark-start] 2016-10-10T00:02:26.594+0200: 25715,697: Total time for which application threads were stopped: 0,1226207 seconds, Stopping threads took: 0,1223130 seconds 2016-10-10T00:02:26.901+0200: 25716,003: Total time for which application threads were stopped: 0,3050990 seconds, Stopping threads took: 0,3047010 seconds 2016-10-10T00:02:26.960+0200: 25716,063: Total time for which application threads were stopped: 0,0043570 seconds, Stopping threads took: 0,0040603 seconds 2016-10-10T00:02:26.960+0200: 25716,063: Total time for which application threads were stopped: 0,0002308 seconds, Stopping threads took: 0,0000567 seconds 2016-10-10T00:02:28.324+0200: 25717,426: Total time for which application threads were stopped: 0,0061071 seconds, Stopping threads took: 0,0059022 seconds 2016-10-10T00:02:29.325+0200: 25718,428: Total time for which application threads were stopped: 0,0003410 seconds, Stopping threads took: 0,0001455 seconds 2016-10-10T00:02:31.056+0200: 25720,158: [CMS-concurrent-mark: 4,280/4,721 secs] [Times: user=21,41 sys=0,44, real=4,72 secs] 2016-10-10T00:02:31.056+0200: 25720,158: [CMS-concurrent-preclean-start] 2016-10-10T00:02:31.332+0200: 25720,434: Total time for which application threads were stopped: 0,0029760 seconds, Stopping threads took: 0,0027661 seconds 2016-10-10T00:02:32.187+0200: 25721,290: [CMS-concurrent-preclean: 0,965/1,131 secs] [Times: user=5,92 sys=0,09, real=1,13 secs] 2016-10-10T00:02:32.187+0200: 25721,290: [CMS-concurrent-abortable-preclean-start] 2016-10-10T00:02:32.546+0200: 25721,648: Total time for which application threads were stopped: 0,0006876 seconds, Stopping threads took: 0,0001229 seconds 2016-10-10T00:02:32.964+0200: 25722,066: Total time for which application threads were stopped: 0,0020954 seconds, Stopping threads took: 0,0018945 seconds 2016-10-10T00:02:33.794+0200: 25722,896: [CMS-concurrent-abortable-preclean: 1,573/1,607 secs] [Times: user=9,04 sys=0,12, real=1,61 secs] 2016-10-10T00:02:33.926+0200: 25723,028: [GC (CMS Final Remark) [YG occupancy: 4396269 K (13981056 K)]{Heap before GC invocations=478 (full 6): par new generation total 13981056K, used 4396269K [0x00007fa0d8000000, 0x00007fa4d8000000, 0x00007fa4d8000000) eden space 11184896K, 39% used [0x00007fa0d8000000, 0x00007fa1e453b598, 0x00007fa382ac0000) from space 2796160K, 0% used [0x00007fa42d560000, 0x00007fa42d560000, 0x00007fa4d8000000) to space 2796160K, 0% used [0x00007fa382ac0000, 0x00007fa382ac0000, 0x00007fa42d560000) concurrent mark-sweep generation total 16777216K, used 15699719K [0x00007fa4d8000000, 0x00007fa8d8000000, 0x00007fa8d8000000) Metaspace used 36740K, capacity 37441K, committed 37684K, reserved 38912K 2016-10-10T00:02:33.926+0200: 25723,028: [GC (CMS Final Remark) 2016-10-10T00:02:33.926+0200: 25723,029: [ParNew: 4396269K->4396269K(13981056K), 0,0000212 secs] 20095988K->20095988K(30758272K), 0,00 06292 secs] [Times: user=0,00 sys=0,00, real=0,00 secs] Heap after GC invocations=479 (full 6): par new generation total 13981056K, used 4396269K [0x00007fa0d8000000, 0x00007fa4d8000000, 0x00007fa4d8000000) eden space 11184896K, 39% used [0x00007fa0d8000000, 0x00007fa1e453b598, 0x00007fa382ac0000) from space 2796160K, 0% used [0x00007fa42d560000, 0x00007fa42d560000, 0x00007fa4d8000000) to space 2796160K, 0% used [0x00007fa382ac0000, 0x00007fa382ac0000, 0x00007fa42d560000) concurrent mark-sweep generation total 16777216K, used 15699719K [0x00007fa4d8000000, 0x00007fa8d8000000, 0x00007fa8d8000000) Metaspace used 36740K, capacity 37441K, committed 37684K, reserved 38912K } 2016-10-10T00:02:33.926+0200: 25723,029: [Rescan (parallel) , 1,4594466 secs]2016-10-10T00:02:35.386+0200: 25724,488: [weak refs processing, 0,0065564 secs]2016-10-10T00:02:35.392+0200: 25724,495: [class unloading, 0,0089755 secs]2016-10-10T00:02:35.401+0200: 25724,504: [scrub symbol table, 0,0044581 secs]2016-10-10T00:02:35.406+0200: 25724,508: [scrub string table, 0,0005908 secs][1 CMS-remark: 15699719K(16777216K)] 20095988K(30758272K), 1,4808925 secs] [Times: user=2,92 sys=0,01, real=1,48 secs] 2016-10-10T00:02:35.407+0200: 25724,509: Total time for which application threads were stopped: 1,6124523 seconds, Stopping threads took: 0,1312338 seconds 2016-10-10T00:02:35.407+0200: 25724,509: [CMS-concurrent-sweep-start] 2016-10-10T00:02:35.824+0200: 25724,926: [CMS-concurrent-sweep: 0,417/0,417 secs] [Times: user=1,86 sys=0,02, real=0,42 secs] 2016-10-10T00:02:35.824+0200: 25724,926: [CMS-concurrent-reset-start] 2016-10-10T00:02:35.862+0200: 25724,964: [CMS-concurrent-reset: 0,038/0,038 secs] [Times: user=0,15 sys=0,00, real=0,03 secs] {Heap before GC invocations=479 (full 6): {Heap before GC invocations=479 (full 6): par new generation total 13981056K, used 5767902K [0x00007fa0d8000000, 0x00007fa4d8000000, 0x00007fa4d8000000) eden space 11184896K, 51% used [0x00007fa0d8000000, 0x00007fa2380b7b28, 0x00007fa382ac0000) from space 2796160K, 0% used [0x00007fa42d560000, 0x00007fa42d560000, 0x00007fa4d8000000) to space 2796160K, 0% used [0x00007fa382ac0000, 0x00007fa382ac0000, 0x00007fa42d560000) concurrent mark-sweep generation total 16777216K, used 15698847K [0x00007fa4d8000000, 0x00007fa8d8000000, 0x00007fa8d8000000) Metaspace used 36740K, capacity 37441K, committed 37684K, reserved 38912K 2016-10-10T00:02:35.922+0200: 25725,024: [GC (Allocation Failure) 2016-10-10T00:02:35.922+0200: 25725,024: [CMS: 15698847K->15716846K(16777216K), 5,0241273 secs] 21466750K->18470223K(30758272K), [Metaspace: 36740K->36740K(38912K)], 5,0244793 secs] [Times: user=5,03 sys=0,00, real=5,03 secs] Heap after GC invocations=480 (full 7): par new generation total 13981056K, used 2753376K [0x00007fa0d8000000, 0x00007fa4d8000000, 0x00007fa4d8000000) eden space 11184896K, 24% used [0x00007fa0d8000000, 0x00007fa1800d8238, 0x00007fa382ac0000) from space 2796160K, 0% used [0x00007fa42d560000, 0x00007fa42d560000, 0x00007fa4d8000000) to space 2796160K, 0% used [0x00007fa382ac0000, 0x00007fa382ac0000, 0x00007fa42d560000) concurrent mark-sweep generation total 16777216K, used 15716846K [0x00007fa4d8000000, 0x00007fa8d8000000, 0x00007fa8d8000000) Metaspace used 36740K, capacity 37441K, committed 37684K, reserved 38912K } {Heap before GC invocations=480 (full 7): par new generation total 13981056K, used 2753376K [0x00007fa0d8000000, 0x00007fa4d8000000, 0x00007fa4d8000000) eden space 11184896K, 24% used [0x00007fa0d8000000, 0x00007fa1800d8238, 0x00007fa382ac0000) from space 2796160K, 0% used [0x00007fa42d560000, 0x00007fa42d560000, 0x00007fa4d8000000) to space 2796160K, 0% used [0x00007fa382ac0000, 0x00007fa382ac0000, 0x00007fa42d560000) concurrent mark-sweep generation total 16777216K, used 15716846K [0x00007fa4d8000000, 0x00007fa8d8000000, 0x00007fa8d8000000) Metaspace used 36740K, capacity 37441K, committed 37684K, reserved 38912K 2016-10-10T00:02:40.946+0200: 25730,049: [Full GC (Allocation Failure) 2016-10-10T00:02:40.946+0200: 25730,049: [CMS: 15716846K->15716754K(16777216K), 4,6906650 secs] 18470223K->18470130K(30758272K), [Metaspace: 36740K->36740K(38912K)], 4,6907440 secs] [Times: user=4,69 sys=0,00, real=4,69 secs] I'm sorry, that I cannot provide more informations. ______________________________________________________ Gesendet mit Maills.de - mehr als nur Freemail www.maills.de