It this occurring an Accumulo client or server process? The thread that sees an out of memory error may not have caused it. Any thread in the system could have exhausted memory. If this happens repeatably, try increasing JVM memory. If that does not work look into using jmap to dump memory and analyze the dump to see what using memory.
On Tue, Nov 19, 2013 at 7:38 PM, Tran, An - 0553 - MITLL <[email protected]>wrote: > Hi, > > I am currently getting TabletServerBatchReaderIterator Java heap space > errors. Below are the log outputs. Do any of you know what is going on > and what is the proper solution to fix this issue? > A little detail on the use case is I have an application which uses a > thread pool that does concurrent queries on Accumulo. Any insight on this > issue is greatly appreciated . > > Thanks. > > 19 Nov 2013 14:13:06,845 52142 [batch scanner 7-7 looking up 4 ranges at > 192.168.1.66:9997] WARN TabletServerBatchReaderIterator run > Java heap space > java.lang.OutOfMemoryError: Java heap space > 19 Nov 2013 14:13:06,845 52142 [batch scanner 7-6 looking up 5 ranges at > 192.168.1.68:9997] WARN TabletServerBatchReaderIterator run > Java heap space > java.lang.OutOfMemoryError: Java heap space > 19 Nov 2013 14:13:06,844 52141 [batch scanner 7-3 looking up 3 ranges at > 192.168.1.69:9997] WARN TabletServerBatchReaderIterator run > Java heap space > java.lang.OutOfMemoryError: Java heap space > 19 Nov 2013 14:13:06,844 52141 [batch scanner 7-2 looking up 3 ranges at > 192.168.1.63:9997] WARN TabletServerBatchReaderIterator run > Java heap space > java.lang.OutOfMemoryError: Java heap space > 19 Nov 2013 14:13:06,843 52140 [batch scanner 6-1 looking up 5 ranges at > 192.168.1.67:9997] WARN TabletServerBatchReaderIterator run > Java heap space > java.lang.OutOfMemoryError: Java heap space > 19 Nov 2013 14:13:06,846 52143 [batch scanner 7-4 looking up 7 ranges at > 192.168.1.67:9997] WARN TabletServerBatchReaderIterator run > Java heap space > java.lang.OutOfMemoryError: Java heap space > 19 Nov 2013 14:13:06,846 52143 [batch scanner 6-3 looking up 5 ranges at > 192.168.1.64:9997] WARN TabletServerBatchReaderIterator run > Java heap space > ava.lang.OutOfMemoryError: Java heap space > at > org.apache.accumulo.core.client.impl.TabletServerBatchReaderIterator.doLookup(TabletServerBatchReaderIterator.java:564) > at > org.apache.accumulo.core.client.impl.TabletServerBatchReaderIterator$QueryTask.run(TabletServerBatchReaderIterator.java:338) > at > org.apache.accumulo.cloudtrace.instrument.TraceRunnable.run(TraceRunnable.java:47) > at > java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) > at > java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) > at java.lang.Thread.run(Thread.java:724) > java.lang.OutOfMemoryError: Java heap space > at java.util.Arrays.copyOfRange(Arrays.java:2550) > at > org.apache.accumulo.core.util.ByteBufferUtil.toBytes(ByteBufferUtil.java:31) > at org.apache.accumulo.core.data.Key.<init>(Key.java:288) > at > org.apache.accumulo.core.client.impl.TabletServerBatchReaderIterator.doLookup(TabletServerBatchReaderIterator.java:564) > at > org.apache.accumulo.core.client.impl.TabletServerBatchReaderIterator$QueryTask.run(TabletServerBatchReaderIterator.java:338) > at > org.apache.accumulo.cloudtrace.instrument.TraceRunnable.run(TraceRunnable.java:47) > at > java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) > at > java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) > at java.lang.Thread.run(Thread.java:724) > >
