[ 
https://issues.apache.org/jira/browse/HBASE-16345?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15584202#comment-15584202
 ] 

huaxiang sun commented on HBASE-16345:
--------------------------------------

Unittest failure is due to running out of memory.

Running org.apache.hadoop.hbase.mapreduce.TestLoadIncrementalHFilesSplitRecovery
Exception in thread "process reaper" Exception in thread "Thread-2483" 
Exception in thread "Thread-2495" Exception in thread "Thread-2487" 
java.lang.OutOfMemoryError: Java heap space
Exception in thread "Thread-2499" java.lang.OutOfMemoryError: Java heap space
java.lang.OutOfMemoryError: Java heap space
        at java.util.Arrays.copyOfRange(Arrays.java:2694)
        at java.lang.String.<init>(String.java:203)
        at java.lang.StringBuffer.toString(StringBuffer.java:561)
        at java.io.BufferedReader.readLine(BufferedReader.java:352)
        at java.io.BufferedReader.readLine(BufferedReader.java:382)
        at 
org.apache.maven.surefire.shade.org.apache.maven.shared.utils.cli.StreamPumper.run(StreamPumper.java:66)
java.lang.OutOfMemoryError: Java heap space
        at 
java.lang.UNIXProcess$ProcessPipeInputStream.drainInputStream(UNIXProcess.java:320)
        at 
java.lang.UNIXProcess$ProcessPipeInputStream.processExited(UNIXProcess.java:333)
        at java.lang.UNIXProcess.processExited(UNIXProcess.java:241)
        at java.lang.UNIXProcess$4.run(UNIXProcess.java:229)
        at 
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
        at 
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
        at java.lang.Thread.run(Thread.java:745)
java.lang.OutOfMemoryError: Java heap space
        at java.util.Arrays.copyOf(Arrays.java:2367)
        at 
java.lang.AbstractStringBuilder.expandCapacity(AbstractStringBuilder.java:130)
        at 
java.lang.AbstractStringBuilder.ensureCapacityInternal(AbstractStringBuilder.java:114)
        at 
java.lang.AbstractStringBuilder.append(AbstractStringBuilder.java:535)
        at java.lang.StringBuffer.append(StringBuffer.java:322)
        at java.io.BufferedReader.readLine(BufferedReader.java:363)
        at java.io.BufferedReader.readLine(BufferedReader.java:382)
        at 
org.apache.maven.surefire.shade.org.apache.maven.shared.utils.cli.StreamPumper.run(StreamPumper.java:66)
Running org.apache.hadoop.hbase.mapreduce.TestHFileOutputFormat
Exception in thread "Thread-2505" Exception in thread "Thread-2507" 
java.lang.OutOfMemoryError: Java heap space

> RpcRetryingCallerWithReadReplicas#call() should catch some RegionServer 
> Exceptions
> ----------------------------------------------------------------------------------
>
>                 Key: HBASE-16345
>                 URL: https://issues.apache.org/jira/browse/HBASE-16345
>             Project: HBase
>          Issue Type: Bug
>          Components: Client
>    Affects Versions: 2.0.0
>            Reporter: huaxiang sun
>            Assignee: huaxiang sun
>         Attachments: HBASE-16345-v001.patch, HBASE-16345.branch-1.001.patch, 
> HBASE-16345.master.001.patch, HBASE-16345.master.002.patch, 
> HBASE-16345.master.003.patch, HBASE-16345.master.004.patch, 
> HBASE-16345.master.005.patch, HBASE-16345.master.005.patch
>
>
> Update for the description. Debugged more at this front based on the comments 
> from Enis. 
> The cause is that for the primary replica, if its retry is exhausted too 
> fast, f.get() [1] returns ExecutionException. This Exception needs to be 
> ignored and continue with the replicas.
> The other issue is that after adding calls for the replicas, if the first 
> completed task gets ExecutionException (due to the retry exhausted), it 
> throws the exception to the client[2].
> In this case, it needs to loop through these tasks, waiting for the success 
> one. If no one succeeds, throw exception.
> Similar for the scan as well
> [1] 
> https://github.com/apache/hbase/blob/master/hbase-client/src/main/java/org/apache/hadoop/hbase/client/RpcRetryingCallerWithReadReplicas.java#L197
> [2] 
> https://github.com/apache/hbase/blob/master/hbase-client/src/main/java/org/apache/hadoop/hbase/client/RpcRetryingCallerWithReadReplicas.java#L219



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Reply via email to