hi, HBase version is 0.96. Occasionally, a large cluster got the time out(stacktrace at the end of the email) when access UI or Hbase shell. HBase Master seems working fine as a load job was running and eventually completed successfully.
I did some google and found a suggestion to increase hbase.rpc.timeout. So my question is, besides change hbase.rpc.time to 120 sec or longer, any other possiblity to cause this issue. or any other configuration to tune BTW, I found a good blog here: http://hadoop-hbase.blogspot.com/2012/09/hbase-client-timeouts.html. Any detailed suggestion of best practice around these configuration? thanks Demai Time out stack in pastin : http://pastebin.com/edtATYrw HTTP ERROR 500 Problem accessing /master-status. Reason: Call to hdperf001.svl.ibm.com/9.30.75.10:60000 failed because java.net.SocketTimeoutException: 600000 millis timeout while waiting for channel to be ready for read. ch : java.nio.channels.SocketChannel[connected local=/9.30.75.10:1047 remote= hdperf001.svl.ibm.com/9.30.75.10:60000] Caused by: java.net.SocketTimeoutException: Call to hdperf001.svl.ibm.com/9.30.75.10:60000 failed because java.net.SocketTimeoutException: 600000 millis timeout while waiting for channel to be ready for read. ch : java.nio.channels.SocketChannel[connected local=/9.30.75.10:1047 remote= hdperf001.svl.ibm.com/9.30.75.10:60000] at org.apache.hadoop.hbase.ipc.RpcClient.wrapException(RpcClient.java:1478) at org.apache.hadoop.hbase.ipc.RpcClient.call(RpcClient.java:1453) at org.apache.hadoop.hbase.ipc.RpcClient.callBlockingMethod(RpcClient.java:1653) at org.apache.hadoop.hbase.ipc.RpcClient$BlockingRpcChannelImplementation.callBlockingMethod(RpcClient.java:1711)
