Re: SocketTimeoutException on regionservers

2017-01-19 Thread Yu Li
Have you ever checked the RS gc log and observed any long ones? Please also check the load of your RS/DN machine when this SocketTimeoutException happens, there may be some pause caused by system halt instead of JVM GC. Hope this helps. Best Regards, Yu On 17 January 2017 at 13:29, Stack

Re: SocketTimeoutException on regionservers

2017-01-16 Thread Stack
Timeout after waiting ten seconds to read from HDFS is no fun. Tell us more about your HDFS setup. You collect system metrics on disks? Machines are healthy all around? How frequent does this occur? Thanks for the question, S On Thu, Jan 12, 2017 at 10:18 AM, Tulasi Paradarami <

Re: SocketTimeoutException on regionservers

2017-01-13 Thread Tulasi Paradarami
Any comments? On Thu, Jan 12, 2017 at 10:18 AM, Tulasi Paradarami < tulasi.krishn...@gmail.com> wrote: > Hi, > > I noticed that Regionservers are raising following exceptions > intermittently that is manifesting itself as request timeouts on the client > side. HDFS is in a healthy state and

SocketTimeoutException on regionservers

2017-01-12 Thread Tulasi Paradarami
Hi, I noticed that Regionservers are raising following exceptions intermittently that is manifesting itself as request timeouts on the client side. HDFS is in a healthy state and there are no corrupted blocks (from "hdfs fsck" results). Datanodes were not out of service when this error occurs and