RE: LeaseExpiredException: No lease on /user/biadmin/analytic‐root/SX5XPWPPDPQH/.

2016-10-18 Thread Brahma Reddy Battula
: LeaseExpiredException: No lease on /user/biadmin/analytic‐root/SX5XPWPPDPQH/. Thanks Gaurav. For my case, I called the HDFS API to write the reducer result into HDFS directly, not using Spark. 2016-10-17 23:24 GMT+08:00 Gaurav Kumar mailto:gauravkuma...@gmail.com>>: Hi, Please also che

Re: LeaseExpiredException: No lease on /user/biadmin/analytic‐root/SX5XPWPPDPQH/.

2016-10-18 Thread Zhang Jianfeng
Thanks Gaurav. For my case, I called the HDFS API to write the reducer result into HDFS directly, not using Spark. 2016-10-17 23:24 GMT+08:00 Gaurav Kumar : > Hi, > > Please also check for coalesced RDD. I encountered the same error while > writing a coalesced rdd/df to HDFS. If this is the case,

Re: LeaseExpiredException: No lease on /user/biadmin/analytic‐root/SX5XPWPPDPQH/.

2016-10-17 Thread Gaurav Kumar
Hi, Please also check for coalesced RDD. I encountered the same error while writing a coalesced rdd/df to HDFS. If this is the case, please use repartition instead. Sent from OnePlus 3 Thanks & Regards, Gaurav Kumar On Oct 17, 2016 11:22 AM, "Zhang Jianfeng" wrote: Thanks Rakesh for your kind

Re: LeaseExpiredException: No lease on /user/biadmin/analytic‐root/SX5XPWPPDPQH/.

2016-10-16 Thread Zhang Jianfeng
Thanks Rakesh for your kind help. Actually during the job only one reducer result file (for example part-r-2) had this error, other reducers worked well. Best Regards, Jian Feng 2016-10-17 11:49 GMT+08:00 Rakesh Radhakrishnan : > Hi Jian Feng, > > Could you please check your code and see any pos

Re: LeaseExpiredException: No lease on /user/biadmin/analytic‐root/SX5XPWPPDPQH/.

2016-10-16 Thread Rakesh Radhakrishnan
Hi Jian Feng, Could you please check your code and see any possibilities of simultaneous access to the same file. Mostly this situation happens when multiple clients tries to access the same file. Code Reference:- https://github.com/apache/hadoop/blob/branch-2.2/hadoop- hdfs-project/hadoop-hdfs/s