https://issues.apache.org/jira/browse/HIVE-1181 is committed. Thanks to Yonqqiang.
We need to "-hiveconf hive.fileformat.check=false" when starting HiveServer to get rid of the extra connections. We still need to fix MAPREDUCE-1504 so that we can re-enable fileformat check. Zheng On Thu, Feb 18, 2010 at 11:47 PM, Bennie Schut <[email protected]> wrote: > That's some great news. Thanks. > > Zheng Shao wrote: >> >> This is actually a bug in MAPREDUCE-1504, but we will try to find a >> workaround. >> https://issues.apache.org/jira/browse/HIVE-1181 >> >> Given that release 0.5.0 is much wanted right now, I don't think we >> want to wait purely for 0.5.0 since the ultimate fix should come from >> Hadoop. >> We will definitely get HIVE-1181 for branch 0.5. >> >> Zheng >> >> ---------- Forwarded message ---------- >> From: Andy Kent <[email protected]> >> Date: Thu, Feb 18, 2010 at 3:17 PM >> Subject: Re: Hive Server Leaking File Descriptors? >> To: "[email protected]" <[email protected]> >> >> >> >> On 18 Feb 2010, at 20:29, "Zheng Shao" <[email protected]> wrote: >> >> >>>> >>>> I've tried to look into it a bit more and it seems to happen on >>>> "load data >>>> inpath" >>>> >> >> This is inline with what we have been seeing as we do around 200 load >> data statements per day and leak approx the same number of file >> descriptors. >> >> Is there any chance this fix will make it into the 0.5 release? >> >> >> >> > > -- Yours, Zheng
