*We also had a global HDFS file limit to contend with* Yes, we have been seeing this from time to time in our production clusters. Periodic purging of old files helps, but the issue is obvious.
-Vladimir Rodionov On Tue, Apr 15, 2014 at 11:58 AM, Stack <[email protected]> wrote: > On Mon, Apr 14, 2014 at 1:47 PM, Claudiu Soroiu <[email protected]> wrote: > > > .... > > After some tunning I managed to > > reduce it to 8 seconds in total and for the moment it fits the needs. > > > > What did you do Claudiu to get the time down? > Thanks, > St.Ack >
