Re: Error while indexing (mapred)

2006-02-14 Thread Florent Gluck
Chris, I bumpped the maximum number of open file descriptors to 32k, but still no luck: ... 060214 062901 reduce 9% 060214 062905 reduce 10% 060214 062908 reduce 11% 060214 062911 reduce 12% 060214 062914 reduce 11% 060214 062917 reduce 10% 060214 062918 reduce 9% 060214 062919 reduce

Re: Error while indexing (mapred)

2006-02-14 Thread Raghavendra Prabhu
Hi Florent Does the mapreduce go in a loop Can you let us know the environment Are you running on windows or linus If on windows ,you should use Cygwin Rgds Prabhu On 2/14/06, Florent Gluck [EMAIL PROTECTED] wrote: Chris, I bumpped the maximum number of open file descriptors to 32k,

Re: Error while indexing (mapred)

2006-02-14 Thread Raghavendra Prabhu
Please ignore my earlier message I think is due to some other reason Rgds Prabhu On 2/14/06, Raghavendra Prabhu [EMAIL PROTECTED] wrote: Hi Florent Does the mapreduce go in a loop Can you let us know the environment Are you running on windows or linus If on windows ,you should

Re: Error while indexing (mapred)

2006-02-11 Thread Chris Schneider
Florent, You might want to try increasing the number of open files allowed on your master machine. We've increased this twice now, and each time it solved similar problems. We now have it at 16K. See my other post today (re: Corrupt NDFS?) for more details. Good Luck, - Chris At 11:07 AM

Re: Error while indexing (mapred)

2006-02-11 Thread Raghavendra Prabhu
Hi Where do we change the no of open files? Where do we do it in the master system Rgds Prabhu On 2/12/06, Chris Schneider [EMAIL PROTECTED] wrote: Florent, You might want to try increasing the number of open files allowed on your master machine. We've increased this twice now, and each