Re: CombineFileInputFormat ran out of memory while making splits

2012-07-16 Thread Felix . 徐
My hadoop version is 1.0.1 and I didn't specify any parameter. 2012/7/16 Felix.徐 ygnhz...@gmail.com HI all, I have written a MyCombineFileInputFormat extends from CombineFileInputFormat , it can put multi files together into the same inputsplit, it works fine for just a small amount of

Re: Basic question on how reducer works

2012-07-16 Thread Subir S
Just for reference of others who might see this thread. Jira corresponding to parameter on reduce input limit is MAPREDUCE-2324 On 7/14/12, Harsh J ha...@cloudera.com wrote: Subir, On Sat, Jul 14, 2012 at 5:30 PM, Subir S subir.sasiku...@gmail.com wrote: Harsh, Thanks I think this is what I