Re: HDFS replication factor

This is solved in Hadoop 3. So stay tuned Best, On Feb 2, 2018 6:26 AM, "李立伟" wrote: > Hi: > It's my understanding that HDFS write operation is not considered > completd until all of the replicas have been successfully written.If so, > does the replication factor

Re: HDFS Shell tool

Superb, fantastic, and a really needed one. I was half way, now let me try to merge my snippets if necessary. Best, Ravion On Feb 9, 2017 10:12 AM, "Vitásek, Ladislav" wrote: > Hello Hadoop fans, > I would like to inform you about our tool we want to share. > > We created a

No Reducer scenarios

Dear all, 1) When we don't set the reducer class in driver program, IdentityReducer is invoked. 2) When we set setNumReduceTasks(0), no reducer, even IdentityReducer is invoked. Now, in the second scenario, we observed that the output is part-m-xx format(instead of part-r-xx format) , which

Re: Combiner and KeyComposite

Are you checking logs at correct place? On Sun, Oct 4, 2015, 4:39 PM paco wrote: > I am doing a secondary sort in Hadoop 2.6.0, I am following this tutorial: >

Re: Chaining MapReduce

Hi , The mappers depend on source data only. But data definitely is going through all mappers, so I should get number of map jpbs as my output right? Instead I am getting only one. Thanks and regards, Ravion On Fri, Aug 21, 2015 at 1:35 PM, ☼ R Nair (रविशंकर नायर) ravishankar.n...@gmail.com

Chaining MapReduce

All, I have three mappers, followed by a reducer. I executed the map reduce successfully. The reported output shows that number of mappers executed is 1 and number of reducers is also 1. Though number of reducers are correct, won't we be getting number of mappers as 3 , since I have three mapper