RE: More replication of map reduce output

2009-05-20 Thread Puri, Aseem
@hadoop.apache.org Subject: Re: More replication of map reduce output On Thu, May 21, 2009 at 11:16:59AM +0530, Puri, Aseem wrote: > I mean when my reduce tasks is set 1 part-0 filw shows replication facor as 3. But I set replication factor as 1 in hadoop-site.xml Did you mark the replicat

Re: More replication of map reduce output

2009-05-20 Thread Michael C. Toren
On Thu, May 21, 2009 at 11:16:59AM +0530, Puri, Aseem wrote: > I mean when my reduce tasks is set 1 part-0 filw shows replication facor > as 3. But I set replication factor as 1 in hadoop-site.xml Did you mark the replication factor configuration option as "final"? e.g.: dfs.repl

RE: More replication of map reduce output

2009-05-20 Thread Puri, Aseem
@hadoop.apache.org Subject: Re: More replication of map reduce output Do you mean the three files such as, part-0? If so, you can set the number of reduce tasks as 1. On Thu, May 21, 2009 at 2:39 PM, Puri, Aseem wrote: > Hi > >            I have running a map reduce program on two nod

Re: More replication of map reduce output

2009-05-20 Thread Edward J. Yoon
Do you mean the three files such as, part-0? If so, you can set the number of reduce tasks as 1. On Thu, May 21, 2009 at 2:39 PM, Puri, Aseem wrote: > Hi > >            I have running a map reduce program on two node. My DFS > replication factor is one. Al files for input have one replication

More replication of map reduce output

2009-05-20 Thread Puri, Aseem
Hi I have running a map reduce program on two node. My DFS replication factor is one. Al files for input have one replication but the output from reduce always have replication 3. Can anyone please tell why it is so? Thanks & Regards Aseem Puri