RE: More replication of map reduce output

2009-05-21 Thread Puri, Aseem
@hadoop.apache.org Subject: Re: More replication of map reduce output On Thu, May 21, 2009 at 11:16:59AM +0530, Puri, Aseem wrote: I mean when my reduce tasks is set 1 part-0 filw shows replication facor as 3. But I set replication factor as 1 in hadoop-site.xml Did you mark the replication

RE: More replication of map reduce output

2009-05-20 Thread Puri, Aseem
@hadoop.apache.org Subject: Re: More replication of map reduce output Do you mean the three files such as, part-0? If so, you can set the number of reduce tasks as 1. On Thu, May 21, 2009 at 2:39 PM, Puri, Aseem aseem.p...@honeywell.com wrote: Hi            I have running a map reduce program

RE: On usig Eclipse IDE

2009-05-06 Thread Puri, Aseem
George, In my Eclipse Europa it is showing the attribute hadoop.job.ugi. It is after the fs.trash.interval. Thanks Regards Aseem Puri -Original Message- From: George Pang [mailto:p09...@gmail.com] Sent: Wednesday, May 06, 2009 1:07 PM To: core-user@hadoop.apache.org;

RE: How to configure nodes with different user account?

2009-05-04 Thread Puri, Aseem
Starry, In .ssh directory you have to create a file config (without extension) on every node. Suppose server1 is your master and server2, server3 is your slave. On the master (server1), in the config file and add the following lines: Host server2 User user2 Host server3 User user3 On

RE: How to access data node without a passphrase?

2009-04-21 Thread Puri, Aseem
Arber, A. You have to first setup authorization keys 1. Execute the following command to generate keys: ssh-keygen 2. When prompted for filenames and pass phrases press ENTER to accept default values. 3. After the command has finished generating keys, enter the following command to change into

Problem with using differnt username

2009-04-17 Thread Puri, Aseem
Hi I am running Hadoop Cluster on windows. I have 4 datnodes. 3 data node have same username so they always start. But one datanode have different username. When I run command $bin/start-all.sh master tries to find $bin/Hadoop-demon.sh giving master username instead of username in

RE: More Replication on dfs

2009-04-15 Thread Puri, Aseem
, since you have just 3 nodes). Raghu. Puri, Aseem wrote: Alex, Ouput of $ bin/hadoop fsck / command after running HBase data insert command in a table is: . . . . . /hbase/test/903188508/tags/info/4897652949308499876: Under replicated blk_-5193 695109439554521_3133

RE: More Replication on dfs

2009-04-15 Thread Puri, Aseem
, since you have just 3 nodes). Raghu. Puri, Aseem wrote: Alex, Ouput of $ bin/hadoop fsck / command after running HBase data insert command in a table is: . . . . . /hbase/test/903188508/tags/info/4897652949308499876: Under replicated blk_-5193 695109439554521_3133

RE: More Replication on dfs

2009-04-11 Thread Puri, Aseem
be surprised if replication really wasn't happening. Can you run fsck and pay attention to Under-replicated blocks and Mis-replicated blocks? In fact, can you just copy-paste the output of fsck? Alex On Thu, Apr 9, 2009 at 11:23 PM, Puri, Aseem aseem.p...@honeywell.comwrote: Hi I also

RE: More Replication on dfs

2009-04-10 Thread Puri, Aseem
Hi I also tried the command $ bin/hadoop balancer. But still the same problem. Aseem -Original Message- From: Puri, Aseem [mailto:aseem.p...@honeywell.com] Sent: Friday, April 10, 2009 11:18 AM To: core-user@hadoop.apache.org Subject: RE: More Replication on dfs Hi Alex

More Replication on dfs

2009-04-09 Thread Puri, Aseem
Hi I am a new Hadoop user. I have a small cluster with 3 Datanodes. In hadoop-site.xml values of dfs.replication property is 2 but then also it is replicating data on 3 machines. Please tell why is it happening? Regards, Aseem Puri

RE: More Replication on dfs

2009-04-09 Thread Puri, Aseem
factor of 3. There have been cases when clusters running with a replication of 2 discovered new bugs, because replication is so often set to 3. That said, if you can do it, it's probably advisable to run with a replication factor of 3 instead of 2. Alex On Thu, Apr 9, 2009 at 9:56 PM, Puri

RE: Cannot resolve Datonode address in slave file

2009-04-02 Thread Puri, Aseem
done yet: 1. Check if your other hosts can ssh to master. 2. Take a look at logs of other hosts. 2009/4/2 Puri, Aseem aseem.p...@honeywell.com Hi I have a small Hadoop cluster with 3 machines. One is my NameNode/JobTracker + DataNode/TaskTracker and other 2 are DataNode

RE: Eclipse version for Hadoop-0.19.1

2009-04-01 Thread Puri, Aseem
: Re: Eclipse version for Hadoop-0.19.1 I also couldn't succeed in running it in ganymede. I use eclipse europa with v. 0.19.0. I would give it a try for 19.1, though. 2009/3/18 Puri, Aseem aseem.p...@honeywell.com I am using Hadoop - HBase 0.18 and my eclipse supports hadoop-0.18.0-eclipse

RE: Eclipse version for Hadoop-0.19.1

2009-04-01 Thread Puri, Aseem
Try this page for eclipse europa: http://rm.mirror.garr.it/mirrors/eclipse/technology/epp/downloads/release/europa/winter/ This is the fastest for me, if it's too slow, you can download from here: http://archive.eclipse.org/eclipse/downloads/ Rasit 2009/4/1 Puri, Aseem aseem.p...@honeywell.com

Cannot resolve Datonode address in slave file

2009-04-01 Thread Puri, Aseem
Hi I have a small Hadoop cluster with 3 machines. One is my NameNode/JobTracker + DataNode/TaskTracker and other 2 are DataNode/TaskTracker. So I have made all 3 as slave. In slave file I have put names of all there machines as: master slave slave1 When I start Hadoop

Eclipse version for Hadoop-0.19.1

2009-03-18 Thread Puri, Aseem
I am using Hadoop - HBase 0.18 and my eclipse supports hadoop-0.18.0-eclipse-plugin. When I switch to Hadoop 0.19.1 and use hadoop-0.19.0-eclipse-plugin then my eclipse doesn't show mapreduce perspective. I am using Eclipse Platform (GANYMEDE), Version: 3.4.1. Can anyone pls tell