RE: launch aggregatewordcount and sudoku in Yarn

Hi, You can run aggregatewordcount Job using the below command, Command : bin/hadoop jar hadoop-*-examples.jar aggregatewordcount in-dir out-dir numOfReducers inputformat inputformat - It uses default as seqfileinputformat, we can change it to textinputformat. If we pass other than

RE: How run Aggregator wordcount?

It doesn't accept multiple folders as input. You can have multiple files in a directory and same you can give as input. Thanks Devaraj K From: Pedro Sá da Costa [mailto:psdc1...@gmail.com] Sent: 22 June 2013 16:25 To: mapreduce-user Subject: How run Aggregator wordcount? Aggregator wordcount

Re: MapReduce job not running - i think i keep all correct configuration.

Can you paste some error logs here? you can find it on the JT or TT. and tell us the hadoop version. On Sun, Jun 23, 2013 at 9:20 PM, Pavan Kumar Polineni smartsunny...@gmail.com wrote: Hi all, first i have a machine with all the demons are running on it. after that i added two data

Re: MapReduce job not running - i think i keep all correct configuration.

Hi all, i solved it. due to some cluster id prob . Thanks for support On Mon, Jun 24, 2013 at 11:39 AM, Azuryy Yu azury...@gmail.com wrote: Can you paste some error logs here? you can find it on the JT or TT. and tell us the hadoop version. On Sun, Jun 23, 2013 at 9:20 PM, Pavan Kumar

Re: how to turn on NativeIO.posixFadviseIfPossible

Hi Leo, Following your instruction on moving the sections in configure.ac, I am able to re-compile the code base and I can find that the objdump returns the correct fadvise symbols as you described in your earlier email. I then ran the TestNativeIO.java class and I believe that the Fadvise test

RE: Job end notification does not always work (Hadoop 2.x)

Even if we handle all the failure cases in AM for Job End Notification, we may miss cases like abrupt kill of AM when it is in last retry. If we choose NM to give the notification, again RM needs to identify which NM should give the end-notification as we don't have any direct protocol between

Re: Requesting containers on a specific host

Yes Arun, the one I am giving is same as the one I see in RM's log also. Thanks, Kishore On Fri, Jun 21, 2013 at 7:25 PM, Arun C Murthy a...@hortonworks.com wrote: Check if the hostname you are setting is the same in the RM logs… On Jun 21, 2013, at 2:15 AM, Krishna Kishore Bonagiri

Re: Job end notification does not always work (Hadoop 2.x)

if we ought to do this in a yarn service it should be the RM or the HS. the RM is, IMO, the natural fit. the HS, would be a good choice if we are concerned about the extra work this would cause in the RM. the problem with the current HS is that it is MR specific, we should generalize it for

Re: Compile Just a Subproject

Hi Omkar, That was a typo, good catch. The path to Client.java should be C:\l\hadoop-yarn-project\hadoop-yarn\hadoop-yarn-applications\hadoop-yarn- applications-distributedshell /src/main/java/org/apache/hadoop/yarn/applications/distributedshell/Client.java Running as you suggest does build the

RE: how to turn on NativeIO.posixFadviseIfPossible

You're welcome. Have fun with hadoop! Regards, Leo From: Jun Li [mailto:jltz922...@gmail.com] Sent: Sunday, June 23, 2013 11:24 PM To: user@hadoop.apache.org Subject: Re: how to turn on NativeIO.posixFadviseIfPossible Hi Leo, Following your instruction on moving the sections in

Piping to HDFS (from Linux or HDFS)

Hi guys While I was trying to get some test data and configurations done quickly I realized one can do this and I think its super cool Processing existing file on Linux/HDFS and Piping it directly to hdfs source = Linux dest=HDFS == File = sanjay.conf.template We want to

could only be replicated to 0 nodes instead of minReplication exception during job execution

Hello, I am using YARN. I get some exceptions at my namenode and datanode. They are thrown when my Reduce progress gets 67%. Then, reduce phase is restarted from 0% several times, but always restarts at this point. Can someone tell me what I should do? Many thanks! Namenode log: 2013-06-24

Re: could only be replicated to 0 nodes instead of minReplication exception during job execution

Hi, I see there are 2 datanodes and for some reason namenode is not able to create even single replica for requested blocks. are you sure the system on which these datanodes are running have sufficient disk space? Do you see any other errors in datanode/namenode logs? What must be happening is

which hadoop version i can choose in production env?

hadoop 1 vs hadoop 2 ,and apache community version vs cloudrea version,anyone can help?

Re: which hadoop version i can choose in production env?

I advice community version of Hadoop-1.1.2, which is a stable release, Hadoop2 hasn't stable release currently, even if all alpha release was extensive tested. but from me, I think HDFS2 is stable now.(no?), MR1 is also stable, but Yarn still need extensive tests(at least I think so), so our

答复： which hadoop version i can choose in production env?

What is MR1? -- 使用语盒发送 @2013-06-25 03:39 http://www.yuchs.com -- 原始邮件 -- user@hadoop.apache.org @2013年06月25日 03:27 I advice community version of Hadoop-1.1.2, which is a stable release, Hadoop2 hasn't stable release currently, even if all alpha release was extensive tested. but from

答复： which hadoop version i can choose in p roduction env?

I do not intent to use mapreduce ,I use hbase on hadoop -- 使用语盒发送 @2013-06-25 03:44 http://www.yuchs.com -- 原始邮件 -- user@hadoop.apache.org @2013年06月25日 03:36 Hi Yuhe, MR1 means Mapreduce version 1. (in Hadoop 1.x) On Tue, Jun 25, 2013 at 12:39 PM, yuhe justlo...@gmail.com wrote:

RE: After importing into Eclipse

It is a good start Lokesh. Can you go through this page http://wiki.apache.org/hadoop/HowToContribute for the steps and guidelines to contribute. Thanks Devaraj k From: Lokesh Basu [mailto:lokesh.b...@gmail.com] Sent: 25 June 2013 11:03 To: user@hadoop.apache.org Subject: After importing into