Thanks very much Harsh , I am a newbie to this , so I don't know much about MR1 or MR2(YARN) , I just updated my old cloudera distribution to the latest following instructions on cloudera website. Thats probably lead me to YARN and I checked and I don't have MR1 files any more.
So please tell me if I should revert back to MR1 some how or I can continue with YARN troubleshooting problems. BTW thanks alot one more time. Thanks On Sat, Oct 19, 2013 at 11:26 PM, Harsh J <[email protected]> wrote: > For CDH-specific questions, you can post them onto the Cloudera > Community forums: http://community.cloudera.com > > On Sun, Oct 20, 2013 at 2:45 AM, gunjan mishra <[email protected]> > wrote: > > HItesh , > > > > My apologies , is there a different distribution list. Please can some > one > > point me to that. > > > > Thanks > > > > > > On Sat, Oct 19, 2013 at 5:11 PM, Hitesh Shah <[email protected]> wrote: > >> > >> Hello Gunjan, > >> > >> This mailing list is for Apache Hadoop related questions. Please post > >> questions for other distributions to the appropriate vendor's mailing > list. > >> > >> thanks > >> -- Hitesh > >> > >> On Oct 19, 2013, at 11:27 AM, gunjan mishra wrote: > >> > >> > Hi I am trying to run a simple word count program , like this , job > >> > keeps running but is not being assigned to Mapper and reducers ... > >> > while I checked the status > >> > > >> > > >> > > =============================================================================================== > >> > > >> > [root@localhost ~]# hadoop jar > >> > /usr/lib/hadoop-0.20-mapreduce/hadoop-examples-2.0.0-mr1-cdh4.4.0.jar > >> > wordcount /usr/read.txt /usr/output > >> > 13/10/19 15:05:02 INFO service.AbstractService: > >> > Service:org.apache.hadoop.yarn.client.YarnClientImpl is inited. > >> > 13/10/19 15:05:02 INFO service.AbstractService: > >> > Service:org.apache.hadoop.yarn.client.YarnClientImpl is started. > >> > 13/10/19 15:05:03 INFO input.FileInputFormat: Total input paths to > >> > process : 1 > >> > 13/10/19 15:05:03 INFO mapreduce.JobSubmitter: number of splits:1 > >> > 13/10/19 15:05:03 WARN conf.Configuration: mapred.jar is deprecated. > >> > Instead, use mapreduce.job.jar > >> > 13/10/19 15:05:03 WARN conf.Configuration: mapred.output.value.class > is > >> > deprecated. Instead, use mapreduce.job.output.value.class > >> > 13/10/19 15:05:03 WARN conf.Configuration: mapreduce.combine.class is > >> > deprecated. Instead, use mapreduce.job.combine.class > >> > 13/10/19 15:05:03 WARN conf.Configuration: mapreduce.map.class is > >> > deprecated. Instead, use mapreduce.job.map.class > >> > 13/10/19 15:05:03 WARN conf.Configuration: mapred.job.name is > >> > deprecated. Instead, use mapreduce.job.name > >> > 13/10/19 15:05:03 WARN conf.Configuration: mapreduce.reduce.class is > >> > deprecated. Instead, use mapreduce.job.reduce.class > >> > 13/10/19 15:05:03 WARN conf.Configuration: mapred.input.dir is > >> > deprecated. Instead, use mapreduce.input.fileinputformat.inputdir > >> > 13/10/19 15:05:03 WARN conf.Configuration: mapred.output.dir is > >> > deprecated. Instead, use mapreduce.output.fileoutputformat.outputdir > >> > 13/10/19 15:05:03 WARN conf.Configuration: mapred.map.tasks is > >> > deprecated. Instead, use mapreduce.job.maps > >> > 13/10/19 15:05:03 WARN conf.Configuration: mapred.output.key.class is > >> > deprecated. Instead, use mapreduce.job.output.key.class > >> > 13/10/19 15:05:03 WARN conf.Configuration: mapred.working.dir is > >> > deprecated. Instead, use mapreduce.job.working.dir > >> > 13/10/19 15:05:03 INFO mapreduce.JobSubmitter: Submitting tokens for > >> > job: job_1382144693199_0005 > >> > 13/10/19 15:05:03 INFO client.YarnClientImpl: Submitted application > >> > application_1382144693199_0005 to ResourceManager at /0.0.0.0:8032 > >> > 13/10/19 15:05:04 INFO mapreduce.Job: The url to track the job: > >> > > http://localhost.localdomain:8088/proxy/application_1382144693199_0005/ > >> > 13/10/19 15:05:04 INFO mapreduce.Job: Running job: > >> > job_1382144693199_0005 > >> > > >> > > >> > > =============================================================================================== > >> > > >> > here is my cloudera distribution > >> > > >> > > >> > Hadoop 2.0.0-cdh4.4.0 > >> > Subversion > >> > > file:///data/1/jenkins/workspace/generic-package-rhel64-6-0/topdir/BUILD/hadoop-2.0.0-cdh4.4.0/src/hadoop-common-project/hadoop-common > >> > -r c0eba6cd38c984557e96a16ccd7356b7de835e79 > >> > Compiled by jenkins on Tue Sep 3 19:33:17 PDT 2013 > >> > From source with checksum ac7e170aa709b3ace13dc5f775487180 > >> > This command was run using > >> > /usr/lib/hadoop/hadoop-common-2.0.0-cdh4.4.0.jar > >> > > >> > > >> > and the outcome of jps (from root) > >> > > >> > ----------------------------------------- > >> > [root@localhost ~]# jps > >> > 2202 TaskTracker > >> > 4161 Bootstrap > >> > 3134 DataNode > >> > 3520 Application > >> > 3262 NameNode > >> > 1879 ThriftServer > >> > 1740 Main > >> > 3603 RunJar > >> > 1606 HMaster > >> > 2078 JobTracker > >> > 16277 Jps > >> > 3624 RunJar > >> > 4053 RunJar > >> > 4189 Sqoop > >> > 3582 Bootstrap > >> > 3024 JobHistoryServer > >> > 3379 SecondaryNameNode > >> > 4732 ResourceManager > >> > > >> > ------------------------------------------------------ > >> > -- > >> > Thanks & Regards > >> > Gunjan Mishra > >> > 732-200-5839(H) > >> > 917-216-9739(C) > >> > > > > > > > > -- > > Thanks & Regards > > Gunjan Mishra > > 732-200-5839(H) > > 917-216-9739(C) > > > > -- > Harsh J > -- Thanks & Regards Gunjan Mishra 732-200-5839(H) 917-216-9739(C)
