Re: hadoop job stuck in accepted state

-/nodemanager logs? Also the „Scheduler page in the Webapp might give a hint whether the job is not starting because of unsufficient resources. Cheers Seb. Am 21.05.2014 um 16:19 schrieb Rahul Singh smart.rahul.i...@gmail.com: Hi, I am trying to run the wordcount example on single node cluster

Re: hadoop job stuck in accepted state

Thanks Sebastian. The job was stuck due to memory issues. I found the below mentioned link very useful in configuring the yarn. http://docs.hortonworks.com/HDPDocuments/HDP2/HDP-2.0.6.0/bk_installing_manually_book/content/rpm-chap1-11.html Regards, -Rahul Singh On Fri, May 23, 2014 at 9:59 AM

Re: using -libjars in Hadoop 2.2.1

Hi, I am running with the following command but still, jar is not available to mapper and reducers. hadoop jar /home/hduser/workspace/Minerva.jar my.search.Minerva /user/hduser/input_minerva_actual /user/hduser/output_merva_actual3 -libjars /home/hduser/Documents/Lib/json-simple-1.1.1.jar

Re: Re: Hadoop NoClassDefFoundError

When i unzip my jar.. i get the class files inside the package hirarchy while in your case all files are lying outside? are you sure your jar was properly created? On Wed, Apr 16, 2014 at 1:21 PM, laozh...@sina.cn laozh...@sina.cn wrote: This is the result . /home/laozhao0 $ unzip -l

Re: using -libjars in Hadoop 2.2.1

any help...all are welcome? On Wed, Apr 16, 2014 at 1:13 PM, Rahul Singh smart.rahul.i...@gmail.comwrote: Hi, I am running with the following command but still, jar is not available to mapper and reducers. hadoop jar /home/hduser/workspace/Minerva.jar my.search.Minerva /user/hduser

Re: using -libjars in Hadoop 2.2.1

is not getting picked up and i am getting class def not found error. Thanks and Regards, Rahul Singh On Thu, Apr 17, 2014 at 2:08 AM, Kim Chew kchew...@gmail.com wrote: Thanks Rahman. This problem can be boiled down to how to submit a job compiled with Hadoop-1.1.1 remotely to a Hadoop 2 cluster

Re: job getting hung

:37 AM, Rahul Singh smart.rahul.i...@gmail.comwrote: Hi, I am trying to run wordcount example(input file contains just few words) but the job seems to be stuck. How do i debug what went wrong? [hduser@poc-hadoop04 sbin]$ hadoop jar ../share/hadoop/mapreduce/hadoop-mapreduce-examples-2.3.0

hadoop inconsistent behaviour

WRONG_REDUCE=0 File Input Format Counters Bytes Read=58 File Output Format Counters Bytes Written=40 Thanks and Regards, -Rahul Singh

Re: hadoop inconsistent behaviour

system shutdown complete. On Mon, Apr 14, 2014 at 12:21 PM, Shengjun Xin s...@gopivotal.com wrote: You can check the nodemanager log On Mon, Apr 14, 2014 at 2:38 PM, Rahul Singh smart.rahul.i...@gmail.comwrote: Hi, I am running a job(wordcount example) on 3 node cluster(1 master and 2

Re: hadoop inconsistent behaviour

. On Mon, Apr 14, 2014 at 2:38 PM, Rahul Singh smart.rahul.i...@gmail.comwrote: Hi, I am running a job(wordcount example) on 3 node cluster(1 master and 2 slave), some times the job passes but some times it fails(as reduce fails, input data few kbs). I am not able to nail down the reason

job getting hung

09:01:09 INFO mapreduce.Job: The url to track the job: http://poc-hadoop04:8088/proxy/application_1397446243581_0001/ 14/04/14 09:01:09 INFO mapreduce.Job: Running job: job_1397446243581_0001 Thanks and Regards, Rahul Singh

not able to run map reduce job example on aws machine

DataNode 10738 ResourceManager 11634 Jps 10584 SecondaryNameNode 10844 NodeManager Any pointers will be appreciated. Thanks and Regards, -Rahul Singh

Re: not able to run map reduce job example on aws machine

in mapred.site.xml Thanks Kiran On Thu, Apr 10, 2014 at 3:23 PM, Rahul Singh smart.rahul.i...@gmail.comwrote: Hi, I am getting following exception while running word count example, 14/04/10 15:17:09 INFO mapreduce.Job: Task Id : attempt_1397123038665_0001_m_00_2, Status : FAILED

multi column value support in hadoop

Hi, Is there a muti column value support in hadoop or i need to create custom data type(or writablearray) for two values i.e. Can I map more than one value in mapper and consume multiple values in reducer. Thanks and Regards, Rahul Singh

job not shown in job history server

/jobhistory My jps command shows: 9430 DataNode 10167 ResourceManager 9888 SecondaryNameNode 30433 JobHistoryServer 9136 NameNode 10437 NodeManager Please let me know if i am missing something? Thanks and Regards, Rahul Singh

Re: job not shown in job history server

-site.xml? On Mon, Mar 31, 2014 at 3:10 PM, Rahul Singh smart.rahul.i...@gmail.comwrote: Hi, I have configured hadoop 2.3 single node setup and ran a sample job using hadoop command, hadoop jar jarpath classname inputdir outputdir The job runs sucessfully and outout is as expected, But I

Re: job not shown in job history server

Hi, I copied my mapred-site.xml.template to mapred-site.xml and everything is working fine. Thanks a lot for the help. Regards, -Rahul Singh On Mon, Mar 31, 2014 at 1:37 PM, Rahul Singh smart.rahul.i...@gmail.comwrote: Here is my config regarding the same in *mapred-site.xml.template

Re: HADOOP_MAPRED_HOME not found!

Try adding the hadoop bin path to system path. -Rahul Singh On Fri, Mar 28, 2014 at 11:32 AM, Azuryy Yu azury...@gmail.com wrote: it was defined at hadoop-config.sh On Fri, Mar 28, 2014 at 1:19 PM, divye sheth divs.sh...@gmail.com wrote: Which version of hadoop are u using? AFAIK