It appears to me that the "input" directory may not have been created. The "hadoop jar ..." command is expecting that it exists. In pseudo-distributed mode, check that you've run the command from that website http://hadoop.apache.org/docs/current/hadoop-project- dist/hadoop-common/SingleCluster.html <http://hadoop.apache.org/docs/current/hadoop-project-dist/hadoop-common/SingleCluster.html_> $ bin/hdfs dfs -mkdir /user/<username> and replace <username> with huan
Mark On Sat, Oct 4, 2014 at 4:18 AM, xiaopeng <1093218...@qq.com> wrote: > Hi All, > > I install hadoop 2.5.1 on my computer as a single node cluster in > Pseudo-Distributed mode. > > I followed the instructions in the web page '_http://hadoop.apache.org/ > docs/current/hadoop-project-dist/hadoop-common/SingleCluster.html_'. > > It seems all right until I run mapreduce example below: > > huan@huan-ThinkPad-T410:~$ hadoop jar ~/hadoop-2.5.1/share/hadoop/ > mapreduce/hadoop-mapreduce-examples-2.5.1.jar grep input output > 'dfs[a-z.]+' > 14/10/02 21:43:42 INFO client.RMProxy: Connecting to ResourceManager at / > 0.0.0.0:8032 > 14/10/02 21:43:43 WARN mapreduce.JobSubmitter: No job jar file set. User > classes may not be found. See Job or Job#setJar(String). > 14/10/02 21:43:43 INFO input.FileInputFormat: Total input paths to process > : 30 > 14/10/02 21:43:44 INFO mapreduce.JobSubmitter: number of splits:30 > 14/10/02 21:43:44 INFO mapreduce.JobSubmitter: Submitting tokens for job: > job_1412256375065_0001 > 14/10/02 21:43:45 INFO mapred.YARNRunner: Job jar is not present. Not > adding any jar to the list of resources. > 14/10/02 21:43:46 INFO impl.YarnClientImpl: Submitted application > application_1412256375065_0001 > 14/10/02 21:43:46 INFO mapreduce.Job: The url to track the job: > http://huan-ThinkPad-T410:8088/proxy/application_1412256375065_0001/ > 14/10/02 21:43:46 INFO mapreduce.Job: Running job: job_1412256375065_0001 > 14/10/02 21:44:34 INFO mapreduce.Job: Job job_1412256375065_0001 running > in uber mode : false > > So please give me a guide of the problem? Thanks a lot. > > My configuration as below: > > yarn-site.xml: > <configuration> > <!-- Site specific YARN configuration properties --> > <property> > <name>yarn.nodemanager.aux-services</name> > <value>mapreduce_shuffle</value> > </property> > </configuration> > > mapred-site.xml: > <configuration> > <property> > <name>mapreduce.framework.name</name> > <value>yarn</value> > </property> > </configuration> > > hdfs-site.xml: > <configuration> > <property> > <name>dfs.replication</name> > <value>1</value> > </property> > </configuration> > > core-site.xml: > <configuration> > <property> > <name>fs.defaultFS</name> > <value>hdfs://localhost:9000</value> > </property> > </configuration> > -- Mark Laney Hortonworks Technical Instructor c: 720.308.8027 "Half of the world's data will be processed by Apache Hadoop within five years" -- CONFIDENTIALITY NOTICE NOTICE: This message is intended for the use of the individual or entity to which it is addressed and may contain information that is confidential, privileged and exempt from disclosure under applicable law. If the reader of this message is not the intended recipient, you are hereby notified that any printing, copying, dissemination, distribution, disclosure or forwarding of this communication is strictly prohibited. If you have received this communication in error, please contact the sender immediately and delete it from your system. Thank You.
