how to set org.apache.hadoop classpath?

2014-01-27 Thread EdwardKing
I use hadoop-2.2.0 under CentOS-5.8,then I set JAVA_HOME ,HADOOP_HOME and CLASSPATH [hadoop@master ~]$ echo $JAVA_HOME /home/software/jdk1.7.0_02 [hadoop@master ~]$ echo $HADOOP_HOME /home/software/hadoop-2.2.0 [hadoop@master mapreduce]$ echo $CLASSPATH .:/home/software/hadoop-2.2.0/share/hadoop

Re: how to set org.apache.hadoop classpath?

2014-01-27 Thread EdwardKing
earth from our ancestors, we borrow it from our > children.'' PROTECT IT !* > > > On Mon, Jan 27, 2014 at 1:43 PM, EdwardKing wrote: > >> I use hadoop-2.2.0 under CentOS-5.8,then I set JAVA_HOME ,HADOOP_HOME and >> CLASSPATH >> >> [hadoop@master ~]

Re: how to set org.apache.hadoop classpath?

2014-01-27 Thread EdwardKing
classpath. Export it to CLASSPATH variable. Sent from my iPhone > On Jan 27, 2014, at 1:41 AM, "EdwardKing" wrote: > > I have set HADOOP_CLASSPATH,but it still raise error. > > [hadoop@master ~]$ export > HADOOP_CLASSPATH=.:/home/software/hadoop-2.2.0/share/hadoop/

PipeMapRed.waitOutputThreads(): subprocess failed with code 2

2014-02-12 Thread EdwardKing
I want to try hadoop streaming example,so I execute following command: $hadoop jar /home/software/hadoop-2.2.0/share/hadoop/tools/lib/hadoop-streaming-2.2.0.jar -file shapetimemapper.rb -mapper shapetimemapper.rb -file shapetimereducer.rb -reducer shapetimereducer.rb -input ufo.tsv -output sha

question about reduce method

2014-02-17 Thread EdwardKing
Hello every, I am a newbie to hadoop2.2.0, I puzzle with reduce method ,I have two text file,sales.txt and account.txt,like follows: sales.txt 001 35.99 2012-03-15 002 12.49 2004-07-02 004 13.42 2005-12-20 003 499.99 2010-12-20 001 78.95 2012-04-02 002 21.99 2006-11-30 002 93.45 2008-09-10 001

hadoop run avro error

2014-02-24 Thread EdwardKing
I use hadoop 2.2.0 to run avro, I know hadoop contains avro-1.7.4.jar,like follows: [hadoop@master lib]$ pwd /home/software/hadoop-2.2.0/share/hadoop/common/lib [hadoop@master lib]$ ls av* avro-1.7.4.jar Then I put avro-1.7.4.jar into classpath $export CLASSPATH=.:/home/software/hadoop-2.2.0/sh

Where is hadoop result?

2014-06-23 Thread EdwardKing
I use hadoop 2.2.0 under Redhat Linux,I run hadoop mapreduce examples like follows: [yarn@localhost sbin]$ hadoop jar /opt/yarn/hadoop-2.2.0/share/hadoop/mapreduce/hadoop-mapreduce-examples-2.2.0.jar pi -Dmapreduce.clientfactory.class.name=org.apache.hadoop.mapred.YarnClientFactory -libjars

ERROR org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode: Exception in doCheckpoint

2014-06-27 Thread EdwardKing
I use hadoop2.2.0, first I set hdfs-site.xml,like follows: [yarn@localhost hadoop]$ vi hdfs-site.xml dfs.replication 1 dfs.namenode.name.dir file:/var/data/hadoop/hdfs/nn fs.checkpoint.dir file:/var/data/hadoop/hdfs/snn fs.checkpoint.edits.dir

hadoop-mapreduce-examples-2.2.0 : Exception from container-launch

2014-06-29 Thread EdwardKing
I run hadoop-mapreduce-examples-2.2.0.jar,it can get correct result,but it raise error "exitCode: 1 due to: Exception from container-launch". Why? How to solve it? Thanks. [yarn@localhost sbin]$ hadoop jar /opt/yarn/hadoop-2.2.0/share/hadoop/mapreduce/hadoop-mapreduce-examples-2.2.0.jar pi -D