I use hadoop-2.2.0 under CentOS-5.8,then I set JAVA_HOME ,HADOOP_HOME and
CLASSPATH
[hadoop@master ~]$ echo $JAVA_HOME
/home/software/jdk1.7.0_02
[hadoop@master ~]$ echo $HADOOP_HOME
/home/software/hadoop-2.2.0
[hadoop@master mapreduce]$ echo $CLASSPATH
.:/home/software/hadoop-2.2.0/share/hadoop
earth from our ancestors, we borrow it from our
> children.'' PROTECT IT !*
>
>
> On Mon, Jan 27, 2014 at 1:43 PM, EdwardKing wrote:
>
>> I use hadoop-2.2.0 under CentOS-5.8,then I set JAVA_HOME ,HADOOP_HOME and
>> CLASSPATH
>>
>> [hadoop@master ~]
classpath. Export it to CLASSPATH variable.
Sent from my iPhone
> On Jan 27, 2014, at 1:41 AM, "EdwardKing" wrote:
>
> I have set HADOOP_CLASSPATH,but it still raise error.
>
> [hadoop@master ~]$ export
> HADOOP_CLASSPATH=.:/home/software/hadoop-2.2.0/share/hadoop/
I want to try hadoop streaming example,so I execute following command:
$hadoop jar
/home/software/hadoop-2.2.0/share/hadoop/tools/lib/hadoop-streaming-2.2.0.jar
-file shapetimemapper.rb -mapper shapetimemapper.rb -file shapetimereducer.rb
-reducer shapetimereducer.rb -input ufo.tsv -output sha
Hello every,
I am a newbie to hadoop2.2.0, I puzzle with reduce method ,I have two text
file,sales.txt and account.txt,like follows:
sales.txt
001 35.99 2012-03-15
002 12.49 2004-07-02
004 13.42 2005-12-20
003 499.99 2010-12-20
001 78.95 2012-04-02
002 21.99 2006-11-30
002 93.45 2008-09-10
001
I use hadoop 2.2.0 to run avro, I know hadoop contains avro-1.7.4.jar,like
follows:
[hadoop@master lib]$ pwd
/home/software/hadoop-2.2.0/share/hadoop/common/lib
[hadoop@master lib]$ ls av*
avro-1.7.4.jar
Then I put avro-1.7.4.jar into classpath
$export
CLASSPATH=.:/home/software/hadoop-2.2.0/sh
I use hadoop 2.2.0 under Redhat Linux,I run hadoop mapreduce examples like
follows:
[yarn@localhost sbin]$ hadoop jar
/opt/yarn/hadoop-2.2.0/share/hadoop/mapreduce/hadoop-mapreduce-examples-2.2.0.jar
pi
-Dmapreduce.clientfactory.class.name=org.apache.hadoop.mapred.YarnClientFactory
-libjars
I use hadoop2.2.0, first I set hdfs-site.xml,like follows:
[yarn@localhost hadoop]$ vi hdfs-site.xml
dfs.replication
1
dfs.namenode.name.dir
file:/var/data/hadoop/hdfs/nn
fs.checkpoint.dir
file:/var/data/hadoop/hdfs/snn
fs.checkpoint.edits.dir
I run hadoop-mapreduce-examples-2.2.0.jar,it can get correct result,but it
raise error "exitCode: 1 due to: Exception from container-launch". Why? How to
solve it? Thanks.
[yarn@localhost sbin]$ hadoop jar
/opt/yarn/hadoop-2.2.0/share/hadoop/mapreduce/hadoop-mapreduce-examples-2.2.0.jar
pi
-D