Re: run spark0.9.1 on yarn with hadoop CDH4

2014-05-16 Thread Sandy Ryza
t; > From: sln-1...@163.com >> > To: u...@spark.incubator.apache.org >> > Subject: run spark0.9.1 on yarn with hadoop CDH4 >> >> > >> > Hi all, >> > I have make HADOOP_CONF_DIR or YARN_CONF_DIR points to the directory >> whi

Re: run spark0.9.1 on yarn with hadoop CDH4

2014-05-15 Thread Arpit Tak
ult on > CentOS/Linux. > > or FYI: http://stackoverflow.com/questions/1117398/java-home-directory > > > > Date: Tue, 6 May 2014 00:23:02 -0700 > > From: sln-1...@163.com > > To: u...@spark.incubator.apache.org > > Subject: run spark0.9.1 on yarn with had

RE: run spark0.9.1 on yarn with hadoop CDH4

2014-05-06 Thread Andrew Lee
Please check JAVA_HOME. Usually it should point to /usr/java/default on CentOS/Linux. or FYI: http://stackoverflow.com/questions/1117398/java-home-directory > Date: Tue, 6 May 2014 00:23:02 -0700 > From: sln-1...@163.com > To: u...@spark.incubator.apache.org > Subject: run spark0

run spark0.9.1 on yarn with hadoop CDH4

2014-05-06 Thread Sophia
Hi all, I have make HADOOP_CONF_DIR or YARN_CONF_DIR points to the directory which contains the (client side) configuration files for the hadoop cluster. The command to launch the YARN Client which I run is like this: # SPARK_JAR=./~/spark-0.9.1/assembly/target/scala-2.10/spark-assembly_2.10-0.9