Re: Running Spark Job on Yarn from Java Code

Hi there I also got exception when running PI example on YARN Spark version: spark-1.1.1-bin-hadoop2.4 My environment: Hortonworks HDP 2.2 My command: ./bin/spark-submit --master yarn-cluster --class org.apache.spark.examples.SparkPi lib/spark-examples*.jar 10 Output logs: 14/12/17 14:06:32 IN

Running Spark Job on Yarn from Java Code

Hi all, I am trying to run a simple Spark_Pi application through Yarn from Java code. I have the Spark_Pi class and everything works fine if I run on Spark. However, when I set master to "yarn-client" and set yarn mode to true, I keep getting exceptions. I suspect this has something to do with