Hi Zhan, No, I did not follow that link, I use the pre-built version of 1.2.0 from the Spark official website, do you mean that there is a hortonworks distribution of Spark, where can I download it, and which option should I set ?
Thanks. ------------------ Original ------------------ From: "Zhan Zhang";<[email protected]>; Date: Feb 13, 2015 To: ""<[email protected]>; Cc: "user"<[email protected]>; Subject: Re: Can't execute the SparkPi example in yarn-cluster mode If you follow the link in http://hortonworks.com/hadoop-tutorial/using-apache-spark-hdp/, there is a spark.driver.extraJavaOptions needs to be set in spark-defautls, which only support in spark-1.3. In Hortonworks dist, the feature is back ported to spark-1.2. This is more about hortonworks specific issue, we can move the discussion to horntonworks forum. Thanks. Zhan Zhang On Feb 12, 2015, at 6:21 AM, guxiaobo1982 <[email protected]> wrote: rk 1.2.0 pre
