Hi,

I hit this when trying to an example job with Spark master against YARN:

Exception in thread "main" java.lang.NoSuchMethodError:
com.typesafe.config.ConfigFactory.invalidateCaches()V
at org.apache.spark.SparkConf.<init>(SparkConf.scala:35)
at org.apache.spark.SparkConf.<init>(SparkConf.scala:30)
at org.apache.spark.deploy.yarn.Client$.main(Client.scala:487)
at org.apache.spark.deploy.yarn.Client.main(Client.scala)

I pretty much followed the 0.8.1 doc:
$MY_SPARK_HOME/bin/spark-class org.apache.spark.deploy.yarn.Client --jar
$MY_SPARK_HOME/examples/target/scala-2.10/spark-examples-assembly-0.9.0-incubating.jar
--class
org.apache.spark.examples.SparkPi --args yarn-standalone --num-workers
1 --master-memory 1g --worker-memory 1g --worker-cores 1

Any idea what's going on?  Will keep digging, but thought somebody might
recognize it.

thanks for any guidance,
Sandy

Reply via email to