Verified that com.typesafe.config.ConfigFactory is present in the Spark assembly jar so now I'm even more confused.
On Mon, Jan 6, 2014 at 8:51 PM, Sandy Ryza <[email protected]> wrote: > Hi, > > I hit this when trying to an example job with Spark master against YARN: > > Exception in thread "main" java.lang.NoSuchMethodError: > com.typesafe.config.ConfigFactory.invalidateCaches()V > at org.apache.spark.SparkConf.<init>(SparkConf.scala:35) > at org.apache.spark.SparkConf.<init>(SparkConf.scala:30) > at org.apache.spark.deploy.yarn.Client$.main(Client.scala:487) > at org.apache.spark.deploy.yarn.Client.main(Client.scala) > > I pretty much followed the 0.8.1 doc: > $MY_SPARK_HOME/bin/spark-class org.apache.spark.deploy.yarn.Client --jar > $MY_SPARK_HOME/examples/target/scala-2.10/spark-examples-assembly-0.9.0-incubating.jar > --class > org.apache.spark.examples.SparkPi --args yarn-standalone --num-workers > 1 --master-memory 1g --worker-memory 1g --worker-cores 1 > > Any idea what's going on? Will keep digging, but thought somebody might > recognize it. > > thanks for any guidance, > Sandy >
