Re: Spark / YARN classpath issues

2014-05-22 Thread Jon Bender
t; org.apache.spark.deploy.yarn.Client is deprecated in Spark 1.0. You should > use bin/spark-submit instead. You can find information about its usage on > the docs I linked to you, or simply through the --help option. > > Cheers, > Andrew > > > 2014-05-22 11:38 GMT-07:00

Spark / YARN classpath issues

2014-05-22 Thread Jon Bender
Hey all, I'm working through the basic SparkPi example on a YARN cluster, and i'm wondering why my containers don't pick up the spark assembly classes. I built the latest spark code against CDH5.0.0 Then ran the following: SPARK_JAR=./assembly/target/scala-2.10/spark-assembly-1.0.0-SNAPSHOT-hado