Lin - if you add "--verbose" to your original *spark-submit* command, it will let you know the location in which Spark is running. As Marcelo pointed out, this will likely indicate version 1.3, which may help you confirm if this is your problem.
On Wed, Jan 13, 2016 at 12:06 PM, Marcelo Vanzin <van...@cloudera.com> wrote: > SparkSubmitDriverBootstrapper was removed back in Spark 1.4, so it > seems you have a mixbag of 1.3 / 1.6 in your path / classpath and > things are failing because of that. > > On Wed, Jan 13, 2016 at 9:31 AM, Lin Zhao <l...@exabeam.com> wrote: > > My job runs fine in yarn cluster mode but I have reason to use client > mode > > instead. But I'm hitting this error when submitting: > >> spark-submit --class com.exabeam.martini.scripts.SparkStreamingTest > >> --master yarn --deploy-mode client --executor-memory 90G > --num-executors 3 > >> --executor-cores 14 Martini-assembly-0.1.jar yarn-client > > > > Error: Could not find or load main class > > org.apache.spark.deploy.SparkSubmitDriverBootstrapper > > > > > > If I replace deploy-mode to cluster the job is submitted successfully. > Is > > there a dependency missing from my project? Right now only one I > included is > > spark-streaming 1.6.0. > > > > -- > Marcelo > > --------------------------------------------------------------------- > To unsubscribe, e-mail: user-unsubscr...@spark.apache.org > For additional commands, e-mail: user-h...@spark.apache.org > >
