Re: Submitting Spark Applications using Spark Submit

2015-06-22 Thread Andrew Or
ich is prepared through "mvn package". You > just have to make sure that you re-package the assembly jar after each > modification. > > -Andrew > > 2015-06-18 16:35 GMT-07:00 maxdml : > You can specify the jars of your application to be included with > spark-submit >

Re: Submitting Spark Applications using Spark Submit

2015-06-20 Thread Raghav Shankar
t; > 2015-06-18 16:35 GMT-07:00 maxdml : > You can specify the jars of your application to be included with spark-submit > with the /--jars/ switch. > > Otherwise, are you sure that your newly compiled spark jar assembly is in > assembly/target/scala-2.10/? > > > &

Re: Submitting Spark Applications using Spark Submit

2015-06-19 Thread Andrew Or
bly jar after each modification. >> >> -Andrew >> >> 2015-06-18 16:35 GMT-07:00 maxdml : >> >>> You can specify the jars of your application to be included with >>> spark-submit >>> with the /--jars/ switch. >>> >>> Otherwise,

Re: Submitting Spark Applications using Spark Submit

2015-06-19 Thread Raghav Shankar
ecify the jars of your application to be included with >> spark-submit >> with the /--jars/ switch. >> >> Otherwise, are you sure that your newly compiled spark jar assembly is in >> assembly/target/scala-2.10/? >> >> >> >> -- >> View this

Re: Submitting Spark Applications using Spark Submit

2015-06-19 Thread Andrew Or
that your newly compiled spark jar assembly is in > assembly/target/scala-2.10/? > > > > -- > View this message in context: > http://apache-spark-user-list.1001560.n3.nabble.com/Submitting-Spark-Applications-using-Spark-Submit-tp23352p23400.html > Sent from the Apache S

Re: Submitting Spark Applications using Spark Submit

2015-06-18 Thread maxdml
/Submitting-Spark-Applications-using-Spark-Submit-tp23352p23400.html Sent from the Apache Spark User List mailing list archive at Nabble.com. - To unsubscribe, e-mail: user-unsubscr...@spark.apache.org For additional commands, e-mail

Re: Submitting Spark Applications using Spark Submit

2015-06-18 Thread lovelylavs
.n3.nabble.com/Submitting-Spark-Applications-using-Spark-Submit-tp23352p23395.html Sent from the Apache Spark User List mailing list archive at Nabble.com. - To unsubscribe, e-mail: user-unsubscr...@spark.apache.org For additional

Re: Submitting Spark Applications using Spark Submit

2015-06-16 Thread Raghav Shankar
iveMethodAccessorImpl.java:39) >> at >> >> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) >> at java.lang.reflect.Method.invoke(Method.java:597) >> at >> >> org.apache.spark.deploy.SparkSubmit$.org$apache$spark$deploy$SparkSubmit$$run

Re: Submitting Spark Applications using Spark Submit

2015-06-16 Thread Yanbo Liang
.main(SparkSubmit.scala:110) > at org.apache.spark.deploy.SparkSubmit.main(SparkSubmit.scala) > > When I use spark submit, where does the jar come from? How do I make sure > it > uses the jars that have built? > > > > > -- > View this message in context: > http://

Re: Submitting Spark Applications using Spark Submit

2015-06-16 Thread Raghav Shankar
la:189) >> at org.apache.spark.deploy.SparkSubmit$.main(SparkSubmit.scala:110) >> at org.apache.spark.deploy.SparkSubmit.main(SparkSubmit.scala) >> >> When I use spark submit, where does the jar come from? How do I make sure it >> uses the jars that have bu

Re: Submitting Spark Applications using Spark Submit

2015-06-16 Thread Will Briggs
.apache.spark.deploy.SparkSubmit.main(SparkSubmit.scala) > > When I use spark submit, where does the jar come from? How do I make sure it > uses the jars that have built? > > > > > -- > View this message in co

Re: Submitting Spark Applications using Spark Submit

2015-06-16 Thread Raghav Shankar
k.deploy.SparkSubmit$.main(SparkSubmit.scala:110) > at org.apache.spark.deploy.SparkSubmit.main(SparkSubmit.scala) > > When I use spark submit, where does the jar come from? How do I make sure it > uses the jars that have built? > > > > > -- > View this mes

Re: Submitting Spark Applications using Spark Submit

2015-06-16 Thread Will Briggs
-user-list.1001560.n3.nabble.com/Submitting-Spark-Applications-using-Spark-Submit-tp23352.html Sent from the Apache Spark User List mailing list archive at Nabble.com. - To unsubscribe, e-mail: user-unsubscr...@spark.apache.org For

Submitting Spark Applications using Spark Submit

2015-06-16 Thread raggy
message in context: http://apache-spark-user-list.1001560.n3.nabble.com/Submitting-Spark-Applications-using-Spark-Submit-tp23352.html Sent from the Apache Spark User List mailing list archive at Nabble.com. - To unsubscribe, e-