>>> The "--master" should override any other ways of setting the Spark
master.
Ah yes, actually you can set "spark.master" directly in your application
through SparkConf. Thanks Marcelo.
2014-08-19 14:47 GMT-07:00 Marcelo Vanzin :
> On Tue, Aug 19, 2014 at 2:34 PM, Arun Ahuja wrote:
> > /opt/c
Yes, the application is overwriting it - I need to pass it as argument to
the application otherwise it will be set as local.
Thanks for the quick reply! Also, yes now the appTrackingUrl is set
properly as well, before it just said unassigned.
Thanks!
Arun
On Tue, Aug 19, 2014 at 5:47 PM, Marce
On Tue, Aug 19, 2014 at 2:34 PM, Arun Ahuja wrote:
> /opt/cloudera/parcels/CDH/bin/spark-submit \
> --master yarn \
> --deploy-mode client \
This should be enough.
> But when I view the job 4040 page, SparkUI, there is a single executor (just
> the driver node) and I see the following in
