Thanks Sandy, passing --name works fine :)
Tomer
On Fri, Dec 12, 2014 at 9:35 AM, Sandy Ryza wrote:
>
> Hi Tomer,
>
> In yarn-cluster mode, the application has already been submitted to YARN
> by the time the SparkContext is created, so it's too late to set the app
> name there. I believe givin
Hi Tomer,
In yarn-cluster mode, the application has already been submitted to YARN by
the time the SparkContext is created, so it's too late to set the app name
there. I believe giving it with the --name property to spark-submit should
work.
-Sandy
On Thu, Dec 11, 2014 at 10:28 AM, Tomer Benyam
On Thu, Dec 11, 2014 at 8:27 PM, Tomer Benyamini
wrote:
> Hi,
>
> I'm trying to set a custom spark app name when running a java spark app in
> yarn-cluster mode.
>
> SparkConf sparkConf = new SparkConf();
>
> sparkConf.setMaster(System.getProperty("spark.master"));
>
> sparkConf.setAppName("my
Hi,
I'm trying to set a custom spark app name when running a java spark app in
yarn-cluster mode.
SparkConf sparkConf = new SparkConf();
sparkConf.setMaster(System.getProperty("spark.master"));
sparkConf.setAppName("myCustomName");
sparkConf.set("spark.logConf", "true");
JavaSparkContext
