Thanks Sandy, passing --name works fine :)
Tomer
On Fri, Dec 12, 2014 at 9:35 AM, Sandy Ryza <sandy.r...@cloudera.com> wrote:
>
> Hi Tomer,
>
> In yarn-cluster mode, the application has already been submitted to YARN
> by the time the SparkContext is created, so it's too late to set the app
> name there. I believe giving it with the --name property to spark-submit
> should work.
>
> -Sandy
>
> On Thu, Dec 11, 2014 at 10:28 AM, Tomer Benyamini <tomer....@gmail.com>
> wrote:
>>
>>
>>
>> On Thu, Dec 11, 2014 at 8:27 PM, Tomer Benyamini <tomer....@gmail.com>
>> wrote:
>>
>>> Hi,
>>>
>>> I'm trying to set a custom spark app name when running a java spark app
>>> in yarn-cluster mode.
>>>
>>> SparkConf sparkConf = new SparkConf();
>>>
>>> sparkConf.setMaster(System.getProperty("spark.master"));
>>>
>>> sparkConf.setAppName("myCustomName");
>>>
>>> sparkConf.set("spark.logConf", "true");
>>>
>>> JavaSparkContext sc = new JavaSparkContext(sparkConf);
>>>
>>>
>>> Apparently this only works when running in yarn-client mode; in
>>> yarn-cluster mode the app name is the class name, when viewing the app in
>>> the cluster manager UI. Any idea?
>>>
>>>
>>> Thanks,
>>>
>>> Tomer
>>>
>>>
>>>
>>
