GitHub user devaraj-kavali opened a pull request:
https://github.com/apache/spark/pull/21088
[SPARK-24003][CORE] Add support to provide spark.executor.extraJavaOptions
in terms of App Id and/or Executor Id's
## What changes were proposed in this pull request?
Added support to specify the 'spark.executor.extraJavaOptions' value in
terms of the `{{APP_ID}}` and/or `{{EXECUTOR_ID}}`, `{{APP_ID}}` will be
replaced by Application Id and `{{EXECUTOR_ID}}` will be replaced by Executor
Id while starting the executor.
## How was this patch tested?
I have verified this by checking the executor process command and gc logs.
I verified the same in different deployment modes(Standalone, YARN, Mesos)
client and cluster modes.
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/devaraj-kavali/spark SPARK-24003
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/spark/pull/21088.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #21088
----
commit ff6e79315c0ea26b45207753d3e79f96f2395329
Author: Devaraj K <devaraj@...>
Date: 2018-04-17T18:37:11Z
[SPARK-24003][CORE] Add support to provide spark.executor.extraJavaOptions
in terms of App Id and/or Executor Id's
----
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
