[
https://issues.apache.org/jira/browse/SPARK-22744?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Lantao Jin updated SPARK-22744:
-------------------------------
Description:
In MapReduce, we can get the submit hostname via checking the value of
configuration {{mapreduce.job.submithostname}}. It can help infra team or other
people to do support work and debug. Bu in Spark, the information is not
included.
Then, I suggest to introduce a new configuration parameter,
{{spark.submit.hostname}}, which will be set automatically by default, but it
also allows to set this to an user defined hostname if needed (e.g, using an
user node instead of Livy server node).
was:
In MapReduce, we can get the submit hostname via checking the value of
configuration {{mapreduce.job.submithostname}}. It can help infra team or other
people to do support work and debug. Bu in Spark, the information is not
included.
Then, I suggest to introduce two new configuration parameters,
{{spark.submit.hostname}} and {{spark.submit.hostAddress}}, which will be set
automatically by default, but it also allows to set this to an user defined
hostname if needed (e.g, using an user node instead of Livy server node).
> Add a configuration to show the application submit hostname
> -----------------------------------------------------------
>
> Key: SPARK-22744
> URL: https://issues.apache.org/jira/browse/SPARK-22744
> Project: Spark
> Issue Type: Improvement
> Components: Spark Core
> Affects Versions: 2.2.1
> Reporter: Lantao Jin
>
> In MapReduce, we can get the submit hostname via checking the value of
> configuration {{mapreduce.job.submithostname}}. It can help infra team or
> other people to do support work and debug. Bu in Spark, the information is
> not included.
> Then, I suggest to introduce a new configuration parameter,
> {{spark.submit.hostname}}, which will be set automatically by default, but it
> also allows to set this to an user defined hostname if needed (e.g, using an
> user node instead of Livy server node).
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
