[
https://issues.apache.org/jira/browse/SPARK-26790?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-26790:
------------------------------------
Assignee: Apache Spark
> Yarn executor to self-retrieve log urls and attributes
> ------------------------------------------------------
>
> Key: SPARK-26790
> URL: https://issues.apache.org/jira/browse/SPARK-26790
> Project: Spark
> Issue Type: Improvement
> Components: YARN
> Affects Versions: 3.0.0
> Reporter: Jungtaek Lim
> Assignee: Apache Spark
> Priority: Major
>
> SPARK-23155 enables retrieving executor attributes from YARN container via
> `Container` YARN API which just works but we're still concerning about below:
> - some informations are not provided (NM PORT, etc.)
> - we provide them as container launch environment on executor which is not
> the same approach for driver log in yarn-cluster mode
> This issue tracks the effort on addressing above, via let YARN executor
> self-retrieving attributes.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]