[
https://issues.apache.org/jira/browse/SPARK-22839?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Matt Cheah resolved SPARK-22839.
--------------------------------
Resolution: Fixed
Fix Version/s: 2.4.0
Done in https://github.com/apache/spark/pull/20669
> Refactor Kubernetes code for configuring driver/executor pods to use
> consistent and cleaner abstraction
> -------------------------------------------------------------------------------------------------------
>
> Key: SPARK-22839
> URL: https://issues.apache.org/jira/browse/SPARK-22839
> Project: Spark
> Issue Type: Improvement
> Components: Kubernetes
> Affects Versions: 2.3.0
> Reporter: Yinan Li
> Priority: Major
> Fix For: 2.4.0
>
>
> As discussed in https://github.com/apache/spark/pull/19954, the current code
> for configuring the driver pod vs the code for configuring the executor pods
> are not using the same abstraction. Besides that, the current code leaves a
> lot to be desired in terms of the level and cleaness of abstraction. For
> example, the current code is passing around many pieces of information around
> different class hierarchies, which makes code review and maintenance
> challenging. We need some thorough refactoring of the current code to achieve
> better, cleaner, and consistent abstraction.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
