[
https://issues.apache.org/jira/browse/SPARK-18278?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16648208#comment-16648208
]
Matt Cheah commented on SPARK-18278:
------------------------------------
[~liushaohui] a significantly large prerequisite for dynamic allocation is
changing the way shuffle resiliency works; see
https://issues.apache.org/jira/browse/SPARK-25299.
> SPIP: Support native submission of spark jobs to a kubernetes cluster
> ---------------------------------------------------------------------
>
> Key: SPARK-18278
> URL: https://issues.apache.org/jira/browse/SPARK-18278
> Project: Spark
> Issue Type: Umbrella
> Components: Build, Deploy, Documentation, Kubernetes, Scheduler,
> Spark Core
> Affects Versions: 2.3.0
> Reporter: Erik Erlandson
> Assignee: Anirudh Ramanathan
> Priority: Major
> Labels: SPIP
> Attachments: SPARK-18278 Spark on Kubernetes Design Proposal Revision
> 2 (1).pdf
>
>
> A new Apache Spark sub-project that enables native support for submitting
> Spark applications to a kubernetes cluster. The submitted application runs
> in a driver executing on a kubernetes pod, and executors lifecycles are also
> managed as pods.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
