[
https://issues.apache.org/jira/browse/YUNIKORN-1555?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Brandon Grams reassigned YUNIKORN-1555:
---------------------------------------
Assignee: Brandon Grams
> Completed Spark applications are recovered/remain as New
> --------------------------------------------------------
>
> Key: YUNIKORN-1555
> URL: https://issues.apache.org/jira/browse/YUNIKORN-1555
> Project: Apache YuniKorn
> Issue Type: Bug
> Components: shim - kubernetes
> Affects Versions: 1.1.0, 1.2.0
> Reporter: Brandon Grams
> Assignee: Brandon Grams
> Priority: Major
> Attachments: CEEB85D7-D0D5-4D3D-8C0A-730CBA48B150.jpeg
>
>
> The k8s Spark plugin is
> [documented|https://github.com/apache/yunikorn-k8shim/blob/master/pkg/appmgmt/sparkoperator/spark.go#L33]
> as implementing the Recoverable interface, however it does not. This leads
> to the following recovery outcome when driver pods in a terminal state remain
> in the cluster pending garbage collection:
> !CEEB85D7-D0D5-4D3D-8C0A-730CBA48B150.jpeg|width=1063,height=157!
> Instead, we should implement the Recoverable interface so that completed
> applications have their proper state propagated in such a scenario.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
