[
https://issues.apache.org/jira/browse/SPARK-37060?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
wuyi reassigned SPARK-37060:
----------------------------
Assignee: Mohamadreza Rostami
> Report driver status does not handle response from backup masters
> -----------------------------------------------------------------
>
> Key: SPARK-37060
> URL: https://issues.apache.org/jira/browse/SPARK-37060
> Project: Spark
> Issue Type: Bug
> Components: Spark Core
> Affects Versions: 3.1.0, 3.1.1, 3.1.2, 3.2.0
> Reporter: Mohamadreza Rostami
> Assignee: Mohamadreza Rostami
> Priority: Critical
>
> After an improvement in SPARK-31486, contributor uses
> 'asyncSendToMasterAndForwardReply' method instead of
> 'activeMasterEndpoint.askSync' to get the status of driver. Since the
> driver's status is only available in active master and the
> 'asyncSendToMasterAndForwardReply' method iterate over all of the masters, we
> have to handle the response from the backup masters in the client, which the
> developer did not consider in the SPARK-31486 change. So drivers running in
> cluster mode and on a cluster with multi-master affected by this bug. I
> created the patch for this bug and will soon be sent the pull request.
--
This message was sent by Atlassian Jira
(v8.20.1#820001)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
