Mohamadreza Rostami created SPARK-37060:
-------------------------------------------
Summary: Report driver status does not handle response from backup
masters
Key: SPARK-37060
URL: https://issues.apache.org/jira/browse/SPARK-37060
Project: Spark
Issue Type: Bug
Components: Spark Core
Affects Versions: 3.2.0, 3.1.2, 3.1.1, 3.1.0
Reporter: Mohamadreza Rostami
After a improvement in SPARK-31486, contributor uses
'asyncSendToMasterAndForwardReply' method instead of
'activeMasterEndpoint.askSync' to get the status of driver. Since the driver's
status is only available inactive master and the
'asyncSendToMasterAndForwardReply' method iterate over all of the masters, we
have to handle the response from the backup masters in the client, which the
developer did not consider in the SPARK-31486 change. So drivers running in
cluster mode and on a cluster with multi-master affected by this bug.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
