[
https://issues.apache.org/jira/browse/SPARK-29236?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wenchen Fan resolved SPARK-29236.
---------------------------------
Fix Version/s: 3.0.0
Resolution: Fixed
Issue resolved by pull request 25922
[https://github.com/apache/spark/pull/25922]
> Access 'executorDataMap' out of 'DriverEndpoint' should be protected by lock
> ----------------------------------------------------------------------------
>
> Key: SPARK-29236
> URL: https://issues.apache.org/jira/browse/SPARK-29236
> Project: Spark
> Issue Type: Bug
> Components: Spark Core
> Affects Versions: 2.4.4
> Reporter: Xianyang Liu
> Assignee: Xianyang Liu
> Priority: Major
> Fix For: 3.0.0
>
>
> Just as the comments:
> >
> // Accessing `executorDataMap` in `DriverEndpoint.receive/receiveAndReply`
> doesn't need any
> // protection. But accessing `executorDataMap` out of
> `DriverEndpoint.receive/receiveAndReply`
> // must be protected by `CoarseGrainedSchedulerBackend.this`. Besides,
> `executorDataMap` should
> // only be modified in `DriverEndpoint.receive/receiveAndReply` with
> protection by
> // `CoarseGrainedSchedulerBackend.this`.
>
> `executorDataMap` is not threadsafe, it should be protected by lock when
> accessing it out of `DriverEndpoint`
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
