[
https://issues.apache.org/jira/browse/SPARK-19803?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15943460#comment-15943460
]
Shubham Chopra commented on SPARK-19803:
----------------------------------------
The PR enforces a refresh of the peer list cached at the executor that is
trying to proactively replicate the block. This fix ensures that the peer will
never try to replicate to a previously failed executor due to a stale
reference. In addition, in the unit test, the block managers are explicitly
stopped when they are being removed from the master.
> Flaky BlockManagerProactiveReplicationSuite tests
> -------------------------------------------------
>
> Key: SPARK-19803
> URL: https://issues.apache.org/jira/browse/SPARK-19803
> Project: Spark
> Issue Type: Bug
> Components: Spark Core, Tests
> Affects Versions: 2.2.0
> Reporter: Sital Kedia
> Assignee: Shubham Chopra
> Labels: flaky-test
> Fix For: 2.2.0
>
>
> The tests added for BlockManagerProactiveReplicationSuite has made the
> jenkins build flaky. Please refer to the build for more details -
> https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/73640/testReport/
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
