Carson Wang created SPARK-22681:
-----------------------------------
Summary: Accumulator should only be updated once for each task in
result stage
Key: SPARK-22681
URL: https://issues.apache.org/jira/browse/SPARK-22681
Project: Spark
Issue Type: Bug
Components: Spark Core
Affects Versions: 2.2.0
Reporter: Carson Wang
As the doc says "For accumulator updates performed inside actions only, Spark
guarantees that each task’s update to the accumulator will only be applied
once, i.e. restarted tasks will not update the value."
But currently the code doesn't guarantee this.
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
