[
https://issues.apache.org/jira/browse/SPARK-14619?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Andrew Or resolved SPARK-14619.
-------------------------------
Resolution: Fixed
> Track internal accumulators (metrics) by stage attempt rather than stage
> ------------------------------------------------------------------------
>
> Key: SPARK-14619
> URL: https://issues.apache.org/jira/browse/SPARK-14619
> Project: Spark
> Issue Type: Sub-task
> Components: Spark Core
> Reporter: Reynold Xin
> Assignee: Reynold Xin
> Fix For: 2.0.0
>
>
> When there are multiple attempts for a stage, we currently only reset
> internal accumulator values if all the tasks are resubmitted. It would make
> more sense to reset the accumulator values for each stage attempt. This will
> allow us to eventually get rid of the internal flag in the Accumulator class.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
