[
https://issues.apache.org/jira/browse/SPARK-5701?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14313310#comment-14313310
]
Apache Spark commented on SPARK-5701:
-------------------------------------
User 'kayousterhout' has created a pull request for this issue:
https://github.com/apache/spark/pull/4488
> Only set ShuffleReadMetrics when task does a shuffle
> ----------------------------------------------------
>
> Key: SPARK-5701
> URL: https://issues.apache.org/jira/browse/SPARK-5701
> Project: Spark
> Issue Type: Bug
> Components: Spark Core
> Affects Versions: 1.3.0, 1.2.1
> Reporter: Kay Ousterhout
> Assignee: Kay Ousterhout
> Priority: Minor
>
> The updateShuffleReadMetrics method in TaskMetrics (called by the executor
> heartbeater) will currently always add a ShuffleReadMetrics to TaskMetrics
> (with values set to 0), even when the task didn't read any shuffle data.
> ShuffleReadMetrics should only be added if the task reads shuffle data.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
