[
https://issues.apache.org/jira/browse/SPARK-5982?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14335576#comment-14335576
]
Apache Spark commented on SPARK-5982:
-------------------------------------
User 'kayousterhout' has created a pull request for this issue:
https://github.com/apache/spark/pull/4749
> Remove Local Read Time
> ----------------------
>
> Key: SPARK-5982
> URL: https://issues.apache.org/jira/browse/SPARK-5982
> Project: Spark
> Issue Type: Bug
> Reporter: Kay Ousterhout
> Assignee: Kay Ousterhout
> Priority: Blocker
>
> LocalReadTime was added to TaskMetrics for the 1.3.0 release. However, this
> time is actually only a small subset of the local read time, because local
> shuffle files are memory mapped, so most of the read time occurs later, as
> data is read from the memory mapped files and the data actually gets read
> from disk. We should remove this before the 1.3.0 release, so we never
> expose this incomplete info.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
