[
https://issues.apache.org/jira/browse/SPARK-5982?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean Owen updated SPARK-5982:
-----------------------------
Component/s: Spark Core
> Remove Local Read Time
> ----------------------
>
> Key: SPARK-5982
> URL: https://issues.apache.org/jira/browse/SPARK-5982
> Project: Spark
> Issue Type: Bug
> Components: Spark Core
> Reporter: Kay Ousterhout
> Assignee: Kay Ousterhout
> Priority: Blocker
>
> LocalReadTime was added to TaskMetrics for the 1.3.0 release. However, this
> time is actually only a small subset of the local read time, because local
> shuffle files are memory mapped, so most of the read time occurs later, as
> data is read from the memory mapped files and the data actually gets read
> from disk. We should remove this before the 1.3.0 release, so we never
> expose this incomplete info.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
