Kay Ousterhout created SPARK-5982:
-------------------------------------
Summary: Remove Local Read Time
Key: SPARK-5982
URL: https://issues.apache.org/jira/browse/SPARK-5982
Project: Spark
Issue Type: Bug
Reporter: Kay Ousterhout
Assignee: Kay Ousterhout
Priority: Blocker
LocalReadTime was added to TaskMetrics for the 1.3.0 release. However, this
time is actually only a small subset of the local read time, because local
shuffle files are memory mapped, so most of the read time occurs later, as data
is read from the memory mapped files and the data actually gets read from disk.
We should remove this before the 1.3.0 release, so we never expose this
incomplete info.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
