GitHub user kayousterhout opened a pull request:
https://github.com/apache/spark/pull/4749
[SPARK-5982] Remove incorrect Local Read Time Metric
This metric is incomplete, because the files are memory mapped, so much of
the read from disk occurs later as tasks actually read the file's data.
This should be merged into 1.3, so that we never expose this incorrect
metric to users.
CC @pwendell @ksakellis @sryza
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/kayousterhout/spark-1 SPARK-5982
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/spark/pull/4749.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #4749
----
commit cf13497ddef48c7919a1f1b4841beca0274f6859
Author: Kay Ousterhout <[email protected]>
Date: 2015-02-24T22:15:55Z
[SPARK-5982] Remove incorrectwq Local Read Time Metric
commit a1eb3009c6af7e58a281a02fb2a2b148715e6839
Author: Kay Ousterhout <[email protected]>
Date: 2015-02-24T22:19:15Z
Removed one more use of local read time
commit 9737b5e1caf7807aba222e9c3b9e21e2363fe5cf
Author: Kay Ousterhout <[email protected]>
Date: 2015-02-24T22:25:03Z
More fixes
----
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
