Merge pull request #42 from pwendell/shuffle-read-perf Fix inconsistent and incorrect log messages in shuffle read path
The user-facing messages generated by the CacheManager are currently wrong and somewhat misleading. This patch makes the messages more accurate. It also uses a consistent representation of the partition being fetched (`rdd_xx_yy`) so that it's easier for users to trace what is going on when reading logs. Project: http://git-wip-us.apache.org/repos/asf/incubator-spark/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-spark/commit/ea34c521 Tree: http://git-wip-us.apache.org/repos/asf/incubator-spark/tree/ea34c521 Diff: http://git-wip-us.apache.org/repos/asf/incubator-spark/diff/ea34c521 Branch: refs/heads/master Commit: ea34c521025d3408d44d45ab5c132fd9791794f6 Parents: 02f37ee 8b37771 Author: Reynold Xin <r...@apache.org> Authored: Mon Oct 7 20:45:58 2013 -0700 Committer: Reynold Xin <r...@apache.org> Committed: Mon Oct 7 20:45:58 2013 -0700 ---------------------------------------------------------------------- .../main/scala/org/apache/spark/CacheManager.scala | 17 ++++++++--------- .../org/apache/spark/storage/BlockManager.scala | 12 +++++++++++- 2 files changed, 19 insertions(+), 10 deletions(-) ----------------------------------------------------------------------
