GitHub user andrewor14 opened a pull request:
https://github.com/apache/spark/pull/10811
[SPARK-10620] [MINOR] Rename 3 fields in ShuffleWriteMetrics
This is a small step in implementing SPARK-10620, which migrates
TaskMetrics to accumulators. This patch is strictly a cleanup patch and
introduces no change in functionality. It literally just renames 3 fields for
consistency. Today we have:
```
inputMetrics.recordsRead
outputMetrics.bytesWritten
shuffleReadMetrics.localBlocksFetched
...
shuffleWriteMetrics.shuffleRecordsWritten
shuffleWriteMetrics.shuffleBytesWritten
shuffleWriteMetrics.shuffleWriteTime
```
The shuffle write ones are kind of redundant. We can drop the `shuffle`
part in the method names.
Parent PR: #10717
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/andrewor14/spark rename-things
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/spark/pull/10811.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #10811
----
commit c9478ac5d1771ebc9ddaeb0ec0b696e5dbae2259
Author: Andrew Or <[email protected]>
Date: 2016-01-18T18:39:13Z
Rename things
commit f3723c4ea2a577553f1f5864cdb36e61e82d4d74
Author: Andrew Or <[email protected]>
Date: 2016-01-18T18:40:56Z
Add deprecation annotations
commit 0a2d9a14dbce0e78e850f12fea8781e4ba35df08
Author: Andrew Or <[email protected]>
Date: 2016-01-18T18:45:16Z
Add TODO in JsonProtocol
----
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
