Github user JoshRosen commented on the pull request:
https://github.com/apache/spark/pull/6397#issuecomment-106605483
I added a bunch more tests to DiskBlockObjectWriter to ensure that all of
the close methods are idempotent. I've also moved the metrics test from
InputOutputMetricsSuite into ShuffleSuite so that they're run against all
shuffle managers and have added a test to check that the metrics are correct
when shuffles perform aggregation. I also added some additional checks to
ensure that shuffleBytesRead == shuffleBytesWritten. /cc @ksakellis, since
this touches some of your code in InputOutputMetricsSuite.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
