Github user pwendell commented on the pull request:
https://github.com/apache/spark/pull/2087#issuecomment-60528666
Hey @sryza this looks good - I tested it locally and it worked. I stumbled
a bit with the test because I was using coalesce() and these metrics don't work
well with coalesced RDD's right now (which I forgot).
I just have one small question about slightly simplifying access to the
metrics variable. Let me know what you think... if it's possible to clean it
quickly it would be nice to do it and then merge this. If that can't be
simplified for some reason then let me know and we can just merge this.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
