Github user hvanhovell commented on the pull request:
https://github.com/apache/spark/pull/10228#issuecomment-163764840
@davies don't get me wrong. I think this PR is an improvement of the
current situation (it never crossed my mind to change partitioning when I was
working on that part of the code), and should be added.
I am also not to keen on changing the MultipleDistinctRewriter; given the
time it'll take and the objections you've raised. The only thing that bugs me
is, is that we currently rewrite distinct aggregates in two places.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
