Github user NarineK commented on the pull request:
https://github.com/apache/spark/pull/12836#issuecomment-216706623
@davies , I see, we could support more columns and reach the same goal with
dapply.
But what if a specific key's value occurs billions of times and only 1
value occurs only once. This means that one of the partitions will be very
small and another one will be very large and the user cannot control the number
of partitions.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
