Github user jiangxb1987 commented on the issue:
https://github.com/apache/spark/pull/21698
> What happened to the other pr proposal of just using the hashPartitioner?
It's not able to handle the use case when we use `repartition()` to shuffle
skewed data, so we give up on that way.--- --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
