Github user mateiz commented on the pull request:
https://github.com/apache/spark/pull/1499#issuecomment-49973755
Added one more commit that fixes the type of ShuffledRDD, because in this
new shuffle it's not possible to return a custom Product2 the way it's written
now, and in the old one it wasn't possible anyway with aggregation. See
https://github.com/mateiz/spark/commit/9c299579f13f004f5fd1f4dd0b98b7d76cac2a55
for details. @rxin you should look at this one.
With this commit there's now a version of ShuffleSuite that passes using
SortBasedShuffle.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
