GitHub user marmbrus opened a pull request:
https://github.com/apache/spark/pull/3263
[SQL] Don't shuffle code generated rows
When sort based shuffle and code gen are on we were trying to ship the code
generated rows during a shuffle. This doesn't work because the classes don't
exist on the other side. Instead we now copy into a generic row before
shipping.
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/marmbrus/spark aggCodeGen
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/spark/pull/3263.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #3263
----
commit f6ba8cf023c9fafb2fefb20b78cddc3a016059eb
Author: Michael Armbrust <[email protected]>
Date: 2014-11-14T07:41:14Z
fix and test
----
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
