GitHub user scwf opened a pull request:
https://github.com/apache/spark/pull/15240
[SPARK-17556] Executor side broadcast for broadcast joins
## What changes were proposed in this pull request?
Design doc :
https://issues.apache.org/jira/secure/attachment/12830286/executor%20broadcast.pdf
## How was this patch tested?
added unit test and manual test.
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/KirinKing/spark SPARK-17556
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/spark/pull/15240.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #15240
----
commit df723bb138f4c01b507aed7f3d0a80613b2b2f30
Author: w00228970 <[email protected]>
Date: 2016-09-26T04:10:11Z
draft
commit cf4adbe8754cf56dceb2c2ad750a24520ef49d4a
Author: w00228970 <[email protected]>
Date: 2016-09-26T04:19:19Z
ununsed changes
commit 77057366e69cb659626b4039d35c87fe91a6d668
Author: w00228970 <[email protected]>
Date: 2016-09-26T04:59:41Z
comment improvement
commit 81da4e33314015eb044c54e4ef7e834519c15f12
Author: w00228970 <[email protected]>
Date: 2016-09-26T06:06:44Z
fix tests
commit 63a5dbf5123b458a52a22e1e03aea152995e55cb
Author: w00228970 <[email protected]>
Date: 2016-09-26T06:37:55Z
fix npe
commit c284c2cfbf3c3094db8b95ecbae331f8586128a2
Author: w00228970 <[email protected]>
Date: 2016-09-26T07:33:00Z
new endpoint for broadcast
commit cc535ed775efcd228c22c3b1dbbc7e10201f3da6
Author: w00228970 <[email protected]>
Date: 2016-09-26T07:43:14Z
unused changes
commit 2caafbf8eea238791335ff4a30c1d797a400b540
Author: w00228970 <[email protected]>
Date: 2016-09-26T10:45:36Z
use broadcast in sql
commit 89336e7f0cf535484798536c27e3d98d5ff0a358
Author: w00228970 <[email protected]>
Date: 2016-09-26T11:09:43Z
key not found issue
----
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
