GitHub user marmbrus opened a pull request:
https://github.com/apache/spark/pull/993
[WIP][SPARK-2054][SQL] Code Generation for Expression Evaluation
This PR drops the aggregation code generation, which will be added back in
a follow-up PR. The following remains to be done:
- [ ] Remove remaining spurious changes.
- [ ] Make configurable with #956
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/marmbrus/spark newCodeGen
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/spark/pull/993.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #993
----
commit 1972e2d5ecf919824cb47ee6b6295242c785e064
Author: Michael Armbrust <[email protected]>
Date: 2014-05-11T18:30:56Z
Split out generic logic for hash joins and create two concrete physical
operators: BroadcastHashJoin and ShuffledHashJoin.
commit f27119cf9dc46d18ea869e0e49a69f16dd0b7886
Author: Michael Armbrust <[email protected]>
Date: 2014-05-11T18:31:20Z
A simple strategy that broadcasts tables only when they are found in a
configuration hint.
commit f7c750b7cf6473188a8f06d97e6532d8041660ed
Author: Michael Armbrust <[email protected]>
Date: 2014-05-12T22:09:39Z
Formatting.
commit 2904d29e5a0d9197f301bac82c40682619f6b508
Author: Michael Armbrust <[email protected]>
Date: 2014-05-29T22:34:24Z
WIP: Code generation and more
commit fa6939c552623fa05f14cc06ce80b20fa7b7d549
Author: Michael Armbrust <[email protected]>
Date: 2014-05-29T22:46:30Z
Widen datatypes
commit 8b1b4a955895f2046384be5f5ca254b7e2971ab2
Author: Michael Armbrust <[email protected]>
Date: 2014-05-29T23:52:53Z
Simple draft of IN generation.
commit c742978b817762a802c8c18a72e13bb723b518c0
Author: Michael Armbrust <[email protected]>
Date: 2014-05-30T01:01:29Z
Make IN case insensitive.
commit 0557d4c8799a8b5384c1410544912f9359b01977
Author: Michael Armbrust <[email protected]>
Date: 2014-05-30T01:14:14Z
Add byte code dumper.
commit c6f4835c67f07d199e2e79defbe716cc2f47293b
Author: Michael Armbrust <[email protected]>
Date: 2014-05-30T01:22:59Z
Unique names for isIn functions.
commit 764673b7ab2d4de48bf3880256940f66ad06f662
Author: Michael Armbrust <[email protected]>
Date: 2014-05-30T02:27:50Z
Global lock on code generation, cache orderings.
commit 6ebe45f7142f600f72aac73a4cac32f56ab684d4
Author: Zongheng Yang <[email protected]>
Date: 2014-06-01T20:31:20Z
WIP: Case code gen hack.
commit 760ce3cdc16db449068e1f9cf3e15384e3cf305f
Author: Zongheng Yang <[email protected]>
Date: 2014-06-01T21:30:12Z
Fix parsing CASE?
commit b54d3bc7a9fcd8d8134b2c4eb1765482872d9c9e
Author: Michael Armbrust <[email protected]>
Date: 2014-06-01T22:51:32Z
Hacky draft of case statements with code gen.
commit 7c5405f45b7b546d6e3b3f4f5667ce515910e50c
Author: Michael Armbrust <[email protected]>
Date: 2014-06-02T02:36:53Z
Correctly type nulls in the case when.
commit 5d0db90ae86e7fb38de67a93960c074810993a77
Author: Michael Armbrust <[email protected]>
Date: 2014-06-06T05:12:03Z
Quiet logging.
commit 82cbd15483775a62fddd446a333401ff7640e8e2
Author: Michael Armbrust <[email protected]>
Date: 2014-06-06T05:12:42Z
Turn off HashAggregation
commit 1209daaf49b0a87e7f68f89c79d02b446e624db3
Author: Michael Armbrust <[email protected]>
Date: 2014-06-06T05:16:37Z
Drop broken CASE WHEN.
commit 9c8872b57c5b120ae841c4525f032f7d5cb5712c
Author: Michael Armbrust <[email protected]>
Date: 2014-06-06T05:37:37Z
Drop anon SchemaRDD.
commit 0748abd9adc171257548df142bf63ab73159e5ac
Author: Michael Armbrust <[email protected]>
Date: 2014-06-06T05:55:32Z
Fix style. Drop test code.
----
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
