GitHub user dreamquster opened a pull request:
https://github.com/apache/spark/pull/5346
[ SQL ] SparkSPARK-6489: Optimize lateral view with explode to not read
unnecessary columns
merge with SPARK-6548.
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/dreamquster/spark master
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/spark/pull/5346.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #5346
----
commit 0e34edf73196a47fbb9e81279eda7f8a8acd3bfa
Author: dreamquster <[email protected]>
Date: 2015-03-26T11:08:47Z
SPARK-6380:Resolution of equi-join key in post-join projection
commit 661dfd1d9be77b6b82d0fed4ed097cc1ca6a38e5
Author: dreamquster <[email protected]>
Date: 2015-03-26T15:03:20Z
add unittest
commit 9d45216883b470206046da2a612679bb1b550b61
Author: dreamquster <[email protected]>
Date: 2015-03-27T09:39:37Z
SPARK-6548:Adding stddev to DataFrame functions
commit c05e80bf5941b1f7faad651a69b7b19b74ff4e9d
Author: dreamquster <[email protected]>
Date: 2015-03-27T09:49:03Z
Revert Resolution of equi-join key change
commit 40b3cdc1e8677f926e4166ad1ee9abe4d4f37cb3
Author: dreamquster <[email protected]>
Date: 2015-03-27T10:23:14Z
retore
commit 691dc0e8eabed7cc062c7a96ca3cffb02a4bb991
Author: dreamquster <[email protected]>
Date: 2015-03-27T13:17:54Z
Merge branch 'master' of https://github.com/dreamquster/spark
Conflicts:
sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/plans/logical/basicOperators.scala
sql/core/src/test/scala/org/apache/spark/sql/JoinSuite.scala
commit 91f8c5ade5b039f3d3a9336b25b9e2422abc739a
Author: dreamquster <[email protected]>
Date: 2015-03-27T14:44:03Z
conform to ScalaStyle
commit 41a5768b9eb5154b2f1af38199b3c121770a5367
Author: dreamquster <[email protected]>
Date: 2015-03-30T11:15:15Z
explode optimization: prune unnecessary columns
commit 1771888f11784ae706099e436f87792530c5883e
Author: dreamquster <[email protected]>
Date: 2015-04-02T11:04:56Z
add explode test cases
commit 7fb0bdb9f11e62de54894ce5760fdeb851684bea
Author: dreamquster <[email protected]>
Date: 2015-04-03T08:58:40Z
add explode test
----
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
