GitHub user dilipbiswal opened a pull request:
https://github.com/apache/spark/pull/22047
[SPARK-19851] Add support for EVERY and ANY (SOME) aggregates
## What changes were proposed in this pull request?
This PR is a rebased version of original work
[link](https://github.com/apache/spark/pull/17648) by
@ptkool.
Please give credit to @ptkool for this work.
Description from original PR:
This pull request implements the EVERY and ANY aggregates.
## How was this patch tested?
Testing was performed using unit tests, integration tests, and manual tests.
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/dilipbiswal/spark SPARK-19851
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/spark/pull/22047.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #22047
----
commit 8cf4a3963961083e1feffd45c649ed31785a54ac
Author: ptkool <michael.styles@...>
Date: 2017-03-07T19:09:32Z
Add new aggregates EVERY and ANY (SOME).
commit f30b4cde8e398f2d1b8c6cb9842b7a87640f09ee
Author: ptkool <michael.styles@...>
Date: 2017-03-07T22:59:48Z
Fix Scala style check errors.
commit 5adeb17eac47aef3d17ea7cbb015cba313a6f4e5
Author: ptkool <michael.styles@...>
Date: 2017-03-13T13:37:02Z
Resolved issue with Any aggregate and added window function test.
commit c192de003a2011440886fcc34562ba1818ba3c3b
Author: ptkool <michael.styles@...>
Date: 2017-03-13T17:49:21Z
Added additional pyspark.sql tests.
commit 14bf7a10a0cf1b27e94a7a8087c0a536252cc95f
Author: ptkool <michael.styles@...>
Date: 2017-03-14T01:34:40Z
Fix pyspark window function tests.
commit 525392ce0b673416832f3cbea20cc1a4e6885ae2
Author: ptkool <michael.styles@...>
Date: 2017-03-15T13:21:47Z
Resolve several issues with Pyspark tests.
commit ee78f22d236047820c16077f0130ea75bc705aba
Author: ptkool <michael.styles@...>
Date: 2017-03-15T13:27:53Z
Resolve Scala style issues.
commit 9503d9e408d1347fc29aaa2e147b7ef17b269c0c
Author: ptkool <michael.styles@...>
Date: 2017-03-15T13:42:11Z
Fix Python style errors.
----
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
