GitHub user chenghao-intel opened a pull request:
https://github.com/apache/spark/pull/6304
[SPARK-7320] [SQL] Add Cube / Rollup for dataframe
This is a follow up for #6257, which broke the maven test.
Add cube & rollup for DataFrame
For example:
```scala
testData.rollup($"a" + $"b", $"b").agg(sum($"a" - $"b"))
testData.cube($"a" + $"b", $"b").agg(sum($"a" - $"b"))
```
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/chenghao-intel/spark rollup
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/spark/pull/6304.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #6304
----
commit 5ffb196ec911847a9f35f20462fb5123de7ee18a
Author: Cheng Hao <[email protected]>
Date: 2015-05-19T06:30:29Z
Add Cube / Rollup for dataframe
commit 5fd62d0653d02a6861935147dd83501bce0a31b8
Author: Cheng Hao <[email protected]>
Date: 2015-05-20T00:23:37Z
hiden the CubedData & RollupedData
commit 03bc3d91eb8f38179e8bb07d52fdcd09e617b150
Author: Cheng Hao <[email protected]>
Date: 2015-05-20T00:34:52Z
Remove the CubedData & RollupedData
commit e1d88aa9a37e7743de6da31c358a49a81e0b9cef
Author: Cheng Hao <[email protected]>
Date: 2015-05-20T07:00:01Z
update the code as suggested
commit 9959dfa2656e7e737e9fbd2f90b562ba0c296ca3
Author: Cheng Hao <[email protected]>
Date: 2015-05-20T07:16:17Z
update the code as comments
commit ced4b8f14ae66c900785b8ad10024e31bc79acdd
Author: Cheng Hao <[email protected]>
Date: 2015-05-20T07:32:09Z
remove the unnecessary code changes
commit a6069f15f10cd47fc4b2bf39306685e44d2fe373
Author: Cheng Hao <[email protected]>
Date: 2015-05-20T07:52:25Z
cancel the implicit keyword
commit 04bb1de9ec01bd4e4b91f762f61821d9a6b44bf1
Author: Cheng Hao <[email protected]>
Date: 2015-05-21T00:30:37Z
move the table register/unregister into beforeAll/afterAll
----
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
