GitHub user rxin opened a pull request:
https://github.com/apache/spark/pull/11841
[SPARK-13897][SQL] RelationalGroupedDataset and KeyValueGroupedDataset
## What changes were proposed in this pull request?
Previously, Dataset.groupBy returns a GroupedData, and Dataset.groupByKey
returns a GroupedDataset. The naming is very similar, and unfortunately does
not convey the real differences between the two.
Assume we are grouping by some keys (K). groupByKey is a key-value style
group by, in which the schema of the returned dataset is a tuple of just two
fields: key and value. groupBy, on the other hand, is a relational style group
by, in which the schema of the returned dataset is flattened and contain |K| +
|V| fields.
## How was this patch tested?
This is a rename to improve API understandability. Should be covered by all
existing tests.
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/rxin/spark SPARK-13897
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/spark/pull/11841.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #11841
----
commit 24eaf42ff06eeaf697b815ddf40fc0861c9813e0
Author: Reynold Xin <[email protected]>
Date: 2016-03-19T06:25:32Z
[SPARK-13897][SQL] RelationalGroupedDataset and KeyValueGroupedDataset
----
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
