[
https://issues.apache.org/jira/browse/SPARK-11425?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14983105#comment-14983105
]
Apache Spark commented on SPARK-11425:
--------------------------------------
User 'davies' has created a pull request for this issue:
https://github.com/apache/spark/pull/9383
> Improve hybrid aggregation (sort-based after hash-based)
> --------------------------------------------------------
>
> Key: SPARK-11425
> URL: https://issues.apache.org/jira/browse/SPARK-11425
> Project: Spark
> Issue Type: Improvement
> Reporter: Davies Liu
>
> After aggregation, the dataset could be smaller than inputs, so it's better
> to do hash based aggregation for all inputs, then using sort based
> aggregation to merge them.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
