GitHub user rxin opened a pull request: https://github.com/apache/spark/pull/1152
[SPARK-1412][SQL] Disable partial aggregation automatically when reduction factor is low - WIP This is just a prototype. Kinda ugly, doesn't properly connect with the config system yet, and have no test. You can merge this pull request into a Git repository by running: $ git pull https://github.com/rxin/spark partialAggDisable Alternatively you can review and apply these changes as the patch at: https://github.com/apache/spark/pull/1152.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #1152 ---- commit 6360e117de927b77a61b5e4f03ac52eb400c1825 Author: Reynold Xin <r...@apache.org> Date: 2014-06-20T08:05:22Z Prototype for disable partial aggregation when we don't see reduction. ---- --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---