Josh Rosen created SPARK-14960:
----------------------------------
Summary: Don't perform treeAggregation in local mode
Key: SPARK-14960
URL: https://issues.apache.org/jira/browse/SPARK-14960
Project: Spark
Issue Type: Improvement
Components: Spark Core
Reporter: Josh Rosen
I don't think that {{treeAggregation}} will help performance in {{local}} mode
and based on measurement of some unit tests it looks like it actually severely
harms performance in certain cases. Therefore, treeAggregate should fall back
to plain aggregate when running in local mode.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
