[ 
https://issues.apache.org/jira/browse/SPARK-14960?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15260476#comment-15260476
 ] 

Apache Spark commented on SPARK-14960:
--------------------------------------

User 'JoshRosen' has created a pull request for this issue:
https://github.com/apache/spark/pull/12737

> Don't perform treeAggregation in local mode
> -------------------------------------------
>
>                 Key: SPARK-14960
>                 URL: https://issues.apache.org/jira/browse/SPARK-14960
>             Project: Spark
>          Issue Type: Improvement
>          Components: Spark Core
>            Reporter: Josh Rosen
>
> I don't think that {{treeAggregation}} will help performance in {{local}} 
> mode and based on measurement of some unit tests it looks like it actually 
> severely harms performance in certain cases. Therefore, treeAggregate should 
> fall back to plain aggregate when running in local mode.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]

Reply via email to