[
https://issues.apache.org/jira/browse/SPARK-13307?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15235635#comment-15235635
]
JESSE CHEN commented on SPARK-13307:
Performance back on track on Spark 2.0. Closing
[
https://issues.apache.org/jira/browse/SPARK-13307?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15174501#comment-15174501
]
Xiao Li commented on SPARK-13307:
-
Really thank you for your response.
> TPCDS query 66
[
https://issues.apache.org/jira/browse/SPARK-13307?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15174473#comment-15174473
]
Davies Liu commented on SPARK-13307:
In the plan, I saw that the column pruning does
[
https://issues.apache.org/jira/browse/SPARK-13307?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15160260#comment-15160260
]
Xiao Li commented on SPARK-13307:
-
You need to check the plan and check the join type it
[
https://issues.apache.org/jira/browse/SPARK-13307?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15160256#comment-15160256
]
Xiao Li commented on SPARK-13307:
-
First, I am not sure if usage of broadcastjoin makes s
[
https://issues.apache.org/jira/browse/SPARK-13307?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15159636#comment-15159636
]
JESSE CHEN commented on SPARK-13307:
I tuned up the autoBroadcastJoinThreshold to 100
[
https://issues.apache.org/jira/browse/SPARK-13307?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15146765#comment-15146765
]
Xiao Li commented on SPARK-13307:
-
In the following PR: https://github.com/apache/spark/p
[
https://issues.apache.org/jira/browse/SPARK-13307?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15146755#comment-15146755
]
Xiao Li commented on SPARK-13307:
-
Please tune “spark.sql.autoBroadcastJoinThreshold” to
[
https://issues.apache.org/jira/browse/SPARK-13307?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15146751#comment-15146751
]
Xiao Li commented on SPARK-13307:
-
1.6.1 is using SortMergeJoin, but 1.4.1 is using Shuff
[
https://issues.apache.org/jira/browse/SPARK-13307?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15146740#comment-15146740
]
JESSE CHEN commented on SPARK-13307:
Uploaded newly collected plans (logical, analyze
[
https://issues.apache.org/jira/browse/SPARK-13307?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15146140#comment-15146140
]
Xiao Li commented on SPARK-13307:
-
Could you provided logical plans, as suggested above?
[
https://issues.apache.org/jira/browse/SPARK-13307?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15146138#comment-15146138
]
JESSE CHEN commented on SPARK-13307:
Have you looked at the plans? I provided at abov
[
https://issues.apache.org/jira/browse/SPARK-13307?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15145829#comment-15145829
]
Xiao Li commented on SPARK-13307:
-
Please use explain(true). It will be much easier to an
13 matches
Mail list logo