spark git commit: [SPARK-12281][CORE] Fix a race condition when reporting ExecutorState in the shutdown hook

2015-12-13 Thread zsxwing
Repository: spark Updated Branches: refs/heads/branch-1.6 d7e3bfd7d -> fbf16da2e [SPARK-12281][CORE] Fix a race condition when reporting ExecutorState in the shutdown hook 1. Make sure workers and masters exit so that no worker or master will still be running when triggering the shutdown

spark git commit: [SPARK-12281][CORE] Fix a race condition when reporting ExecutorState in the shutdown hook

2015-12-13 Thread zsxwing
Repository: spark Updated Branches: refs/heads/master 8af2f8c61 -> 2aecda284 [SPARK-12281][CORE] Fix a race condition when reporting ExecutorState in the shutdown hook 1. Make sure workers and masters exit so that no worker or master will still be running when triggering the shutdown hook.

spark git commit: [SPARK-12275][SQL] No plan for BroadcastHint in some condition

2015-12-13 Thread yhuai
Repository: spark Updated Branches: refs/heads/master 834e71489 -> ed87f6d3b [SPARK-12275][SQL] No plan for BroadcastHint in some condition When SparkStrategies.BasicOperators's "case BroadcastHint(child) => apply(child)" is hit, it only recursively invokes BasicOperators.apply with this

spark git commit: [SPARK-12275][SQL] No plan for BroadcastHint in some condition

2015-12-13 Thread yhuai
Repository: spark Updated Branches: refs/heads/branch-1.6 fbf16da2e -> 94ce5025f [SPARK-12275][SQL] No plan for BroadcastHint in some condition When SparkStrategies.BasicOperators's "case BroadcastHint(child) => apply(child)" is hit, it only recursively invokes BasicOperators.apply with

[2/2] spark git commit: [SPARK-12213][SQL] use multiple partitions for single distinct query

2015-12-13 Thread yhuai
[SPARK-12213][SQL] use multiple partitions for single distinct query Currently, we could generate different plans for query with single distinct (depends on spark.sql.specializeSingleDistinctAggPlanning), one works better on low cardinality columns, the other works better for high cardinality

[1/2] spark git commit: [SPARK-12213][SQL] use multiple partitions for single distinct query

2015-12-13 Thread yhuai
Repository: spark Updated Branches: refs/heads/master 2aecda284 -> 834e71489 http://git-wip-us.apache.org/repos/asf/spark/blob/834e7148/sql/core/src/main/scala/org/apache/spark/sql/execution/aggregate/utils.scala -- diff --git