spark git commit: [SPARK-24696][SQL] ColumnPruning rule fails to remove extra Project

Repository: spark Updated Branches: refs/heads/branch-2.3 8ff4b9727 -> 3c0af793f [SPARK-24696][SQL] ColumnPruning rule fails to remove extra Project The ColumnPruning rule tries adding an extra Project if an input node produces fields more than needed, but as a post-processing step, it needs

spark git commit: simplify rand in dsl/package.scala

Repository: spark Updated Branches: refs/heads/branch-2.3 0f534d3da -> 8ff4b9727 simplify rand in dsl/package.scala (cherry picked from commit d54d8b86301581142293341af25fd78b3278a2e8) Signed-off-by: Xiao Li Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-u

[1/2] spark git commit: [SPARK-24696][SQL] ColumnPruning rule fails to remove extra Project

Repository: spark Updated Branches: refs/heads/master 03545ce6d -> d54d8b863 [SPARK-24696][SQL] ColumnPruning rule fails to remove extra Project ## What changes were proposed in this pull request? The ColumnPruning rule tries adding an extra Project if an input node produces fields more than

[2/2] spark git commit: simplify rand in dsl/package.scala

simplify rand in dsl/package.scala Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/d54d8b86 Tree: http://git-wip-us.apache.org/repos/asf/spark/tree/d54d8b86 Diff: http://git-wip-us.apache.org/repos/asf/spark/diff/d54d8b86 Bra

spark git commit: [SPARK-24638][SQL] StringStartsWith support push down

Repository: spark Updated Branches: refs/heads/master f71e8da5e -> 03545ce6d [SPARK-24638][SQL] StringStartsWith support push down ## What changes were proposed in this pull request? `StringStartsWith` support push down. About 50% savings in compute time. ## How was this patch tested? unit t

[spark] Git Push Summary

Repository: spark Updated Tags: refs/tags/v2.1.3 [created] b7eac07b9 - To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org For additional commands, e-mail: commits-h...@spark.apache.org

svn commit: r27835 - in /dev/spark: v2.1.3-rc1-bin/ v2.1.3-rc1-docs/ v2.1.3-rc2-docs/

Author: vanzin Date: Fri Jun 29 21:37:13 2018 New Revision: 27835 Log: Remove Spark 2.1.3 RC directories. Removed: dev/spark/v2.1.3-rc1-bin/ dev/spark/v2.1.3-rc1-docs/ dev/spark/v2.1.3-rc2-docs/ - To unsubscribe, e-

svn commit: r27834 - /dev/spark/v2.1.3-rc2-bin/ /release/spark/spark-2.1.3/

Author: vanzin Date: Fri Jun 29 21:31:17 2018 New Revision: 27834 Log: Move Spark 2.1.3-rc2 to release area. Added: release/spark/spark-2.1.3/ - copied from r27833, dev/spark/v2.1.3-rc2-bin/ Removed: dev/spark/v2.1.3-rc2-bin/ ---

svn commit: r27833 - in /dev/spark/2.4.0-SNAPSHOT-2018_06_29_12_01-f71e8da-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _s

Author: pwendell Date: Fri Jun 29 19:15:55 2018 New Revision: 27833 Log: Apache Spark 2.4.0-SNAPSHOT-2018_06_29_12_01-f71e8da docs [This commit notification would consist of 1467 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.] ---

spark git commit: [SPARK-24566][CORE] Fix spark.storage.blockManagerSlaveTimeoutMs default config

Repository: spark Updated Branches: refs/heads/master f6e6899a8 -> f71e8da5e [SPARK-24566][CORE] Fix spark.storage.blockManagerSlaveTimeoutMs default config This PR use spark.network.timeout in place of spark.storage.blockManagerSlaveTimeoutMs when it is not configured, as configuration doc