spark git commit: [SPARK-24971][SQL] remove SupportsDeprecatedScanRow

Repository: spark Updated Branches: refs/heads/master 1122754bd -> defc54c69 [SPARK-24971][SQL] remove SupportsDeprecatedScanRow ## What changes were proposed in this pull request? This is a follow up of https://github.com/apache/spark/pull/21118 . In

spark git commit: [SPARK-24982][SQL] UDAF resolution should not throw AssertionError

Repository: spark Updated Branches: refs/heads/master 1f7e22c72 -> 1efffb799 [SPARK-24982][SQL] UDAF resolution should not throw AssertionError ## What changes were proposed in this pull request? When user calls anUDAF with the wrong number of arguments, Spark previously throws an

svn commit: r28485 - in /dev/spark/2.4.0-SNAPSHOT-2018_08_01_00_02-1f7e22c-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _s

Author: pwendell Date: Wed Aug 1 07:16:46 2018 New Revision: 28485 Log: Apache Spark 2.4.0-SNAPSHOT-2018_08_01_00_02-1f7e22c docs [This commit notification would consist of 1470 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.]

spark git commit: [SPARK-24653][TESTS] Avoid cross-job pollution in TestUtils / SpillListener.

Repository: spark Updated Branches: refs/heads/master 1efffb799 -> 1122754bd [SPARK-24653][TESTS] Avoid cross-job pollution in TestUtils / SpillListener. There is a narrow race in this code that is caused when the code being run in assertSpilled / assertNotSpilled runs more than a single job.

svn commit: r28491 - in /dev/spark/2.4.0-SNAPSHOT-2018_08_01_04_02-1122754-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _s

Author: pwendell Date: Wed Aug 1 11:18:20 2018 New Revision: 28491 Log: Apache Spark 2.4.0-SNAPSHOT-2018_08_01_04_02-1122754 docs [This commit notification would consist of 1470 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.]

svn commit: r28505 - in /dev/spark/2.4.0-SNAPSHOT-2018_08_01_12_05-95a9d5e-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _s

Author: pwendell Date: Wed Aug 1 19:19:25 2018 New Revision: 28505 Log: Apache Spark 2.4.0-SNAPSHOT-2018_08_01_12_05-95a9d5e docs [This commit notification would consist of 1470 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.]

spark git commit: [SPARK-23915][SQL] Add array_except function

Repository: spark Updated Branches: refs/heads/master defc54c69 -> 95a9d5e3a [SPARK-23915][SQL] Add array_except function ## What changes were proposed in this pull request? The PR adds the SQL function `array_except`. The behavior of the function is based on Presto's one. This function

spark git commit: [SPARK-24990][SQL] merge ReadSupport and ReadSupportWithSchema

Repository: spark Updated Branches: refs/heads/master 9f558601e -> ce084d3e0 [SPARK-24990][SQL] merge ReadSupport and ReadSupportWithSchema ## What changes were proposed in this pull request? Regarding user-specified schema, data sources may have 3 different behaviors: 1. must have a

spark git commit: [SPARK-24957][SQL][BACKPORT-2.2] Average with decimal followed by aggregation returns wrong result

Repository: spark Updated Branches: refs/heads/branch-2.2 c4b37696f -> 22ce8051f [SPARK-24957][SQL][BACKPORT-2.2] Average with decimal followed by aggregation returns wrong result ## What changes were proposed in this pull request? When we do an average, the result is computed dividing the

svn commit: r28506 - in /dev/spark/2.4.0-SNAPSHOT-2018_08_01_16_02-ce084d3-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _s

Author: pwendell Date: Wed Aug 1 23:16:06 2018 New Revision: 28506 Log: Apache Spark 2.4.0-SNAPSHOT-2018_08_01_16_02-ce084d3 docs [This commit notification would consist of 1469 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.]

spark git commit: [SPARK-24960][K8S] explicitly expose ports on driver container

Repository: spark Updated Branches: refs/heads/master 95a9d5e3a -> f5113ea8d [SPARK-24960][K8S] explicitly expose ports on driver container https://issues.apache.org/jira/browse/SPARK-24960 ## What changes were proposed in this pull request? Expose ports explicitly in the driver container.

spark git commit: [SPARK-24937][SQL] Datasource partition table should load empty static partitions

Repository: spark Updated Branches: refs/heads/master f5113ea8d -> 9f558601e [SPARK-24937][SQL] Datasource partition table should load empty static partitions ## What changes were proposed in this pull request? How to reproduce: ```sql spark-sql> CREATE TABLE tbl AS SELECT 1; spark-sql>

spark git commit: [MINOR][DOCS] Add note about Spark network security

Repository: spark Updated Branches: refs/heads/master c5fe41292 -> c9914cf04 [MINOR][DOCS] Add note about Spark network security ## What changes were proposed in this pull request? In response to a recent question, this reiterates that network access to a Spark cluster should be disabled by

spark git commit: [SPARK-18188][DOC][FOLLOW-UP] Add `spark.broadcast.checksum` to configuration

Repository: spark Updated Branches: refs/heads/master ce084d3e0 -> c5fe41292 [SPARK-18188][DOC][FOLLOW-UP] Add `spark.broadcast.checksum` to configuration ## What changes were proposed in this pull request? This pr add `spark.broadcast.checksum` to configuration. ## How was this patch

svn commit: r28507 - in /dev/spark/2.4.0-SNAPSHOT-2018_08_01_20_01-c9914cf-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _s

Author: pwendell Date: Thu Aug 2 03:16:03 2018 New Revision: 28507 Log: Apache Spark 2.4.0-SNAPSHOT-2018_08_01_20_01-c9914cf docs [This commit notification would consist of 1469 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.]