spark git commit: [SPARK-24576][BUILD] Upgrade Apache ORC to 1.5.2

Repository: spark Updated Branches: refs/heads/master fc2e18963 -> 3b59d326c [SPARK-24576][BUILD] Upgrade Apache ORC to 1.5.2 ## What changes were proposed in this pull request? This issue aims to upgrade Apache ORC library from 1.4.4 to 1.5.2 in order to bring the following benefits into Ap

svn commit: r28192 - in /dev/spark/2.4.0-SNAPSHOT-2018_07_17_20_01-fc2e189-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _s

Author: pwendell Date: Wed Jul 18 03:16:43 2018 New Revision: 28192 Log: Apache Spark 2.4.0-SNAPSHOT-2018_07_17_20_01-fc2e189 docs [This commit notification would consist of 1468 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.] ---

spark git commit: [SPARK-24529][BUILD][TEST-MAVEN][FOLLOW-UP] Set spotbugs-maven-plugin's fork to true

Repository: spark Updated Branches: refs/heads/master 681845fd6 -> fc2e18963 [SPARK-24529][BUILD][TEST-MAVEN][FOLLOW-UP] Set spotbugs-maven-plugin's fork to true ## What changes were proposed in this pull request? Set `spotbugs-maven-plugin`'s fork to `true`, otherwise will throw exception

spark git commit: [SPARK-24402][SQL] Optimize `In` expression when only one element in the collection or collection is empty

Repository: spark Updated Branches: refs/heads/master 2a4dd6f06 -> 681845fd6 [SPARK-24402][SQL] Optimize `In` expression when only one element in the collection or collection is empty ## What changes were proposed in this pull request? Two new rules in the logical plan optimizers are added.

svn commit: r28188 - in /dev/spark/2.4.0-SNAPSHOT-2018_07_17_16_01-2a4dd6f-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _s

Author: pwendell Date: Tue Jul 17 23:16:14 2018 New Revision: 28188 Log: Apache Spark 2.4.0-SNAPSHOT-2018_07_17_16_01-2a4dd6f docs [This commit notification would consist of 1468 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.] ---

spark git commit: [SPARK-24681][SQL] Verify nested column names in Hive metastore

Repository: spark Updated Branches: refs/heads/master 912634b00 -> 2a4dd6f06 [SPARK-24681][SQL] Verify nested column names in Hive metastore ## What changes were proposed in this pull request? This pr added code to check if nested column names do not include ',', ':', and ';' because Hive met

spark git commit: [SPARK-24747][ML] Make Instrumentation class more flexible

Repository: spark Updated Branches: refs/heads/master 7688ce88b -> 912634b00 [SPARK-24747][ML] Make Instrumentation class more flexible ## What changes were proposed in this pull request? This PR updates the Instrumentation class to make it more flexible and a little bit easier to use. When

svn commit: r28182 - in /dev/spark/2.4.0-SNAPSHOT-2018_07_17_12_02-7688ce8-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _s

Author: pwendell Date: Tue Jul 17 19:17:24 2018 New Revision: 28182 Log: Apache Spark 2.4.0-SNAPSHOT-2018_07_17_12_02-7688ce8 docs [This commit notification would consist of 1468 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.] ---

svn commit: r28181 - in /dev/spark/2.3.3-SNAPSHOT-2018_07_17_10_01-e31b476-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _s

Author: pwendell Date: Tue Jul 17 17:16:23 2018 New Revision: 28181 Log: Apache Spark 2.3.3-SNAPSHOT-2018_07_17_10_01-e31b476 docs [This commit notification would consist of 1443 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.] ---

spark git commit: [SPARK-21590][SS] Window start time should support negative values

Repository: spark Updated Branches: refs/heads/master 5215344de -> 7688ce88b [SPARK-21590][SS] Window start time should support negative values ## What changes were proposed in this pull request? Remove the non-negative checks of window start time to make window support negative start time,

spark git commit: [SPARK-24813][BUILD][FOLLOW-UP][HOTFIX] HiveExternalCatalogVersionsSuite still flaky; fall back to Apache archive

Repository: spark Updated Branches: refs/heads/master 4cf1bec4d -> 5215344de [SPARK-24813][BUILD][FOLLOW-UP][HOTFIX] HiveExternalCatalogVersionsSuite still flaky; fall back to Apache archive ## What changes were proposed in this pull request? Test HiveExternalCatalogVersionsSuite vs only cur

spark git commit: [SPARK-24813][BUILD][FOLLOW-UP][HOTFIX] HiveExternalCatalogVersionsSuite still flaky; fall back to Apache archive

Repository: spark Updated Branches: refs/heads/branch-2.3 dae352a29 -> e31b4766b [SPARK-24813][BUILD][FOLLOW-UP][HOTFIX] HiveExternalCatalogVersionsSuite still flaky; fall back to Apache archive ## What changes were proposed in this pull request? Test HiveExternalCatalogVersionsSuite vs only

spark git commit: [SPARK-24305][SQL][FOLLOWUP] Avoid serialization of private fields in collection expressions.

Repository: spark Updated Branches: refs/heads/master 0ca16f6e1 -> 4cf1bec4d [SPARK-24305][SQL][FOLLOWUP] Avoid serialization of private fields in collection expressions. ## What changes were proposed in this pull request? The PR tries to avoid serialization of private fields of already adde

svn commit: r28168 - in /dev/spark/2.4.0-SNAPSHOT-2018_07_17_00_01-0ca16f6-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _s

Author: pwendell Date: Tue Jul 17 07:16:44 2018 New Revision: 28168 Log: Apache Spark 2.4.0-SNAPSHOT-2018_07_17_00_01-0ca16f6 docs [This commit notification would consist of 1468 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.] ---