[1/3] spark git commit: [PYSPARK] Updates to pyspark broadcast

2018-09-17 Thread irashid
Repository: spark Updated Branches: refs/heads/branch-2.4 08f7b145c -> 7beb34175 [PYSPARK] Updates to pyspark broadcast (cherry picked from commit 58419b92673c46911c25bc6c6b13397f880c6424) Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit:

[3/3] spark git commit: [CORE] Updates to remote cache reads

2018-09-17 Thread irashid
[CORE] Updates to remote cache reads Covered by tests in DistributedSuite (cherry picked from commit a97001d21757ae214c86371141bd78a376200f66) Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/7beb3417 Tree:

[2/3] spark git commit: [PYSPARK][SQL] Updates to RowQueue

2018-09-17 Thread irashid
[PYSPARK][SQL] Updates to RowQueue Tested with updates to RowQueueSuite (cherry picked from commit 8f5a5a9e5b9f273443b2721f80c99dc7397ef4c0) Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/80e317b3 Tree:

[2/3] spark git commit: [PYSPARK][SQL] Updates to RowQueue

2018-09-17 Thread irashid
[PYSPARK][SQL] Updates to RowQueue Tested with updates to RowQueueSuite Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/8f5a5a9e Tree: http://git-wip-us.apache.org/repos/asf/spark/tree/8f5a5a9e Diff:

svn commit: r29449 - in /dev/spark/2.5.0-SNAPSHOT-2018_09_17_12_02-553af22-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _s

2018-09-17 Thread pwendell
Author: pwendell Date: Mon Sep 17 19:16:59 2018 New Revision: 29449 Log: Apache Spark 2.5.0-SNAPSHOT-2018_09_17_12_02-553af22 docs [This commit notification would consist of 1483 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.]

[1/3] spark git commit: [CORE] Updates to remote cache reads

2018-09-17 Thread irashid
Repository: spark Updated Branches: refs/heads/master 553af22f2 -> a97001d21 [CORE] Updates to remote cache reads Covered by tests in DistributedSuite Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/a97001d2 Tree:

[3/3] spark git commit: [PYSPARK] Updates to pyspark broadcast

2018-09-17 Thread irashid
[PYSPARK] Updates to pyspark broadcast Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/58419b92 Tree: http://git-wip-us.apache.org/repos/asf/spark/tree/58419b92 Diff: http://git-wip-us.apache.org/repos/asf/spark/diff/58419b92

svn commit: r29444 - in /dev/spark/2.5.0-SNAPSHOT-2018_09_17_08_02-30aa37f-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _s

2018-09-17 Thread pwendell
Author: pwendell Date: Mon Sep 17 15:17:07 2018 New Revision: 29444 Log: Apache Spark 2.5.0-SNAPSHOT-2018_09_17_08_02-30aa37f docs [This commit notification would consist of 1483 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.]

svn commit: r29455 - in /dev/spark/2.5.0-SNAPSHOT-2018_09_17_16_02-a97001d-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _s

2018-09-17 Thread pwendell
Author: pwendell Date: Mon Sep 17 23:16:54 2018 New Revision: 29455 Log: Apache Spark 2.5.0-SNAPSHOT-2018_09_17_16_02-a97001d docs [This commit notification would consist of 1484 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.]

svn commit: r29459 - in /dev/spark/2.4.1-SNAPSHOT-2018_09_17_18_02-7beb341-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _s

2018-09-17 Thread pwendell
Author: pwendell Date: Tue Sep 18 01:16:58 2018 New Revision: 29459 Log: Apache Spark 2.4.1-SNAPSHOT-2018_09_17_18_02-7beb341 docs [This commit notification would consist of 1475 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.]

spark git commit: [SPARK-16323][SQL] Add IntegralDivide expression

2018-09-17 Thread dongjoon
Repository: spark Updated Branches: refs/heads/master 4b9542e3a -> 553af22f2 [SPARK-16323][SQL] Add IntegralDivide expression ## What changes were proposed in this pull request? The PR takes over #14036 and it introduces a new expression `IntegralDivide` in order to avoid the several

spark git commit: [SPARK-25423][SQL] Output "dataFilters" in DataSourceScanExec.metadata

2018-09-17 Thread dongjoon
Repository: spark Updated Branches: refs/heads/master 30aa37fca -> 4b9542e3a [SPARK-25423][SQL] Output "dataFilters" in DataSourceScanExec.metadata ## What changes were proposed in this pull request? Output `dataFilters` in `DataSourceScanExec.metadata`. ## How was this patch tested? unit

svn commit: r29448 - in /dev/spark/2.4.1-SNAPSHOT-2018_09_17_10_03-08f7b14-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _s

2018-09-17 Thread pwendell
Author: pwendell Date: Mon Sep 17 17:17:19 2018 New Revision: 29448 Log: Apache Spark 2.4.1-SNAPSHOT-2018_09_17_10_03-08f7b14 docs [This commit notification would consist of 1474 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.]

spark git commit: [SPARK-25443][BUILD] fix issues when building docs with release scripts in docker

2018-09-17 Thread wenchen
Repository: spark Updated Branches: refs/heads/branch-2.4 7beb34175 -> c40375190 [SPARK-25443][BUILD] fix issues when building docs with release scripts in docker ## What changes were proposed in this pull request? These 2 changes are required to build the docs for Spark 2.4.0 RC1: 1.

spark git commit: [SPARK-25443][BUILD] fix issues when building docs with release scripts in docker

2018-09-17 Thread wenchen
Repository: spark Updated Branches: refs/heads/master a97001d21 -> 0f1413e32 [SPARK-25443][BUILD] fix issues when building docs with release scripts in docker ## What changes were proposed in this pull request? These 2 changes are required to build the docs for Spark 2.4.0 RC1: 1. install

svn commit: r29465 - in /dev/spark/2.4.1-SNAPSHOT-2018_09_17_22_02-c403751-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _s

2018-09-17 Thread pwendell
Author: pwendell Date: Tue Sep 18 05:17:31 2018 New Revision: 29465 Log: Apache Spark 2.4.1-SNAPSHOT-2018_09_17_22_02-c403751 docs [This commit notification would consist of 1475 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.]

svn commit: r29464 - in /dev/spark/2.5.0-SNAPSHOT-2018_09_17_20_03-0f1413e-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _s

2018-09-17 Thread pwendell
Author: pwendell Date: Tue Sep 18 03:17:42 2018 New Revision: 29464 Log: Apache Spark 2.5.0-SNAPSHOT-2018_09_17_20_03-0f1413e docs [This commit notification would consist of 1484 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.]

svn commit: r29466 - /dev/spark/KEYS

2018-09-17 Thread wenchen
Author: wenchen Date: Tue Sep 18 05:26:36 2018 New Revision: 29466 Log: Update KEYS Modified: dev/spark/KEYS Modified: dev/spark/KEYS == --- dev/spark/KEYS (original) +++ dev/spark/KEYS Tue Sep 18 05:26:36 2018 @@

spark git commit: [SPARK-25444][SQL] Refactor GenArrayData.genCodeToCreateArrayData method

2018-09-17 Thread ueshin
Repository: spark Updated Branches: refs/heads/master 0f1413e32 -> acc645257 [SPARK-25444][SQL] Refactor GenArrayData.genCodeToCreateArrayData method ## What changes were proposed in this pull request? This PR makes `GenArrayData.genCodeToCreateArrayData` method simple by using

spark git commit: [SPARK-24685][BUILD][FOLLOWUP] Fix the nonexist profile name in release script

2018-09-17 Thread wenchen
Repository: spark Updated Branches: refs/heads/branch-2.4 fb1539ad8 -> e368efcf5 [SPARK-24685][BUILD][FOLLOWUP] Fix the nonexist profile name in release script ## What changes were proposed in this pull request? `without-hadoop` profile doesn't exist in Maven, instead the name should be

spark git commit: [SPARK-24685][BUILD][FOLLOWUP] Fix the nonexist profile name in release script

2018-09-17 Thread wenchen
Repository: spark Updated Branches: refs/heads/master 538e04787 -> b66e14dc9 [SPARK-24685][BUILD][FOLLOWUP] Fix the nonexist profile name in release script ## What changes were proposed in this pull request? `without-hadoop` profile doesn't exist in Maven, instead the name should be

svn commit: r29429 - in /dev/spark/2.5.0-SNAPSHOT-2018_09_17_00_02-538e047-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _s

2018-09-17 Thread pwendell
Author: pwendell Date: Mon Sep 17 07:16:34 2018 New Revision: 29429 Log: Apache Spark 2.5.0-SNAPSHOT-2018_09_17_00_02-538e047 docs [This commit notification would consist of 1483 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.]

spark git commit: [SPARK-23425][SQL][FOLLOWUP] Support wildcards in HDFS path for loadtable command.

2018-09-17 Thread wenchen
Repository: spark Updated Branches: refs/heads/branch-2.4 e368efcf5 -> 43c9b1085 [SPARK-23425][SQL][FOLLOWUP] Support wildcards in HDFS path for loadtable command. What changes were proposed in this pull request Updated the Migration guide for the behavior changes done in the JIRA issue

spark git commit: [SPARK-25427][SQL][TEST] Add BloomFilter creation test cases

2018-09-17 Thread wenchen
Repository: spark Updated Branches: refs/heads/branch-2.4 43c9b1085 -> 56f706867 [SPARK-25427][SQL][TEST] Add BloomFilter creation test cases ## What changes were proposed in this pull request? Spark supports BloomFilter creation for ORC files. This PR aims to add test coverages to prevent

svn commit: r29438 - in /dev/spark/v2.3.2-rc6-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _site/api/java/org/apache/spark

2018-09-17 Thread jshao
Author: jshao Date: Mon Sep 17 12:13:30 2018 New Revision: 29438 Log: Apache Spark v2.3.2-rc6 docs [This commit notification would consist of 1447 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.]

spark git commit: [SPARK-23425][SQL][FOLLOWUP] Support wildcards in HDFS path for loadtable command.

2018-09-17 Thread wenchen
Repository: spark Updated Branches: refs/heads/master b66e14dc9 -> 619c94901 [SPARK-23425][SQL][FOLLOWUP] Support wildcards in HDFS path for loadtable command. What changes were proposed in this pull request Updated the Migration guide for the behavior changes done in the JIRA issue

spark git commit: [SPARK-25427][SQL][TEST] Add BloomFilter creation test cases

2018-09-17 Thread wenchen
Repository: spark Updated Branches: refs/heads/master 619c94901 -> 0dd61ec47 [SPARK-25427][SQL][TEST] Add BloomFilter creation test cases ## What changes were proposed in this pull request? Spark supports BloomFilter creation for ORC files. This PR aims to add test coverages to prevent

svn commit: r29432 - in /dev/spark/2.4.1-SNAPSHOT-2018_09_17_02_02-e368efc-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _s

2018-09-17 Thread pwendell
Author: pwendell Date: Mon Sep 17 09:17:09 2018 New Revision: 29432 Log: Apache Spark 2.4.1-SNAPSHOT-2018_09_17_02_02-e368efc docs [This commit notification would consist of 1474 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.]

spark git commit: [SPARK-24654][BUILD][FOLLOWUP] Update, fix LICENSE and NOTICE, and specialize for source vs binary

2018-09-17 Thread srowen
Repository: spark Updated Branches: refs/heads/master 8cf6fd1c2 -> 30aa37fca [SPARK-24654][BUILD][FOLLOWUP] Update, fix LICENSE and NOTICE, and specialize for source vs binary ## What changes were proposed in this pull request? Fix location of licenses-binary in binary release, and remove

spark git commit: [SPARK-24654][BUILD][FOLLOWUP] Update, fix LICENSE and NOTICE, and specialize for source vs binary

2018-09-17 Thread srowen
Repository: spark Updated Branches: refs/heads/branch-2.4 d05596ebd -> 08f7b145c [SPARK-24654][BUILD][FOLLOWUP] Update, fix LICENSE and NOTICE, and specialize for source vs binary ## What changes were proposed in this pull request? Fix location of licenses-binary in binary release, and

spark git commit: [SPARK-25431][SQL][EXAMPLES] Fix function examples and the example results.

2018-09-17 Thread gurwls223
Repository: spark Updated Branches: refs/heads/branch-2.4 56f706867 -> d05596ebd [SPARK-25431][SQL][EXAMPLES] Fix function examples and the example results. ## What changes were proposed in this pull request? There are some mistakes in examples of newly added functions. Also the format of

spark git commit: [SPARK-25431][SQL][EXAMPLES] Fix function examples and the example results.

2018-09-17 Thread gurwls223
Repository: spark Updated Branches: refs/heads/master 0dd61ec47 -> 8cf6fd1c2 [SPARK-25431][SQL][EXAMPLES] Fix function examples and the example results. ## What changes were proposed in this pull request? There are some mistakes in examples of newly added functions. Also the format of the

svn commit: r29440 - in /dev/spark/2.5.0-SNAPSHOT-2018_09_17_05_59-8cf6fd1-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _s

2018-09-17 Thread pwendell
Author: pwendell Date: Mon Sep 17 13:13:51 2018 New Revision: 29440 Log: Apache Spark 2.5.0-SNAPSHOT-2018_09_17_05_59-8cf6fd1 docs [This commit notification would consist of 1483 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.]

svn commit: r29441 - in /dev/spark/2.4.1-SNAPSHOT-2018_09_17_06_03-d05596e-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _s

2018-09-17 Thread pwendell
Author: pwendell Date: Mon Sep 17 13:18:46 2018 New Revision: 29441 Log: Apache Spark 2.4.1-SNAPSHOT-2018_09_17_06_03-d05596e docs [This commit notification would consist of 1474 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.]