svn commit: r27154 - in /dev/spark/2.4.0-SNAPSHOT-2018_05_29_20_01-f489388-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _s

2018-05-29 Thread pwendell
Author: pwendell Date: Wed May 30 03:16:28 2018 New Revision: 27154 Log: Apache Spark 2.4.0-SNAPSHOT-2018_05_29_20_01-f489388 docs [This commit notification would consist of 1464 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.]

spark git commit: [SPARK-24365][SQL] Add Data Source write benchmark

2018-05-29 Thread wenchen
Repository: spark Updated Branches: refs/heads/master 900bc1f7d -> f48938800 [SPARK-24365][SQL] Add Data Source write benchmark ## What changes were proposed in this pull request? Add Data Source write benchmark. So that it would be easier to measure the writer performance. Author:

svn commit: r27151 - in /dev/spark/2.4.0-SNAPSHOT-2018_05_29_12_01-900bc1f-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _s

2018-05-29 Thread pwendell
Author: pwendell Date: Tue May 29 19:16:27 2018 New Revision: 27151 Log: Apache Spark 2.4.0-SNAPSHOT-2018_05_29_12_01-900bc1f docs [This commit notification would consist of 1464 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.]

spark git commit: [SPARK-24371][SQL] Added isInCollection in DataFrame API for Scala and Java.

2018-05-29 Thread dbtsai
Repository: spark Updated Branches: refs/heads/master aca65c63c -> 900bc1f7d [SPARK-24371][SQL] Added isInCollection in DataFrame API for Scala and Java. ## What changes were proposed in this pull request? Implemented **`isInCollection `** in DataFrame API for both Scala and Java, so users

spark git commit: [SPARK-23991][DSTREAMS] Fix data loss when WAL write fails in allocateBlocksToBatch

2018-05-29 Thread jshao
Repository: spark Updated Branches: refs/heads/branch-2.3 fec43fe1b -> 49a6c2b91 [SPARK-23991][DSTREAMS] Fix data loss when WAL write fails in allocateBlocksToBatch When blocks tried to get allocated to a batch and WAL write fails then the blocks will be removed from the received block

spark git commit: [SPARK-23991][DSTREAMS] Fix data loss when WAL write fails in allocateBlocksToBatch

2018-05-29 Thread jshao
Repository: spark Updated Branches: refs/heads/master 23db600c9 -> aca65c63c [SPARK-23991][DSTREAMS] Fix data loss when WAL write fails in allocateBlocksToBatch When blocks tried to get allocated to a batch and WAL write fails then the blocks will be removed from the received block queue.

svn commit: r27143 - in /dev/spark/2.4.0-SNAPSHOT-2018_05_29_00_01-23db600-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _s

2018-05-29 Thread pwendell
Author: pwendell Date: Tue May 29 07:17:31 2018 New Revision: 27143 Log: Apache Spark 2.4.0-SNAPSHOT-2018_05_29_00_01-23db600 docs [This commit notification would consist of 1464 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.]