svn commit: r29795 - in /dev/spark/2.4.1-SNAPSHOT-2018_09_29_22_02-6f510c6-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _s

2018-09-29 Thread pwendell
Author: pwendell Date: Sun Sep 30 05:19:08 2018 New Revision: 29795 Log: Apache Spark 2.4.1-SNAPSHOT-2018_09_29_22_02-6f510c6 docs [This commit notification would consist of 1472 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.]

svn commit: r29794 - in /dev/spark/2.3.3-SNAPSHOT-2018_09_29_22_02-73408f0-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _s

2018-09-29 Thread pwendell
Author: pwendell Date: Sun Sep 30 05:17:36 2018 New Revision: 29794 Log: Apache Spark 2.3.3-SNAPSHOT-2018_09_29_22_02-73408f0 docs [This commit notification would consist of 1443 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.]

svn commit: r29793 - in /dev/spark/2.5.0-SNAPSHOT-2018_09_29_20_02-b6b8a66-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _s

2018-09-29 Thread pwendell
Author: pwendell Date: Sun Sep 30 03:17:13 2018 New Revision: 29793 Log: Apache Spark 2.5.0-SNAPSHOT-2018_09_29_20_02-b6b8a66 docs [This commit notification would consist of 1485 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.]

svn commit: r29787 - in /dev/spark/2.4.1-SNAPSHOT-2018_09_29_18_02-fef3027-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _s

2018-09-29 Thread pwendell
Author: pwendell Date: Sun Sep 30 01:17:04 2018 New Revision: 29787 Log: Apache Spark 2.4.1-SNAPSHOT-2018_09_29_18_02-fef3027 docs [This commit notification would consist of 1472 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.]

spark git commit: [SPARK-25568][CORE] Continue to update the remaining accumulators when failing to update one accumulator

2018-09-29 Thread lixiao
Repository: spark Updated Branches: refs/heads/branch-2.2 ef3616825 -> 5dd14f5d9 [SPARK-25568][CORE] Continue to update the remaining accumulators when failing to update one accumulator ## What changes were proposed in this pull request? Since we don't fail a job when `AccumulatorV2.merge`

spark git commit: [SPARK-25568][CORE] Continue to update the remaining accumulators when failing to update one accumulator

2018-09-29 Thread lixiao
Repository: spark Updated Branches: refs/heads/branch-2.3 eb78380c0 -> 73408f085 [SPARK-25568][CORE] Continue to update the remaining accumulators when failing to update one accumulator ## What changes were proposed in this pull request? Since we don't fail a job when `AccumulatorV2.merge`

spark git commit: [SPARK-25568][CORE] Continue to update the remaining accumulators when failing to update one accumulator

2018-09-29 Thread lixiao
Repository: spark Updated Branches: refs/heads/master f4b138082 -> b6b8a6632 [SPARK-25568][CORE] Continue to update the remaining accumulators when failing to update one accumulator ## What changes were proposed in this pull request? Since we don't fail a job when `AccumulatorV2.merge`

spark git commit: [SPARK-25568][CORE] Continue to update the remaining accumulators when failing to update one accumulator

2018-09-29 Thread lixiao
Repository: spark Updated Branches: refs/heads/branch-2.4 fef30271b -> 6f510c69b [SPARK-25568][CORE] Continue to update the remaining accumulators when failing to update one accumulator ## What changes were proposed in this pull request? Since we don't fail a job when `AccumulatorV2.merge`

svn commit: r29786 - in /dev/spark/2.5.0-SNAPSHOT-2018_09_29_16_02-f4b1380-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _s

2018-09-29 Thread pwendell
Author: pwendell Date: Sat Sep 29 23:17:00 2018 New Revision: 29786 Log: Apache Spark 2.5.0-SNAPSHOT-2018_09_29_16_02-f4b1380 docs [This commit notification would consist of 1485 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.]

spark git commit: [SPARK-25572][SPARKR] test only if not cran

2018-09-29 Thread felixcheung
Repository: spark Updated Branches: refs/heads/master f246813af -> f4b138082 [SPARK-25572][SPARKR] test only if not cran ## What changes were proposed in this pull request? CRAN doesn't seem to respect the system requirements as running tests - we have seen cases where SparkR is run on Java

spark git commit: [SPARK-25572][SPARKR] test only if not cran

2018-09-29 Thread felixcheung
Repository: spark Updated Branches: refs/heads/branch-2.4 a14306b1d -> fef30271b [SPARK-25572][SPARKR] test only if not cran ## What changes were proposed in this pull request? CRAN doesn't seem to respect the system requirements as running tests - we have seen cases where SparkR is run on

svn commit: r29784 - in /dev/spark/2.5.0-SNAPSHOT-2018_09_29_12_02-f246813-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _s

2018-09-29 Thread pwendell
Author: pwendell Date: Sat Sep 29 19:16:57 2018 New Revision: 29784 Log: Apache Spark 2.5.0-SNAPSHOT-2018_09_29_12_02-f246813 docs [This commit notification would consist of 1485 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.]

spark git commit: [SPARK-25508][SQL][TEST] Refactor OrcReadBenchmark to use main method

2018-09-29 Thread dongjoon
Repository: spark Updated Branches: refs/heads/master 623c2ec4e -> f246813af [SPARK-25508][SQL][TEST] Refactor OrcReadBenchmark to use main method ## What changes were proposed in this pull request? Refactor OrcReadBenchmark to use main method. Generate benchmark result: ```

svn commit: r29782 - in /dev/spark/2.5.0-SNAPSHOT-2018_09_29_08_02-623c2ec-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _s

2018-09-29 Thread pwendell
Author: pwendell Date: Sat Sep 29 15:17:20 2018 New Revision: 29782 Log: Apache Spark 2.5.0-SNAPSHOT-2018_09_29_08_02-623c2ec docs [This commit notification would consist of 1485 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.]

spark git commit: [SPARK-25048][SQL] Pivoting by multiple columns in Scala/Java

2018-09-29 Thread gurwls223
Repository: spark Updated Branches: refs/heads/master dcb9a97f3 -> 623c2ec4e [SPARK-25048][SQL] Pivoting by multiple columns in Scala/Java ## What changes were proposed in this pull request? In the PR, I propose to extend implementation of existing method: ``` def pivot(pivotColumn: Column,

svn commit: r29781 - in /dev/spark/2.4.1-SNAPSHOT-2018_09_29_06_02-a14306b-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _s

2018-09-29 Thread pwendell
Author: pwendell Date: Sat Sep 29 13:17:03 2018 New Revision: 29781 Log: Apache Spark 2.4.1-SNAPSHOT-2018_09_29_06_02-a14306b docs [This commit notification would consist of 1472 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.]

svn commit: r29780 - in /dev/spark/2.5.0-SNAPSHOT-2018_09_29_04_02-dcb9a97-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _s

2018-09-29 Thread pwendell
Author: pwendell Date: Sat Sep 29 11:17:10 2018 New Revision: 29780 Log: Apache Spark 2.5.0-SNAPSHOT-2018_09_29_04_02-dcb9a97 docs [This commit notification would consist of 1485 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.]

spark git commit: [SPARK-25262][DOC][FOLLOWUP] Fix link tags in html table

2018-09-29 Thread gurwls223
Repository: spark Updated Branches: refs/heads/branch-2.4 ec2c17abf -> a14306b1d [SPARK-25262][DOC][FOLLOWUP] Fix link tags in html table ## What changes were proposed in this pull request? Markdown links are not working inside html table. We should use html link tag. ## How was this patch

spark git commit: [SPARK-25262][DOC][FOLLOWUP] Fix link tags in html table

2018-09-29 Thread gurwls223
Repository: spark Updated Branches: refs/heads/master 1007cae20 -> dcb9a97f3 [SPARK-25262][DOC][FOLLOWUP] Fix link tags in html table ## What changes were proposed in this pull request? Markdown links are not working inside html table. We should use html link tag. ## How was this patch

spark git commit: [SPARK-25447][SQL] Support JSON options by schema_of_json()

2018-09-29 Thread gurwls223
Repository: spark Updated Branches: refs/heads/master 1e437835e -> 1007cae20 [SPARK-25447][SQL] Support JSON options by schema_of_json() ## What changes were proposed in this pull request? In the PR, I propose to extended the `schema_of_json()` function, and accept JSON options since they

svn commit: r29776 - in /dev/spark/2.5.0-SNAPSHOT-2018_09_29_00_02-1e43783-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _s

2018-09-29 Thread pwendell
Author: pwendell Date: Sat Sep 29 07:17:20 2018 New Revision: 29776 Log: Apache Spark 2.5.0-SNAPSHOT-2018_09_29_00_02-1e43783 docs [This commit notification would consist of 1485 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.]