svn commit: r24055 - in /dev/spark/2.3.0-SNAPSHOT-2018_01_06_22_01-285d342-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _s

2018-01-06 Thread pwendell
Author: pwendell Date: Sun Jan 7 06:16:23 2018 New Revision: 24055 Log: Apache Spark 2.3.0-SNAPSHOT-2018_01_06_22_01-285d342 docs [This commit notification would consist of 1439 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.]

spark git commit: [SPARK-22973][SQL] Fix incorrect results of Casting Map to String

2018-01-06 Thread wenchen
Repository: spark Updated Branches: refs/heads/branch-2.3 f9e7b0c8a -> 285d342c4 [SPARK-22973][SQL] Fix incorrect results of Casting Map to String ## What changes were proposed in this pull request? This pr fixed the issue when casting maps into strings; ``` scala> Seq(Map(1 -> "a", 2 ->

spark git commit: [SPARK-22973][SQL] Fix incorrect results of Casting Map to String

2018-01-06 Thread wenchen
Repository: spark Updated Branches: refs/heads/master 9a7048b28 -> 18e941499 [SPARK-22973][SQL] Fix incorrect results of Casting Map to String ## What changes were proposed in this pull request? This pr fixed the issue when casting maps into strings; ``` scala> Seq(Map(1 -> "a", 2 ->

svn commit: r24054 - in /dev/spark/2.3.0-SNAPSHOT-2018_01_06_12_01-9a7048b-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _s

2018-01-06 Thread pwendell
Author: pwendell Date: Sat Jan 6 20:15:02 2018 New Revision: 24054 Log: Apache Spark 2.3.0-SNAPSHOT-2018_01_06_12_01-9a7048b docs [This commit notification would consist of 1439 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.]

svn commit: r24050 - in /dev/spark/2.3.0-SNAPSHOT-2018_01_06_10_01-f9e7b0c-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _s

2018-01-06 Thread pwendell
Author: pwendell Date: Sat Jan 6 18:14:55 2018 New Revision: 24050 Log: Apache Spark 2.3.0-SNAPSHOT-2018_01_06_10_01-f9e7b0c docs [This commit notification would consist of 1439 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.]

spark git commit: [HOTFIX] Fix style checking failure

2018-01-06 Thread lixiao
Repository: spark Updated Branches: refs/heads/branch-2.3 b66700a5e -> f9e7b0c8a [HOTFIX] Fix style checking failure ## What changes were proposed in this pull request? This PR is to fix the style checking failure. ## How was this patch tested? N/A Author: gatorsmile

spark git commit: [HOTFIX] Fix style checking failure

2018-01-06 Thread lixiao
Repository: spark Updated Branches: refs/heads/master 993f21567 -> 9a7048b28 [HOTFIX] Fix style checking failure ## What changes were proposed in this pull request? This PR is to fix the style checking failure. ## How was this patch tested? N/A Author: gatorsmile

spark git commit: [SPARK-22901][PYTHON][FOLLOWUP] Adds the doc for asNondeterministic for wrapped UDF function

2018-01-06 Thread lixiao
Repository: spark Updated Branches: refs/heads/branch-2.3 037775598 -> b66700a5e [SPARK-22901][PYTHON][FOLLOWUP] Adds the doc for asNondeterministic for wrapped UDF function ## What changes were proposed in this pull request? This PR wraps the `asNondeterministic` attribute in the wrapped

spark git commit: [SPARK-22901][PYTHON][FOLLOWUP] Adds the doc for asNondeterministic for wrapped UDF function

2018-01-06 Thread lixiao
Repository: spark Updated Branches: refs/heads/master 7b7804142 -> 993f21567 [SPARK-22901][PYTHON][FOLLOWUP] Adds the doc for asNondeterministic for wrapped UDF function ## What changes were proposed in this pull request? This PR wraps the `asNondeterministic` attribute in the wrapped UDF

spark git commit: [SPARK-21786][SQL] When acquiring 'compressionCodecClassName' in 'ParquetOptions', `parquet.compression` needs to be considered.

2018-01-06 Thread lixiao
Repository: spark Updated Branches: refs/heads/master be9a804f2 -> 7b7804142 [SPARK-21786][SQL] When acquiring 'compressionCodecClassName' in 'ParquetOptions', `parquet.compression` needs to be considered. [SPARK-21786][SQL] When acquiring 'compressionCodecClassName' in 'ParquetOptions',

spark git commit: [SPARK-21786][SQL] When acquiring 'compressionCodecClassName' in 'ParquetOptions', `parquet.compression` needs to be considered.

2018-01-06 Thread lixiao
Repository: spark Updated Branches: refs/heads/branch-2.3 e6449e816 -> 037775598 [SPARK-21786][SQL] When acquiring 'compressionCodecClassName' in 'ParquetOptions', `parquet.compression` needs to be considered. [SPARK-21786][SQL] When acquiring 'compressionCodecClassName' in

svn commit: r24046 - in /dev/spark/2.3.0-SNAPSHOT-2018_01_06_02_01-7236914-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _s

2018-01-06 Thread pwendell
Author: pwendell Date: Sat Jan 6 10:16:13 2018 New Revision: 24046 Log: Apache Spark 2.3.0-SNAPSHOT-2018_01_06_02_01-7236914 docs [This commit notification would consist of 1439 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.]

spark git commit: [SPARK-22793][SQL] Memory leak in Spark Thrift Server

2018-01-06 Thread lixiao
Repository: spark Updated Branches: refs/heads/master f2dd8b923 -> be9a804f2 [SPARK-22793][SQL] Memory leak in Spark Thrift Server # What changes were proposed in this pull request? 1. Start HiveThriftServer2. 2. Connect to thriftserver through beeline. 3. Close the beeline. 4. repeat step2

spark git commit: [SPARK-22793][SQL] Memory leak in Spark Thrift Server

2018-01-06 Thread lixiao
Repository: spark Updated Branches: refs/heads/branch-2.3 7236914e5 -> e6449e816 [SPARK-22793][SQL] Memory leak in Spark Thrift Server # What changes were proposed in this pull request? 1. Start HiveThriftServer2. 2. Connect to thriftserver through beeline. 3. Close the beeline. 4. repeat

spark git commit: [SPARK-22930][PYTHON][SQL] Improve the description of Vectorized UDFs for non-deterministic cases

2018-01-06 Thread lixiao
Repository: spark Updated Branches: refs/heads/branch-2.3 3e3e9386e -> 7236914e5 [SPARK-22930][PYTHON][SQL] Improve the description of Vectorized UDFs for non-deterministic cases ## What changes were proposed in this pull request? Add tests for using non deterministic UDFs in aggregate.

spark git commit: [SPARK-22930][PYTHON][SQL] Improve the description of Vectorized UDFs for non-deterministic cases

2018-01-06 Thread lixiao
Repository: spark Updated Branches: refs/heads/master bf65cd3cd -> f2dd8b923 [SPARK-22930][PYTHON][SQL] Improve the description of Vectorized UDFs for non-deterministic cases ## What changes were proposed in this pull request? Add tests for using non deterministic UDFs in aggregate. Update