spark git commit: [SPARK-21475][Core]Revert "[SPARK-21475][CORE] Use NIO's Files API to replace FileInputStream/FileOutputStream in some critical paths"

Repository: spark Updated Branches: refs/heads/master f2b3525c1 -> 14c4a62c1 [SPARK-21475][Core]Revert "[SPARK-21475][CORE] Use NIO's Files API to replace FileInputStream/FileOutputStream in some critical paths" ## What changes were proposed in this pull request? This reverts commit

spark git commit: [SPARK-22771][SQL] Concatenate binary inputs into a binary output

Repository: spark Updated Branches: refs/heads/master 2ea17afb6 -> f2b3525c1 [SPARK-22771][SQL] Concatenate binary inputs into a binary output ## What changes were proposed in this pull request? This pr modified `concat` to concat binary inputs into a single binary output. `concat` in the

svn commit: r23955 - in /dev/spark/2.3.0-SNAPSHOT-2017_12_29_20_01-8169630-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _s

Author: pwendell Date: Sat Dec 30 04:14:51 2017 New Revision: 23955 Log: Apache Spark 2.3.0-SNAPSHOT-2017_12_29_20_01-8169630 docs [This commit notification would consist of 1425 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.]

spark git commit: [SPARK-22881][ML][TEST] ML regression package testsuite add StructuredStreaming test

Repository: spark Updated Branches: refs/heads/master 816963043 -> 2ea17afb6 [SPARK-22881][ML][TEST] ML regression package testsuite add StructuredStreaming test ## What changes were proposed in this pull request? ML regression package testsuite add StructuredStreaming test In order to

spark git commit: [SPARK-22922][ML][PYSPARK] Pyspark portion of the fit-multiple API

Repository: spark Updated Branches: refs/heads/master ccda75b0d -> 30fcdc038 [SPARK-22922][ML][PYSPARK] Pyspark portion of the fit-multiple API ## What changes were proposed in this pull request? Adding fitMultiple API to `Estimator` with default implementation. Also update have ml.tuning

svn commit: r23954 - in /dev/spark/2.3.0-SNAPSHOT-2017_12_29_16_01-ccda75b-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _s

Author: pwendell Date: Sat Dec 30 00:14:47 2017 New Revision: 23954 Log: Apache Spark 2.3.0-SNAPSHOT-2017_12_29_16_01-ccda75b docs [This commit notification would consist of 1425 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.]

spark git commit: [SPARK-22921][PROJECT-INFRA] Bug fix in jira assigning

Repository: spark Updated Branches: refs/heads/master 66a7d6b30 -> ccda75b0d [SPARK-22921][PROJECT-INFRA] Bug fix in jira assigning Small bug fix from last pr, ran a successful merge with this code. Author: Imran Rashid Closes #20117 from squito/SPARK-22921.

svn commit: r23948 - in /dev/spark/2.3.0-SNAPSHOT-2017_12_29_12_01-66a7d6b-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _s

Author: pwendell Date: Fri Dec 29 20:14:47 2017 New Revision: 23948 Log: Apache Spark 2.3.0-SNAPSHOT-2017_12_29_12_01-66a7d6b docs [This commit notification would consist of 1425 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.]

spark git commit: [SPARK-22920][SPARKR] sql functions for current_date, current_timestamp, rtrim/ltrim/trim with trimString

Repository: spark Updated Branches: refs/heads/master afc364146 -> 66a7d6b30 [SPARK-22920][SPARKR] sql functions for current_date, current_timestamp, rtrim/ltrim/trim with trimString ## What changes were proposed in this pull request? Add sql functions ## How was this patch tested?

spark git commit: [SPARK-22905][ML][FOLLOWUP] Fix GaussianMixtureModel save

Repository: spark Updated Branches: refs/heads/master 4e9e6aee4 -> afc364146 [SPARK-22905][ML][FOLLOWUP] Fix GaussianMixtureModel save ## What changes were proposed in this pull request? make sure model data is stored in order. WeichenXu123 ## How was this patch tested? existing tests

spark git commit: [SPARK-22864][CORE] Disable allocation schedule in ExecutorAllocationManagerSuite.

Repository: spark Updated Branches: refs/heads/master 8b497046c -> 4e9e6aee4 [SPARK-22864][CORE] Disable allocation schedule in ExecutorAllocationManagerSuite. The scheduled task was racing with the test code and could influence the values returned to the test, triggering assertions. The

spark git commit: [SPARK-20654][CORE] Add config to limit disk usage of the history server.

Repository: spark Updated Branches: refs/heads/master 11a849b3a -> 8b497046c [SPARK-20654][CORE] Add config to limit disk usage of the history server. This change adds a new configuration option and support code that limits how much disk space the SHS will use. The default value is pretty

svn commit: r23946 - in /dev/spark/2.3.0-SNAPSHOT-2017_12_29_08_01-11a849b-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _s

Author: pwendell Date: Fri Dec 29 16:20:09 2017 New Revision: 23946 Log: Apache Spark 2.3.0-SNAPSHOT-2017_12_29_08_01-11a849b docs [This commit notification would consist of 1425 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.]

spark git commit: [SPARK-22370][SQL][PYSPARK][FOLLOW-UP] Fix a test failure when xmlrunner is installed.

Repository: spark Updated Branches: refs/heads/master dbd492b7e -> 11a849b3a [SPARK-22370][SQL][PYSPARK][FOLLOW-UP] Fix a test failure when xmlrunner is installed. ## What changes were proposed in this pull request? This is a follow-up pr of #19587. If `xmlrunner` is installed,

spark git commit: [SPARK-22921][PROJECT-INFRA] Choices for Assigning Jira on Merge

Repository: spark Updated Branches: refs/heads/master fcf66a327 -> dbd492b7e [SPARK-22921][PROJECT-INFRA] Choices for Assigning Jira on Merge In general jiras are assigned to the original reporter or one of the commentors. This updates the merge script to give you a simple choice to do that,

spark git commit: [SPARK-21657][SQL] optimize explode quadratic memory consumpation

Repository: spark Updated Branches: refs/heads/master cc30ef800 -> fcf66a327 [SPARK-21657][SQL] optimize explode quadratic memory consumpation ## What changes were proposed in this pull request? The issue has been raised in two Jira tickets:

svn commit: r23944 - in /dev/spark/2.3.0-SNAPSHOT-2017_12_29_04_01-cc30ef8-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _s

Author: pwendell Date: Fri Dec 29 12:19:07 2017 New Revision: 23944 Log: Apache Spark 2.3.0-SNAPSHOT-2017_12_29_04_01-cc30ef8 docs [This commit notification would consist of 1425 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.]

spark git commit: [SPARK-22916][SQL] shouldn't bias towards build right if user does not specify

Repository: spark Updated Branches: refs/heads/master 224375c55 -> cc30ef800 [SPARK-22916][SQL] shouldn't bias towards build right if user does not specify ## What changes were proposed in this pull request? When there are no broadcast hints, the current spark strategies will prefer to

svn commit: r23943 - in /dev/spark/2.3.0-SNAPSHOT-2017_12_29_00_01-224375c-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _s

Author: pwendell Date: Fri Dec 29 08:15:45 2017 New Revision: 23943 Log: Apache Spark 2.3.0-SNAPSHOT-2017_12_29_00_01-224375c docs [This commit notification would consist of 1425 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.]