spark git commit: [SPARK-18566][SQL] remove OverwriteOptions

Repository: spark Updated Branches: refs/heads/master f2ddabfa0 -> 3e307b495 [SPARK-18566][SQL] remove OverwriteOptions ## What changes were proposed in this pull request? `OverwriteOptions` was introduced in https://github.com/apache/spark/pull/15705, to carry the information of static

spark git commit: [MINOR][SPARKR] fix kstest example error and add unit test

Repository: spark Updated Branches: refs/heads/master e104e55c1 -> f2ddabfa0 [MINOR][SPARKR] fix kstest example error and add unit test ## What changes were proposed in this pull request? While adding vignettes for kstest, I found some errors in the example: 1. There is a typo of kstest; 2.

spark git commit: [MINOR][SPARKR] fix kstest example error and add unit test

Repository: spark Updated Branches: refs/heads/branch-2.1 019d1fa3d -> 8ef005931 [MINOR][SPARKR] fix kstest example error and add unit test ## What changes were proposed in this pull request? While adding vignettes for kstest, I found some errors in the example: 1. There is a typo of kstest;

spark git commit: [SPARK-18588][TESTS] Ignore KafkaSourceStressForDontFailOnDataLossSuite

Repository: spark Updated Branches: refs/heads/branch-2.1 5693ac8e5 -> 019d1fa3d [SPARK-18588][TESTS] Ignore KafkaSourceStressForDontFailOnDataLossSuite ## What changes were proposed in this pull request? Disable KafkaSourceStressForDontFailOnDataLossSuite for now. ## How was this patch

spark git commit: [SPARK-18588][TESTS] Ignore KafkaSourceStressForDontFailOnDataLossSuite

Repository: spark Updated Branches: refs/heads/master 3ae63b808 -> e104e55c1 [SPARK-18588][TESTS] Ignore KafkaSourceStressForDontFailOnDataLossSuite ## What changes were proposed in this pull request? Disable KafkaSourceStressForDontFailOnDataLossSuite for now. ## How was this patch tested?

spark git commit: [SPARK-18752][SQL] Follow-up: add scaladoc explaining isSrcLocal arg.

Repository: spark Updated Branches: refs/heads/master ae5b2d3e4 -> 3ae63b808 [SPARK-18752][SQL] Follow-up: add scaladoc explaining isSrcLocal arg. Author: Marcelo Vanzin Closes #16257 from vanzin/SPARK-18752.2. Project:

spark git commit: [SPARK-18746][SQL] Add implicit encoder for BigDecimal, timestamp and date

Repository: spark Updated Branches: refs/heads/master 594b14f1e -> ae5b2d3e4 [SPARK-18746][SQL] Add implicit encoder for BigDecimal, timestamp and date ## What changes were proposed in this pull request? Add implicit encoders for BigDecimal, timestamp and date. ## How was this patch tested?

spark git commit: [SPARK-18793][SPARK-18794][R] add spark.randomForest/spark.gbt to vignettes

Repository: spark Updated Branches: refs/heads/branch-2.1 25b97589e -> 5693ac8e5 [SPARK-18793][SPARK-18794][R] add spark.randomForest/spark.gbt to vignettes ## What changes were proposed in this pull request? Mention `spark.randomForest` and `spark.gbt` in vignettes. Keep the content

spark git commit: [SPARK-18793][SPARK-18794][R] add spark.randomForest/spark.gbt to vignettes

Repository: spark Updated Branches: refs/heads/master c68fb426d -> 594b14f1e [SPARK-18793][SPARK-18794][R] add spark.randomForest/spark.gbt to vignettes ## What changes were proposed in this pull request? Mention `spark.randomForest` and `spark.gbt` in vignettes. Keep the content minimal

spark git commit: [SPARK-18834][SS] Expose event time stats through StreamingQueryProgress

Repository: spark Updated Branches: refs/heads/branch-2.1 f672bfdf9 -> 25b97589e [SPARK-18834][SS] Expose event time stats through StreamingQueryProgress ## What changes were proposed in this pull request? - Changed `StreamingQueryProgress.watermark` to

spark git commit: [SPARK-18834][SS] Expose event time stats through StreamingQueryProgress

Repository: spark Updated Branches: refs/heads/master aebf44e50 -> c68fb426d [SPARK-18834][SS] Expose event time stats through StreamingQueryProgress ## What changes were proposed in this pull request? - Changed `StreamingQueryProgress.watermark` to `StreamingQueryProgress.queryTimestamps`

spark git commit: [SPARK-18843][CORE] Fix timeout in awaitResultInForkJoinSafely (branch 2.1, 2.0)

Repository: spark Updated Branches: refs/heads/branch-2.0 06f592c39 -> 1d5c7f452 [SPARK-18843][CORE] Fix timeout in awaitResultInForkJoinSafely (branch 2.1, 2.0) ## What changes were proposed in this pull request? This PR fixes the timeout value in `awaitResultInForkJoinSafely` for 2.1 and

spark git commit: [SPARK-18843][CORE] Fix timeout in awaitResultInForkJoinSafely (branch 2.1, 2.0)

Repository: spark Updated Branches: refs/heads/branch-2.1 292a37f24 -> f672bfdf9 [SPARK-18843][CORE] Fix timeout in awaitResultInForkJoinSafely (branch 2.1, 2.0) ## What changes were proposed in this pull request? This PR fixes the timeout value in `awaitResultInForkJoinSafely` for 2.1 and

spark git commit: [SPARK-18816][WEB UI] Executors Logs column only ran visibility check on initial table load

Repository: spark Updated Branches: refs/heads/branch-2.1 d5c4a5d06 -> 292a37f24 [SPARK-18816][WEB UI] Executors Logs column only ran visibility check on initial table load ## What changes were proposed in this pull request? When I added a visibility check for the logs column on the

spark git commit: [SPARK-18816][WEB UI] Executors Logs column only ran visibility check on initial table load

Repository: spark Updated Branches: refs/heads/master 9e8a9d7c6 -> aebf44e50 [SPARK-18816][WEB UI] Executors Logs column only ran visibility check on initial table load ## What changes were proposed in this pull request? When I added a visibility check for the logs column on the executors

spark git commit: [SPARK-18471][MLLIB] In LBFGS, avoid sending huge vectors of 0

Repository: spark Updated Branches: refs/heads/master e57e3938c -> 9e8a9d7c6 [SPARK-18471][MLLIB] In LBFGS, avoid sending huge vectors of 0 ## What changes were proposed in this pull request? CostFun used to send a dense vector of zeroes as a closure in a treeAggregate call. To avoid that,

spark git commit: [SPARK-18715][ML] Fix AIC calculations in Binomial GLM

Repository: spark Updated Branches: refs/heads/master 43298d157 -> e57e3938c [SPARK-18715][ML] Fix AIC calculations in Binomial GLM The AIC calculation in Binomial GLM seems to be off when the response or weight is non-integer: the result is different from that in R. This issue arises when

spark git commit: [SPARK-18840][YARN] Avoid throw exception when getting token renewal interval in non HDFS security environment

Repository: spark Updated Branches: refs/heads/branch-2.1 207107bca -> d5c4a5d06 [SPARK-18840][YARN] Avoid throw exception when getting token renewal interval in non HDFS security environment ## What changes were proposed in this pull request? Fix `java.util.NoSuchElementException` when

spark git commit: [SPARK-18840][YARN] Avoid throw exception when getting token renewal interval in non HDFS security environment

Repository: spark Updated Branches: refs/heads/master 5572ccf86 -> 43298d157 [SPARK-18840][YARN] Avoid throw exception when getting token renewal interval in non HDFS security environment ## What changes were proposed in this pull request? Fix `java.util.NoSuchElementException` when running

spark git commit: [SPARK-17932][SQL][FOLLOWUP] Change statement `SHOW TABLES EXTENDED` to `SHOW TABLE EXTENDED`

Repository: spark Updated Branches: refs/heads/master f280ccf44 -> 5572ccf86 [SPARK-17932][SQL][FOLLOWUP] Change statement `SHOW TABLES EXTENDED` to `SHOW TABLE EXTENDED` ## What changes were proposed in this pull request? Change the statement `SHOW TABLES [EXTENDED] [(IN|FROM)

spark git commit: [SPARK-18835][SQL] Don't expose Guava types in the JavaTypeInference API.

Repository: spark Updated Branches: refs/heads/master fb3081d3b -> f280ccf44 [SPARK-18835][SQL] Don't expose Guava types in the JavaTypeInference API. This avoids issues during maven tests because of shading. Author: Marcelo Vanzin Closes #16260 from

spark git commit: [SPARK-18835][SQL] Don't expose Guava types in the JavaTypeInference API.

Repository: spark Updated Branches: refs/heads/branch-2.1 9f0e3be62 -> 207107bca [SPARK-18835][SQL] Don't expose Guava types in the JavaTypeInference API. This avoids issues during maven tests because of shading. Author: Marcelo Vanzin Closes #16260 from

spark git commit: [SPARK-13747][CORE] Fix potential ThreadLocal leaks in RPC when using ForkJoinPool

Repository: spark Updated Branches: refs/heads/master d53f18cae -> fb3081d3b [SPARK-13747][CORE] Fix potential ThreadLocal leaks in RPC when using ForkJoinPool ## What changes were proposed in this pull request? Some places in SQL may call `RpcEndpointRef.askWithRetry` (e.g.,

spark git commit: [SPARK-18675][SQL] CTAS for hive serde table should work for all hive versions

Repository: spark Updated Branches: refs/heads/master 096f868b7 -> d53f18cae [SPARK-18675][SQL] CTAS for hive serde table should work for all hive versions ## What changes were proposed in this pull request? Before hive 1.1, when inserting into a table, hive will create the staging

spark git commit: [MINOR][CORE][SQL] Remove explicit RDD and Partition overrides

Repository: spark Updated Branches: refs/heads/master 46d30ac48 -> 096f868b7 [MINOR][CORE][SQL] Remove explicit RDD and Partition overrides ## What changes were proposed in this pull request? I **believe** that I _only_ removed duplicated code (that adds nothing but noise). I'm gonna remove