spark git commit: [SPARK-11126][SQL] Fix the potential flaky test

Repository: spark Updated Branches: refs/heads/master d3180c25d -> beb8bc1ea [SPARK-11126][SQL] Fix the potential flaky test The unit test added in #9132 is flaky. This is a follow up PR to add `listenerBus.waitUntilEmpty` to fix it. Author: zsxwing Closes #9163 from

spark git commit: [SPARK-11126][SQL] Fix the potential flaky test

Repository: spark Updated Branches: refs/heads/branch-1.5 803339ca4 -> 648074096 [SPARK-11126][SQL] Fix the potential flaky test The unit test added in #9132 is flaky. This is a follow up PR to add `listenerBus.waitUntilEmpty` to fix it. Author: zsxwing Closes #9163

spark git commit: [SPARK-10921][YARN] Completely remove the use of SparkContext.prefer…

Repository: spark Updated Branches: refs/heads/master beb8bc1ea -> bd64c2d55 [SPARK-10921][YARN] Completely remove the use of SparkContext.prefer… …redNodeLocationData Author: Jacek Laskowski Closes #8976 from jaceklaskowski/SPARK-10921. Project:

spark git commit: [SPARK-11180][SQL] Support BooleanType in DataFrame.na.fill

Repository: spark Updated Branches: refs/heads/master 7893cd95d -> 596681794 [SPARK-11180][SQL] Support BooleanType in DataFrame.na.fill Added support for boolean types in fill and replace methods Author: Rishabh Bhardwaj Closes #9166 from rishabhbhardwaj/master.

spark git commit: [SPARK-11119] [SQL] cleanup for unsafe array and map

Repository: spark Updated Branches: refs/heads/master 4c33a34ba -> 7893cd95d [SPARK-9] [SQL] cleanup for unsafe array and map The purpose of this PR is to keep the unsafe format detail only inside the unsafe class itself, so when we use them(like use unsafe array in unsafe map, use

spark git commit: [SPARK-10668] [ML] Use WeightedLeastSquares in LinearRegression with L…

Repository: spark Updated Branches: refs/heads/master dfa41e63b -> 4c33a34ba [SPARK-10668] [ML] Use WeightedLeastSquares in LinearRegression with L… …2 regularization if the number of features is small Author: lewuathe Author: Lewuathe Author:

spark git commit: [SPARK-11063] [STREAMING] Change preferredLocations of Receiver's RDD to hosts rather than hostports

Repository: spark Updated Branches: refs/heads/master 596681794 -> 67582132b [SPARK-11063] [STREAMING] Change preferredLocations of Receiver's RDD to hosts rather than hostports The format of RDD's preferredLocations must be hostname but the format of Streaming Receiver's scheduling

spark git commit: [SPARK-11114][PYSPARK] add getOrCreate for SparkContext/SQLContext in Python

Repository: spark Updated Branches: refs/heads/master a1413b366 -> 232d7f8d4 [SPARK-4][PYSPARK] add getOrCreate for SparkContext/SQLContext in Python Also added SQLContext.newSession() Author: Davies Liu Closes #9122 from davies/py_create. Project:

spark git commit: [SPARK-9708][MESOS] Spark should create local temporary directories in Mesos sandbox when launched with Mesos

Repository: spark Updated Branches: refs/heads/master 232d7f8d4 -> fc26f32cf [SPARK-9708][MESOS] Spark should create local temporary directories in Mesos sandbox when launched with Mesos This is my own original work and I license this to the project under the project's open source license

spark git commit: [SPARK-11131][CORE] Fix race in worker registration protocol.

Repository: spark Updated Branches: refs/heads/master 67582132b -> 7ab0ce650 [SPARK-11131][CORE] Fix race in worker registration protocol. Because the registration RPC was not really an RPC, but a bunch of disconnected messages, it was possible for other messages to be sent before the reply

spark git commit: [SPARK-11120] Allow sane default number of executor failures when dynamically allocating in YARN

Repository: spark Updated Branches: refs/heads/master fc26f32cf -> 16906ef23 [SPARK-11120] Allow sane default number of executor failures when dynamically allocating in YARN I also added some information to container-failure error msgs about what host they failed on, which would have helped

spark git commit: [SPARK-11063] [STREAMING] Change preferredLocations of Receiver's RDD to hosts rather than hostports

Repository: spark Updated Branches: refs/heads/branch-1.5 648074096 -> 5186ec8ac [SPARK-11063] [STREAMING] Change preferredLocations of Receiver's RDD to hosts rather than hostports The format of RDD's preferredLocations must be hostname but the format of Streaming Receiver's scheduling

spark git commit: [SPARK-11051][CORE] Do not allow local checkpointing after the RDD is materialized and checkpointed

Repository: spark Updated Branches: refs/heads/master 7ab0ce650 -> a1413b366 [SPARK-11051][CORE] Do not allow local checkpointing after the RDD is materialized and checkpointed JIRA: https://issues.apache.org/jira/browse/SPARK-11051 When a `RDD` is materialized and checkpointed, its

spark git commit: [SPARK-11051][CORE] Do not allow local checkpointing after the RDD is materialized and checkpointed

Repository: spark Updated Branches: refs/heads/branch-1.5 5186ec8ac -> 2195fec12 [SPARK-11051][CORE] Do not allow local checkpointing after the RDD is materialized and checkpointed JIRA: https://issues.apache.org/jira/browse/SPARK-11051 When a `RDD` is materialized and checkpointed, its

spark git commit: [SPARK-11088][SQL] Merges partition values using UnsafeProjection

Repository: spark Updated Branches: refs/heads/master 16906ef23 -> 8b877cc4e [SPARK-11088][SQL] Merges partition values using UnsafeProjection `DataSourceStrategy.mergeWithPartitionValues` is essentially a projection implemented in a quite inefficient way. This PR optimizes this method with

spark git commit: [HOT-FIX] Remove unnessary changed introduced by the backport of SPARK-10577 (https://github.com/apache/spark/commit/30eea40fff97391b8ee3201dd7c6ea7440521386).

Repository: spark Updated Branches: refs/heads/branch-1.5 2195fec12 -> a3ab67146 [HOT-FIX] Remove unnessary changed introduced by the backport of SPARK-10577 (https://github.com/apache/spark/commit/30eea40fff97391b8ee3201dd7c6ea7440521386). Project:

spark git commit: [SPARK-9643] Upgrade pyrolite to 4.9

Repository: spark Updated Branches: refs/heads/master bd64c2d55 -> dfa41e63b [SPARK-9643] Upgrade pyrolite to 4.9 Includes: https://github.com/irmen/Pyrolite/pull/23 which fixes datetimes with timezones. JoshRosen https://issues.apache.org/jira/browse/SPARK-9643 Author: Alex Angelini