spark git commit: [SPARK-15354][FLAKY-TEST] TopologyAwareBlockReplicationPolicyBehavior.Peers in 2 racks

2017-04-12 Thread wenchen
Repository: spark Updated Branches: refs/heads/master 924c42477 -> a7b430b57 [SPARK-15354][FLAKY-TEST] TopologyAwareBlockReplicationPolicyBehavior.Peers in 2 racks ## What changes were proposed in this pull request? `TopologyAwareBlockReplicationPolicyBehavior.Peers in 2 racks` is failing o

spark git commit: [SPARK-20131][CORE] Don't use `this` lock in StandaloneSchedulerBackend.stop

2017-04-12 Thread zsxwing
Repository: spark Updated Branches: refs/heads/branch-2.1 7e0ddda34 -> be36c2f1e [SPARK-20131][CORE] Don't use `this` lock in StandaloneSchedulerBackend.stop ## What changes were proposed in this pull request? `o.a.s.streaming.StreamingContextSuite.SPARK-18560 Receiver data should be deseria

spark git commit: [SPARK-20131][CORE] Don't use `this` lock in StandaloneSchedulerBackend.stop

2017-04-12 Thread zsxwing
Repository: spark Updated Branches: refs/heads/master a7b430b57 -> c5f1cc370 [SPARK-20131][CORE] Don't use `this` lock in StandaloneSchedulerBackend.stop ## What changes were proposed in this pull request? `o.a.s.streaming.StreamingContextSuite.SPARK-18560 Receiver data should be deserialize

spark git commit: [SPARK-20301][FLAKY-TEST] Fix Hadoop Shell.runCommand flakiness in Structured Streaming tests

2017-04-12 Thread tdas
Repository: spark Updated Branches: refs/heads/master 99a947312 -> 924c42477 [SPARK-20301][FLAKY-TEST] Fix Hadoop Shell.runCommand flakiness in Structured Streaming tests ## What changes were proposed in this pull request? Some Structured Streaming tests show flakiness such as: ``` [info] -

spark git commit: [SPARK-19570][PYSPARK] Allow to disable hive in pyspark shell

2017-04-12 Thread holden
Repository: spark Updated Branches: refs/heads/master 540855382 -> 99a947312 [SPARK-19570][PYSPARK] Allow to disable hive in pyspark shell ## What changes were proposed in this pull request? SPARK-15236 do this for scala shell, this ticket is for pyspark shell. This is not only for pyspark i

spark git commit: [SPARK-20291][SQL][BACKPORT] NaNvl(FloatType, NullType) should not be cast to N…

2017-04-12 Thread lixiao
Repository: spark Updated Branches: refs/heads/branch-2.0 123a758ce -> 24f6ef25a [SPARK-20291][SQL][BACKPORT] NaNvl(FloatType, NullType) should not be cast to N… …aNvl(DoubleType, DoubleType) ## What changes were proposed in this pull request? This is a backport of https://github.com/ap

spark git commit: [SPARK-20304][SQL] AssertNotNull should not include path in string representation

2017-04-12 Thread lixiao
Repository: spark Updated Branches: refs/heads/branch-2.1 dbb6d1b44 -> 7e0ddda34 [SPARK-20304][SQL] AssertNotNull should not include path in string representation ## What changes were proposed in this pull request? AssertNotNull's toString/simpleString dumps the entire walkedTypePath. walked

spark git commit: [SPARK-20304][SQL] AssertNotNull should not include path in string representation

2017-04-12 Thread lixiao
Repository: spark Updated Branches: refs/heads/master 504e62e2f -> 540855382 [SPARK-20304][SQL] AssertNotNull should not include path in string representation ## What changes were proposed in this pull request? AssertNotNull's toString/simpleString dumps the entire walkedTypePath. walkedType

spark git commit: [SPARK-20303][SQL] Rename createTempFunction to registerFunction

2017-04-12 Thread lixiao
Repository: spark Updated Branches: refs/heads/master ceaf77ae4 -> 504e62e2f [SPARK-20303][SQL] Rename createTempFunction to registerFunction ### What changes were proposed in this pull request? Session catalog API `createTempFunction` is being used by Hive build-in functions, persistent func

spark git commit: [SPARK-18692][BUILD][DOCS] Test Java 8 unidoc build on Jenkins

2017-04-12 Thread srowen
Repository: spark Updated Branches: refs/heads/master 2e1fd46e1 -> ceaf77ae4 [SPARK-18692][BUILD][DOCS] Test Java 8 unidoc build on Jenkins ## What changes were proposed in this pull request? This PR proposes to run Spark unidoc to test Javadoc 8 build as Javadoc 8 is easily re-breakable. T

spark git commit: [SPARK-20296][TRIVIAL][DOCS] Count distinct error message for streaming

2017-04-12 Thread srowen
Repository: spark Updated Branches: refs/heads/branch-2.1 b2970d971 -> dbb6d1b44 [SPARK-20296][TRIVIAL][DOCS] Count distinct error message for streaming ## What changes were proposed in this pull request? Update count distinct error message for streaming datasets/dataframes to match current b

spark git commit: [SPARK-20296][TRIVIAL][DOCS] Count distinct error message for streaming

2017-04-12 Thread srowen
Repository: spark Updated Branches: refs/heads/master ffc57b011 -> 2e1fd46e1 [SPARK-20296][TRIVIAL][DOCS] Count distinct error message for streaming ## What changes were proposed in this pull request? Update count distinct error message for streaming datasets/dataframes to match current behav

spark git commit: [SPARK-20302][SQL] Short circuit cast when from and to types are structurally the same

2017-04-12 Thread rxin
Repository: spark Updated Branches: refs/heads/master 044f7ecbf -> ffc57b011 [SPARK-20302][SQL] Short circuit cast when from and to types are structurally the same ## What changes were proposed in this pull request? When we perform a cast expression and the from and to types are structurally

spark git commit: [SPARK-20298][SPARKR][MINOR] fixed spelling mistake "charactor"

2017-04-12 Thread srowen
Repository: spark Updated Branches: refs/heads/master bca4259f1 -> 044f7ecbf [SPARK-20298][SPARKR][MINOR] fixed spelling mistake "charactor" ## What changes were proposed in this pull request? Fixed spelling of "charactor" ## How was this patch tested? Spelling change only Author: Brendan

spark git commit: [MINOR][DOCS] JSON APIs related documentation fixes

2017-04-12 Thread srowen
Repository: spark Updated Branches: refs/heads/master b93843824 -> bca4259f1 [MINOR][DOCS] JSON APIs related documentation fixes ## What changes were proposed in this pull request? This PR proposes corrections related to JSON APIs as below: - Rendering links in Python documentation - Replaci

spark git commit: [MINOR][DOCS] Fix spacings in Structured Streaming Programming Guide

2017-04-12 Thread srowen
Repository: spark Updated Branches: refs/heads/branch-2.1 46e212d2f -> b2970d971 [MINOR][DOCS] Fix spacings in Structured Streaming Programming Guide ## What changes were proposed in this pull request? 1. Omitted space between the sentences: `... on static data.The Spark SQL engine will ...`

spark git commit: [MINOR][DOCS] Fix spacings in Structured Streaming Programming Guide

2017-04-12 Thread srowen
Repository: spark Updated Branches: refs/heads/master b14bfc3f8 -> b93843824 [MINOR][DOCS] Fix spacings in Structured Streaming Programming Guide ## What changes were proposed in this pull request? 1. Omitted space between the sentences: `... on static data.The Spark SQL engine will ...` ->