spark git commit: [SPARK-18555][MINOR][SQL] Fix the @since tag when backporting from 2.2 branch into 2.1 branch

2017-04-10 Thread dbtsai
Repository: spark Updated Branches: refs/heads/branch-2.1 8eb71b81f -> 03a42c012 [SPARK-18555][MINOR][SQL] Fix the @since tag when backporting from 2.2 branch into 2.1 branch ## What changes were proposed in this pull request? Fix the since tag when backporting critical bugs (SPARK-18555)

spark git commit: [MINOR][SQL] Fix the @since tag when backporting SPARK-18555 from 2.2 branch into 2.0 branch

2017-04-10 Thread dbtsai
Repository: spark Updated Branches: refs/heads/branch-2.0 aec37529f -> 123a758ce [MINOR][SQL] Fix the @since tag when backporting SPARK-18555 from 2.2 branch into 2.0 branch ## What changes were proposed in this pull request? Fix the since tag when backporting critical bugs (SPARK-18555)

spark git commit: [SPARK-17564][TESTS] Fix flaky RequestTimeoutIntegrationSuite.furtherRequestsDelay

2017-04-10 Thread rxin
Repository: spark Updated Branches: refs/heads/branch-2.1 f40e44de8 -> 8eb71b81f [SPARK-17564][TESTS] Fix flaky RequestTimeoutIntegrationSuite.furtherRequestsDelay ## What changes were proposed in this pull request? This PR fixs the following failure: ``` sbt.ForkMain$ForkError:

spark git commit: [SPARK-17564][TESTS] Fix flaky RequestTimeoutIntegrationSuite.furtherRequestsDelay

2017-04-10 Thread rxin
Repository: spark Updated Branches: refs/heads/master 379b0b0bb -> 734dfbfcf [SPARK-17564][TESTS] Fix flaky RequestTimeoutIntegrationSuite.furtherRequestsDelay ## What changes were proposed in this pull request? This PR fixs the following failure: ``` sbt.ForkMain$ForkError:

spark git commit: [SPARK-20270][SQL] na.fill should not change the values in long or integer when the default value is in double

2017-04-10 Thread dbtsai
Repository: spark Updated Branches: refs/heads/branch-2.0 735e2039a -> aec37529f [SPARK-20270][SQL] na.fill should not change the values in long or integer when the default value is in double ## What changes were proposed in this pull request? This bug was partially addressed in SPARK-18555

spark git commit: [SPARK-20270][SQL] na.fill should not change the values in long or integer when the default value is in double

2017-04-10 Thread dbtsai
Repository: spark Updated Branches: refs/heads/branch-2.1 b26f2c2c6 -> f40e44de8 [SPARK-20270][SQL] na.fill should not change the values in long or integer when the default value is in double ## What changes were proposed in this pull request? This bug was partially addressed in SPARK-18555

spark git commit: [SPARK-18555][SQL] DataFrameNaFunctions.fill miss up original values in long integers

2017-04-10 Thread dbtsai
Repository: spark Updated Branches: refs/heads/branch-2.0 87be9652b -> 735e2039a [SPARK-18555][SQL] DataFrameNaFunctions.fill miss up original values in long integers ## What changes were proposed in this pull request? DataSet.na.fill(0) used on a DataSet which has a long value column,

spark git commit: [SPARK-18555][SQL] DataFrameNaFunctions.fill miss up original values in long integers

2017-04-10 Thread dbtsai
Repository: spark Updated Branches: refs/heads/branch-2.1 489c1f357 -> b26f2c2c6 [SPARK-18555][SQL] DataFrameNaFunctions.fill miss up original values in long integers ## What changes were proposed in this pull request? DataSet.na.fill(0) used on a DataSet which has a long value column,

spark git commit: [SPARK-20283][SQL] Add preOptimizationBatches

2017-04-10 Thread rxin
Repository: spark Updated Branches: refs/heads/master a35b9d971 -> 379b0b0bb [SPARK-20283][SQL] Add preOptimizationBatches ## What changes were proposed in this pull request? We currently have postHocOptimizationBatches, but not preOptimizationBatches. This patch adds preOptimizationBatches

spark git commit: [SPARK-20282][SS][TESTS] Write the commit log first to fix a race contion in tests

2017-04-10 Thread zsxwing
Repository: spark Updated Branches: refs/heads/master f9a50ba2d -> a35b9d971 [SPARK-20282][SS][TESTS] Write the commit log first to fix a race contion in tests ## What changes were proposed in this pull request? This PR fixes the following failure: ``` sbt.ForkMain$ForkError:

spark git commit: [SPARK-20285][TESTS] Increase the pyspark streaming test timeout to 30 seconds

2017-04-10 Thread zsxwing
Repository: spark Updated Branches: refs/heads/branch-2.0 a0b499f60 -> 87be9652b [SPARK-20285][TESTS] Increase the pyspark streaming test timeout to 30 seconds ## What changes were proposed in this pull request? Saw the following failure locally: ``` Traceback (most recent call last):

spark git commit: [SPARK-20285][TESTS] Increase the pyspark streaming test timeout to 30 seconds

2017-04-10 Thread zsxwing
Repository: spark Updated Branches: refs/heads/branch-2.1 bc7304e1f -> 489c1f357 [SPARK-20285][TESTS] Increase the pyspark streaming test timeout to 30 seconds ## What changes were proposed in this pull request? Saw the following failure locally: ``` Traceback (most recent call last):

spark git commit: [SPARK-20285][TESTS] Increase the pyspark streaming test timeout to 30 seconds

2017-04-10 Thread zsxwing
Repository: spark Updated Branches: refs/heads/master f6dd8e0e1 -> f9a50ba2d [SPARK-20285][TESTS] Increase the pyspark streaming test timeout to 30 seconds ## What changes were proposed in this pull request? Saw the following failure locally: ``` Traceback (most recent call last): File

spark git commit: [SPARK-20280][CORE] FileStatusCache Weigher integer overflow

2017-04-10 Thread hvanhovell
Repository: spark Updated Branches: refs/heads/branch-2.1 1a73046b4 -> bc7304e1f [SPARK-20280][CORE] FileStatusCache Weigher integer overflow ## What changes were proposed in this pull request? Weigher.weigh needs to return Int but it is possible for an Array[FileStatus] to have size >

spark git commit: [SPARK-20280][CORE] FileStatusCache Weigher integer overflow

2017-04-10 Thread hvanhovell
Repository: spark Updated Branches: refs/heads/master a26e3ed5e -> f6dd8e0e1 [SPARK-20280][CORE] FileStatusCache Weigher integer overflow ## What changes were proposed in this pull request? Weigher.weigh needs to return Int but it is possible for an Array[FileStatus] to have size >

[2/3] spark git commit: [SPARK-20156][CORE][SQL][STREAMING][MLLIB] Java String toLowerCase "Turkish locale bug" causes Spark problems

2017-04-10 Thread srowen
http://git-wip-us.apache.org/repos/asf/spark/blob/a26e3ed5/sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/mathExpressions.scala -- diff --git

[3/3] spark git commit: [SPARK-20156][CORE][SQL][STREAMING][MLLIB] Java String toLowerCase "Turkish locale bug" causes Spark problems

2017-04-10 Thread srowen
[SPARK-20156][CORE][SQL][STREAMING][MLLIB] Java String toLowerCase "Turkish locale bug" causes Spark problems ## What changes were proposed in this pull request? Add Locale.ROOT to internal calls to String `toLowerCase`, `toUpperCase`, to avoid inadvertent locale-sensitive variation in

[1/3] spark git commit: [SPARK-20156][CORE][SQL][STREAMING][MLLIB] Java String toLowerCase "Turkish locale bug" causes Spark problems

2017-04-10 Thread srowen
Repository: spark Updated Branches: refs/heads/master fd711ea13 -> a26e3ed5e http://git-wip-us.apache.org/repos/asf/spark/blob/a26e3ed5/sql/hive-thriftserver/src/main/scala/org/apache/spark/sql/hive/thriftserver/SparkSQLCLIDriver.scala

spark git commit: [SPARK-20273][SQL] Disallow Non-deterministic Filter push-down into Join Conditions

2017-04-10 Thread lixiao
Repository: spark Updated Branches: refs/heads/master 5acaf8c0c -> fd711ea13 [SPARK-20273][SQL] Disallow Non-deterministic Filter push-down into Join Conditions ## What changes were proposed in this pull request? ``` sql("SELECT t1.b, rand(0) as r FROM cachedData, cachedData t1 GROUP BY t1.b

spark git commit: [SPARK-19518][SQL] IGNORE NULLS in first / last in SQL

2017-04-10 Thread hvanhovell
Repository: spark Updated Branches: refs/heads/master 4f7d49b95 -> 5acaf8c0c [SPARK-19518][SQL] IGNORE NULLS in first / last in SQL ## What changes were proposed in this pull request? This PR proposes to add `IGNORE NULLS` keyword in `first`/`last` in Spark's parser likewise

spark git commit: [SPARK-20243][TESTS] DebugFilesystem.assertNoOpenStreams thread race

2017-04-10 Thread hvanhovell
Repository: spark Updated Branches: refs/heads/master 3d7f201f2 -> 4f7d49b95 [SPARK-20243][TESTS] DebugFilesystem.assertNoOpenStreams thread race ## What changes were proposed in this pull request? Synchronize access to openStreams map. ## How was this patch tested? Existing tests.

spark-website git commit: Add R code style guide

2017-04-10 Thread srowen
Repository: spark-website Updated Branches: refs/heads/asf-site 8b27c470c -> d39c4ecac Add R code style guide Project: http://git-wip-us.apache.org/repos/asf/spark-website/repo Commit: http://git-wip-us.apache.org/repos/asf/spark-website/commit/d39c4eca Tree: