spark git commit: [SPARK-19925][SPARKR] Fix SparkR spark.getSparkFiles fails when it was called on executors.

2017-03-21 Thread yliang
Repository: spark Updated Branches: refs/heads/branch-2.1 c4d2b8338 -> 277ed375b [SPARK-19925][SPARKR] Fix SparkR spark.getSparkFiles fails when it was called on executors. ## What changes were proposed in this pull request? SparkR ```spark.getSparkFiles``` fails when it was called on

spark git commit: [SPARK-19925][SPARKR] Fix SparkR spark.getSparkFiles fails when it was called on executors.

2017-03-21 Thread yliang
Repository: spark Updated Branches: refs/heads/master c1e87e384 -> 478fbc866 [SPARK-19925][SPARKR] Fix SparkR spark.getSparkFiles fails when it was called on executors. ## What changes were proposed in this pull request? SparkR ```spark.getSparkFiles``` fails when it was called on executors,

spark git commit: [SPARK-20030][SS] Event-time-based timeout for MapGroupsWithState

2017-03-21 Thread tdas
Repository: spark Updated Branches: refs/heads/master 2d73fcced -> c1e87e384 [SPARK-20030][SS] Event-time-based timeout for MapGroupsWithState ## What changes were proposed in this pull request? Adding event time based timeout. The user sets the timeout timestamp directly using

spark git commit: [SPARK-20051][SS] Fix StreamSuite flaky test - recover from v2.1 checkpoint

2017-03-21 Thread tdas
Repository: spark Updated Branches: refs/heads/master 9281a3d50 -> 2d73fcced [SPARK-20051][SS] Fix StreamSuite flaky test - recover from v2.1 checkpoint ## What changes were proposed in this pull request? There is a race condition between calling stop on a streaming query and deleting

[2/2] spark git commit: Preparing development version 2.1.2-SNAPSHOT

2017-03-21 Thread pwendell
Preparing development version 2.1.2-SNAPSHOT Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/c4d2b833 Tree: http://git-wip-us.apache.org/repos/asf/spark/tree/c4d2b833 Diff:

[spark] Git Push Summary

2017-03-21 Thread pwendell
Repository: spark Updated Tags: refs/tags/v2.1.1-rc1 [created] 30abb95c9 - To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org For additional commands, e-mail: commits-h...@spark.apache.org

[1/2] spark git commit: Preparing Spark release v2.1.1-rc1

2017-03-21 Thread pwendell
Repository: spark Updated Branches: refs/heads/branch-2.1 a04428fe2 -> c4d2b8338 Preparing Spark release v2.1.1-rc1 Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/30abb95c Tree:

subscribe to spark commits

2017-03-21 Thread Yash Sharma
subscribe to spark commits

spark git commit: [SPARK-19919][SQL] Defer throwing the exception for empty paths in CSV datasource into `DataSource`

2017-03-21 Thread wenchen
Repository: spark Updated Branches: refs/heads/master a04dcde8c -> 9281a3d50 [SPARK-19919][SQL] Defer throwing the exception for empty paths in CSV datasource into `DataSource` ## What changes were proposed in this pull request? This PR proposes to defer throwing the exception within

spark git commit: [SPARK-19980][SQL][BACKPORT-2.1] Add NULL checks in Bean serializer

2017-03-21 Thread wenchen
Repository: spark Updated Branches: refs/heads/branch-2.1 9dfdd2adf -> a04428fe2 [SPARK-19980][SQL][BACKPORT-2.1] Add NULL checks in Bean serializer ## What changes were proposed in this pull request? A Bean serializer in `ExpressionEncoder` could change values when Beans having NULL. A

spark git commit: clarify array_contains function description

2017-03-21 Thread rxin
Repository: spark Updated Branches: refs/heads/master a8877bdbb -> a04dcde8c clarify array_contains function description ## What changes were proposed in this pull request? The description in the comment for array_contains is vague/incomplete (i.e., doesn't mention that it returns `null` if

spark git commit: clarify array_contains function description

2017-03-21 Thread rxin
Repository: spark Updated Branches: refs/heads/branch-2.1 5c18b6c31 -> 9dfdd2adf clarify array_contains function description ## What changes were proposed in this pull request? The description in the comment for array_contains is vague/incomplete (i.e., doesn't mention that it returns

spark git commit: [SPARK-19237][SPARKR][CORE] On Windows spark-submit should handle when java is not installed

2017-03-21 Thread shivaram
Repository: spark Updated Branches: refs/heads/branch-2.1 a88c88aac -> 5c18b6c31 [SPARK-19237][SPARKR][CORE] On Windows spark-submit should handle when java is not installed ## What changes were proposed in this pull request? When SparkR is installed as a R package there might not be any

spark git commit: [SPARK-19237][SPARKR][CORE] On Windows spark-submit should handle when java is not installed

2017-03-21 Thread shivaram
Repository: spark Updated Branches: refs/heads/master 7dbc162f1 -> a8877bdbb [SPARK-19237][SPARKR][CORE] On Windows spark-submit should handle when java is not installed ## What changes were proposed in this pull request? When SparkR is installed as a R package there might not be any java

spark git commit: [SPARK-20017][SQL] change the nullability of function 'StringToMap' from 'false' to 'true'

2017-03-21 Thread lixiao
Repository: spark Updated Branches: refs/heads/master ae4b91d1f -> 7dbc162f1 [SPARK-20017][SQL] change the nullability of function 'StringToMap' from 'false' to 'true' ## What changes were proposed in this pull request? Change the nullability of function `StringToMap` from `false` to

spark git commit: [SPARK-20017][SQL] change the nullability of function 'StringToMap' from 'false' to 'true'

2017-03-21 Thread lixiao
Repository: spark Updated Branches: refs/heads/branch-2.1 c4c7b1857 -> a88c88aac [SPARK-20017][SQL] change the nullability of function 'StringToMap' from 'false' to 'true' ## What changes were proposed in this pull request? Change the nullability of function `StringToMap` from `false` to

spark git commit: [SPARK-20039][ML] rename ChiSquare to ChiSquareTest

2017-03-21 Thread jkbradley
Repository: spark Updated Branches: refs/heads/master 4c0ff5f58 -> ae4b91d1f [SPARK-20039][ML] rename ChiSquare to ChiSquareTest ## What changes were proposed in this pull request? I realized that since ChiSquare is in the package stat, it's pretty unclear if it's the hypothesis test,

spark git commit: [SPARK-19261][SQL] Alter add columns for Hive serde and some datasource tables

2017-03-21 Thread lixiao
Repository: spark Updated Branches: refs/heads/master 63f077fbe -> 4c0ff5f58 [SPARK-19261][SQL] Alter add columns for Hive serde and some datasource tables ## What changes were proposed in this pull request? Support` ALTER TABLE ADD COLUMNS (...) `syntax for Hive serde and some datasource

spark git commit: [SPARK-20041][DOC] Update docs for NaN handling in approxQuantile

2017-03-21 Thread lixiao
Repository: spark Updated Branches: refs/heads/master 14865d7ff -> 63f077fbe [SPARK-20041][DOC] Update docs for NaN handling in approxQuantile ## What changes were proposed in this pull request? Update docs for NaN handling in approxQuantile. ## How was this patch tested? existing tests.

spark git commit: [SPARK-17080][SQL][FOLLOWUP] Improve documentation, change buildJoin method structure and add a debug log

2017-03-21 Thread lixiao
Repository: spark Updated Branches: refs/heads/master 650d03cfc -> 14865d7ff [SPARK-17080][SQL][FOLLOWUP] Improve documentation, change buildJoin method structure and add a debug log ## What changes were proposed in this pull request? 1. Improve documentation for class `Cost` and

spark git commit: [SPARK-19998][BLOCK MANAGER] Change the exception log to add RDD id of the related the block

2017-03-21 Thread srowen
Repository: spark Updated Branches: refs/heads/master 7620aed82 -> 650d03cfc [SPARK-19998][BLOCK MANAGER] Change the exception log to add RDD id of the related the block ## What changes were proposed in this pull request? "java.lang.Exception: Could not compute split, block $blockId not

spark git commit: [SPARK-19994][HOTFIX][BRANCH-2.0] Change InnerLike to Inner

2017-03-21 Thread hvanhovell
Repository: spark Updated Branches: refs/heads/branch-2.0 3983b3dcd -> 72a0ee3ab [SPARK-19994][HOTFIX][BRANCH-2.0] Change InnerLike to Inner ## What changes were proposed in this pull request? InnerLike => Inner ## How was this patch tested? Existing tests. Author: wangzhenhua

spark git commit: [SPARK-20011][ML][DOCS] Clarify documentation for ALS 'rank' parameter

2017-03-21 Thread srowen
Repository: spark Updated Branches: refs/heads/master d2dcd6792 -> 7620aed82 [SPARK-20011][ML][DOCS] Clarify documentation for ALS 'rank' parameter ## What changes were proposed in this pull request? API documentation and collaborative filtering documentation page changes to clarify