spark git commit: [SPARK-19959][SQL] Fix to throw NullPointerException in df[java.lang.Long].collect

2017-03-23 Thread wenchen
Repository: spark Updated Branches: refs/heads/branch-2.0 b45940e67 -> 90eb37343 [SPARK-19959][SQL] Fix to throw NullPointerException in df[java.lang.Long].collect ## What changes were proposed in this pull request? This PR fixes `NullPointerException` in the generated code by Catalyst.

spark git commit: [SPARK-19959][SQL] Fix to throw NullPointerException in df[java.lang.Long].collect

2017-03-23 Thread wenchen
Repository: spark Updated Branches: refs/heads/branch-2.1 af960e86b -> 92f0b012d [SPARK-19959][SQL] Fix to throw NullPointerException in df[java.lang.Long].collect ## What changes were proposed in this pull request? This PR fixes `NullPointerException` in the generated code by Catalyst.

spark git commit: [SPARK-19959][SQL] Fix to throw NullPointerException in df[java.lang.Long].collect

2017-03-23 Thread wenchen
Repository: spark Updated Branches: refs/heads/master d27daa54b -> bb823ca4b [SPARK-19959][SQL] Fix to throw NullPointerException in df[java.lang.Long].collect ## What changes were proposed in this pull request? This PR fixes `NullPointerException` in the generated code by Catalyst. When

spark git commit: [SPARK-17204][CORE] Fix replicated off heap storage

2017-03-23 Thread wenchen
Repository: spark Updated Branches: refs/heads/branch-2.0 72a0ee3ab -> b45940e67 [SPARK-17204][CORE] Fix replicated off heap storage (Jira: https://issues.apache.org/jira/browse/SPARK-17204) There are a couple of bugs in the `BlockManager` with respect to support for replicated off-heap

spark git commit: [SPARK-19636][ML] Feature parity for correlation statistics in MLlib

2017-03-23 Thread jkbradley
Repository: spark Updated Branches: refs/heads/master 93581fbc1 -> d27daa54b [SPARK-19636][ML] Feature parity for correlation statistics in MLlib ## What changes were proposed in this pull request? This patch adds the Dataframes-based support for the correlation statistics found in the

spark git commit: Fix compilation of the Scala 2.10 master branch

2017-03-23 Thread brkyvz
Repository: spark Updated Branches: refs/heads/master c79118070 -> 93581fbc1 Fix compilation of the Scala 2.10 master branch ## What changes were proposed in this pull request? Fixes break caused by: https://github.com/apache/spark/commit/746a558de2136f91f8fe77c6e51256017aa50913 ## How was

spark git commit: [SPARK-10849][SQL] Adds option to the JDBC data source write for user to specify database column type for the create table

2017-03-23 Thread lixiao
Repository: spark Updated Branches: refs/heads/master b7be05a20 -> c79118070 [SPARK-10849][SQL] Adds option to the JDBC data source write for user to specify database column type for the create table ## What changes were proposed in this pull request? Currently JDBC data source creates

spark git commit: [SPARK-19567][CORE][SCHEDULER] Support some Schedulable variables immutability and access

2017-03-23 Thread kayousterhout
Repository: spark Updated Branches: refs/heads/master 746a558de -> b7be05a20 [SPARK-19567][CORE][SCHEDULER] Support some Schedulable variables immutability and access ## What changes were proposed in this pull request? Some `Schedulable` Entities(`Pool` and `TaskSetManager`) variables need

spark git commit: [SPARK-19970][SQL][BRANCH-2.1] Table owner should be USER instead of PRINCIPAL in kerberized clusters

2017-03-23 Thread vanzin
Repository: spark Updated Branches: refs/heads/branch-2.1 56f997f13 -> af960e86b [SPARK-19970][SQL][BRANCH-2.1] Table owner should be USER instead of PRINCIPAL in kerberized clusters ## What changes were proposed in this pull request? In the kerberized hadoop cluster, when Spark creates

spark git commit: [SPARK-19876][SS][WIP] OneTime Trigger Executor

2017-03-23 Thread tdas
Repository: spark Updated Branches: refs/heads/master b0ae6a38a -> 746a558de [SPARK-19876][SS][WIP] OneTime Trigger Executor ## What changes were proposed in this pull request? An additional trigger and trigger executor that will execute a single trigger only. One can use this OneTime

spark git commit: Typo fixup in comment

2017-03-23 Thread rxin
Repository: spark Updated Branches: refs/heads/master b70c03a42 -> b0ae6a38a Typo fixup in comment ## What changes were proposed in this pull request? Fixup typo in comment. ## How was this patch tested? Don't need. Author: Ye Yin Closes #17396 from hustcat/fix. Project:

spark git commit: [INFRA] Close stale PRs

2017-03-23 Thread srowen
Repository: spark Updated Branches: refs/heads/master aefe79890 -> b70c03a42 [INFRA] Close stale PRs Closes #16819 Closes #13467 Closes #16083 Closes #17135 Closes #8785 Closes #16278 Closes #16997 Closes #17073 Closes #17220 Added: Closes #12059 Closes #12524 Closes #12888 Closes #16061

spark git commit: [MINOR][BUILD] Fix javadoc8 break

2017-03-23 Thread srowen
Repository: spark Updated Branches: refs/heads/master 07c12c09a -> aefe79890 [MINOR][BUILD] Fix javadoc8 break ## What changes were proposed in this pull request? Several javadoc8 breaks have been introduced. This PR proposes fix those instances so that we can build Scala/Java API docs.

spark git commit: [SPARK-18579][SQL] Use ignoreLeadingWhiteSpace and ignoreTrailingWhiteSpace options in CSV writing

2017-03-23 Thread felixcheung
Repository: spark Updated Branches: refs/heads/master 12cd00706 -> 07c12c09a [SPARK-18579][SQL] Use ignoreLeadingWhiteSpace and ignoreTrailingWhiteSpace options in CSV writing ## What changes were proposed in this pull request? This PR proposes to support _not_ trimming the white spaces