spark git commit: [SPARK-20375][R] R wrappers for array and map

2017-04-19 Thread felixcheung
Repository: spark Updated Branches: refs/heads/master bdc605691 -> 46c574976 [SPARK-20375][R] R wrappers for array and map ## What changes were proposed in this pull request? Adds wrappers for `o.a.s.sql.functions.array` and `o.a.s.sql.functions.map` ## How was this patch tested? Unit tests

spark git commit: Fixed typos in docs

2017-04-19 Thread rxin
Repository: spark Updated Branches: refs/heads/master dd6d55d5d -> bdc605691 Fixed typos in docs ## What changes were proposed in this pull request? Typos at a couple of place in the docs. ## How was this patch tested? build including docs Please review http://spark.apache.org/contributing

spark git commit: Fixed typos in docs

2017-04-19 Thread rxin
Repository: spark Updated Branches: refs/heads/branch-2.2 e6bbdb0c5 -> 8d658b90b Fixed typos in docs ## What changes were proposed in this pull request? Typos at a couple of place in the docs. ## How was this patch tested? build including docs Please review http://spark.apache.org/contribu

spark git commit: [SPARK-20398][SQL] range() operator should include cancellation reason when killed

2017-04-19 Thread rxin
Repository: spark Updated Branches: refs/heads/branch-2.2 af9f18c31 -> e6bbdb0c5 [SPARK-20398][SQL] range() operator should include cancellation reason when killed ## What changes were proposed in this pull request? https://issues.apache.org/jira/browse/SPARK-19820 adds a reason field for wh

spark git commit: [SPARK-20398][SQL] range() operator should include cancellation reason when killed

2017-04-19 Thread rxin
Repository: spark Updated Branches: refs/heads/master 39e303a8b -> dd6d55d5d [SPARK-20398][SQL] range() operator should include cancellation reason when killed ## What changes were proposed in this pull request? https://issues.apache.org/jira/browse/SPARK-19820 adds a reason field for why t

spark git commit: [MINOR][SS] Fix a missing space in UnsupportedOperationChecker error message

2017-04-19 Thread zsxwing
Repository: spark Updated Branches: refs/heads/branch-2.1 171bf656f -> 9e5dc82a1 [MINOR][SS] Fix a missing space in UnsupportedOperationChecker error message ## What changes were proposed in this pull request? Also went through the same file to ensure other string concatenation are correct.

spark git commit: [MINOR][SS] Fix a missing space in UnsupportedOperationChecker error message

2017-04-19 Thread zsxwing
Repository: spark Updated Branches: refs/heads/branch-2.2 371af9623 -> af9f18c31 [MINOR][SS] Fix a missing space in UnsupportedOperationChecker error message ## What changes were proposed in this pull request? Also went through the same file to ensure other string concatenation are correct.

spark git commit: [MINOR][SS] Fix a missing space in UnsupportedOperationChecker error message

2017-04-19 Thread zsxwing
Repository: spark Updated Branches: refs/heads/master 63824b2c8 -> 39e303a8b [MINOR][SS] Fix a missing space in UnsupportedOperationChecker error message ## What changes were proposed in this pull request? Also went through the same file to ensure other string concatenation are correct. ##

spark git commit: [SPARK-20350] Add optimization rules to apply Complementation Laws.

2017-04-19 Thread wenchen
Repository: spark Updated Branches: refs/heads/branch-2.2 d649787ee -> 371af9623 [SPARK-20350] Add optimization rules to apply Complementation Laws. ## What changes were proposed in this pull request? Apply Complementation Laws during boolean expression simplification. ## How was this patch

spark git commit: [SPARK-20350] Add optimization rules to apply Complementation Laws.

2017-04-19 Thread wenchen
Repository: spark Updated Branches: refs/heads/master 4fea7848c -> 63824b2c8 [SPARK-20350] Add optimization rules to apply Complementation Laws. ## What changes were proposed in this pull request? Apply Complementation Laws during boolean expression simplification. ## How was this patch test

spark git commit: [SPARK-20397][SPARKR][SS] Fix flaky test: test_streaming.R.Terminated by error

2017-04-19 Thread zsxwing
Repository: spark Updated Branches: refs/heads/branch-2.2 80a60da8f -> d649787ee [SPARK-20397][SPARKR][SS] Fix flaky test: test_streaming.R.Terminated by error ## What changes were proposed in this pull request? Checking a source parameter is asynchronous. When the query is created, it's not

spark git commit: [SPARK-20397][SPARKR][SS] Fix flaky test: test_streaming.R.Terminated by error

2017-04-19 Thread zsxwing
Repository: spark Updated Branches: refs/heads/master 71a8e9df1 -> 4fea7848c [SPARK-20397][SPARKR][SS] Fix flaky test: test_streaming.R.Terminated by error ## What changes were proposed in this pull request? Checking a source parameter is asynchronous. When the query is created, it's not gua

spark git commit: [SPARK-20036][DOC] Note incompatible dependencies on org.apache.kafka artifacts

2017-04-19 Thread srowen
Repository: spark Updated Branches: refs/heads/branch-2.2 8baa970bc -> 80a60da8f [SPARK-20036][DOC] Note incompatible dependencies on org.apache.kafka artifacts ## What changes were proposed in this pull request? Note that you shouldn't manually add dependencies on org.apache.kafka artifacts

spark git commit: [SPARK-20036][DOC] Note incompatible dependencies on org.apache.kafka artifacts

2017-04-19 Thread srowen
Repository: spark Updated Branches: refs/heads/master 35378766a -> 71a8e9df1 [SPARK-20036][DOC] Note incompatible dependencies on org.apache.kafka artifacts ## What changes were proposed in this pull request? Note that you shouldn't manually add dependencies on org.apache.kafka artifacts ##

spark git commit: [SPARK-20343][BUILD] Avoid Unidoc build only if Hadoop 2.6 is explicitly set in SBT build

2017-04-19 Thread srowen
Repository: spark Updated Branches: refs/heads/branch-2.2 a87e21dd2 -> 8baa970bc [SPARK-20343][BUILD] Avoid Unidoc build only if Hadoop 2.6 is explicitly set in SBT build ## What changes were proposed in this pull request? This PR proposes two things as below: - Avoid Unidoc build only if H

spark git commit: [SPARK-20343][BUILD] Avoid Unidoc build only if Hadoop 2.6 is explicitly set in SBT build

2017-04-19 Thread srowen
Repository: spark Updated Branches: refs/heads/master 773754b6c -> 35378766a [SPARK-20343][BUILD] Avoid Unidoc build only if Hadoop 2.6 is explicitly set in SBT build ## What changes were proposed in this pull request? This PR proposes two things as below: - Avoid Unidoc build only if Hadoo

spark git commit: [SPARK-20356][SQL] Pruned InMemoryTableScanExec should have correct output partitioning and ordering

2017-04-19 Thread wenchen
Repository: spark Updated Branches: refs/heads/branch-2.2 274a3e294 -> a87e21dd2 [SPARK-20356][SQL] Pruned InMemoryTableScanExec should have correct output partitioning and ordering ## What changes were proposed in this pull request? The output of `InMemoryTableScanExec` can be pruned and mi

spark git commit: [SPARK-20356][SQL] Pruned InMemoryTableScanExec should have correct output partitioning and ordering

2017-04-19 Thread wenchen
Repository: spark Updated Branches: refs/heads/master 608bf30f0 -> 773754b6c [SPARK-20356][SQL] Pruned InMemoryTableScanExec should have correct output partitioning and ordering ## What changes were proposed in this pull request? The output of `InMemoryTableScanExec` can be pruned and mismat

spark git commit: [SPARK-20359][SQL] Avoid unnecessary execution in EliminateOuterJoin optimization that can lead to NPE

2017-04-19 Thread wenchen
Repository: spark Updated Branches: refs/heads/branch-2.1 a4c1ebc1d -> 171bf656f [SPARK-20359][SQL] Avoid unnecessary execution in EliminateOuterJoin optimization that can lead to NPE Avoid necessary execution that can lead to NPE in EliminateOuterJoin and add test in DataFrameSuite to confi

spark git commit: [SPARK-20359][SQL] Avoid unnecessary execution in EliminateOuterJoin optimization that can lead to NPE

2017-04-19 Thread wenchen
Repository: spark Updated Branches: refs/heads/branch-2.2 ef6923f7e -> 274a3e294 [SPARK-20359][SQL] Avoid unnecessary execution in EliminateOuterJoin optimization that can lead to NPE Avoid necessary execution that can lead to NPE in EliminateOuterJoin and add test in DataFrameSuite to confi

spark git commit: [SPARK-20359][SQL] Avoid unnecessary execution in EliminateOuterJoin optimization that can lead to NPE

2017-04-19 Thread wenchen
Repository: spark Updated Branches: refs/heads/master 702d85af2 -> 608bf30f0 [SPARK-20359][SQL] Avoid unnecessary execution in EliminateOuterJoin optimization that can lead to NPE Avoid necessary execution that can lead to NPE in EliminateOuterJoin and add test in DataFrameSuite to confirm N