spark git commit: [MINOR][DOCS] fixed list display in ml-ensembles

Repository: spark Updated Branches: refs/heads/branch-1.6 32911de77 -> 0978ec11c [MINOR][DOCS] fixed list display in ml-ensembles The list in ml-ensembles.md wasn't properly formatted and, as a result, was looking like this:  This PR aims to make it

spark git commit: [MINOR][DOCS] fixed list display in ml-ensembles

Repository: spark Updated Branches: refs/heads/master 8df584b02 -> f2fbfa444 [MINOR][DOCS] fixed list display in ml-ensembles The list in ml-ensembles.md wasn't properly formatted and, as a result, was looking like this:  This PR aims to make it look

spark git commit: Revert "[SPARK-11206] Support SQL UI on the history server"

Repository: spark Updated Branches: refs/heads/master f2fbfa444 -> 2c5dee0fb Revert "[SPARK-11206] Support SQL UI on the history server" This reverts commit cc243a079b1c039d6e7f0b410d1654d94a090e14 / PR #9297 I'm reverting this because it broke SQLListenerMemoryLeakSuite in the master Maven

spark git commit: [SPARK-11859][MESOS] SparkContext accepts invalid Master URLs in the form zk://host:port for a multi-master Mesos cluster using ZooKeeper

Repository: spark Updated Branches: refs/heads/master 0ddfe7868 -> e07494420 [SPARK-11859][MESOS] SparkContext accepts invalid Master URLs in the form zk://host:port for a multi-master Mesos cluster using ZooKeeper * According to below doc and validation logic in

spark git commit: [SPARK-11859][MESOS] SparkContext accepts invalid Master URLs in the form zk://host:port for a multi-master Mesos cluster using ZooKeeper

Repository: spark Updated Branches: refs/heads/branch-1.6 a4a2a7deb -> 12d97b0c5 [SPARK-11859][MESOS] SparkContext accepts invalid Master URLs in the form zk://host:port for a multi-master Mesos cluster using ZooKeeper * According to below doc and validation logic in

spark git commit: [SPARK-12023][BUILD] Fix warnings while packaging spark with maven.

Repository: spark Updated Branches: refs/heads/branch-1.6 aaf835f1d -> 33cd171b2 [SPARK-12023][BUILD] Fix warnings while packaging spark with maven. this is a trivial fix, discussed

spark git commit: [SPARK-12023][BUILD] Fix warnings while packaging spark with maven.

Repository: spark Updated Branches: refs/heads/master 26c3581f1 -> bf0e85a70 [SPARK-12023][BUILD] Fix warnings while packaging spark with maven. this is a trivial fix, discussed

spark git commit: [SPARK-11700] [SQL] Remove thread local SQLContext in SparkPlan

Repository: spark Updated Branches: refs/heads/branch-1.6 a589736a1 -> 32911de77 [SPARK-11700] [SQL] Remove thread local SQLContext in SparkPlan In 1.6, we introduce a public API to have a SQLContext for current thread, SparkPlan should use that. Author: Davies Liu

spark git commit: [SPARK-11700] [SQL] Remove thread local SQLContext in SparkPlan

Repository: spark Updated Branches: refs/heads/master 2db4662fe -> 17275fa99 [SPARK-11700] [SQL] Remove thread local SQLContext in SparkPlan In 1.6, we introduce a public API to have a SQLContext for current thread, SparkPlan should use that. Author: Davies Liu

spark git commit: [SPARK-11982] [SQL] improve performance of cartesian product

Repository: spark Updated Branches: refs/heads/master 17275fa99 -> 8df584b02 [SPARK-11982] [SQL] improve performance of cartesian product This PR improve the performance of CartesianProduct by caching the result of right plan. After this patch, the query time of TPC-DS Q65 go down to 4

spark git commit: [SPARK-12037][CORE] initialize heartbeatReceiverRef before calling startDriverHeartbeat

Repository: spark Updated Branches: refs/heads/branch-1.6 43ffa0373 -> a4e134827 [SPARK-12037][CORE] initialize heartbeatReceiverRef before calling startDriverHeartbeat https://issues.apache.org/jira/browse/SPARK-12037 a simple fix by changing the order of the statements Author: CodingCat

[1/2] spark git commit: [SPARK-12007][NETWORK] Avoid copies in the network lib's RPC layer.

Repository: spark Updated Branches: refs/heads/master 0a46e4377 -> 9bf212067 http://git-wip-us.apache.org/repos/asf/spark/blob/9bf21206/network/common/src/test/java/org/apache/spark/network/RpcIntegrationSuite.java -- diff

[1/2] spark git commit: [SPARK-12007][NETWORK] Avoid copies in the network lib's RPC layer.

Repository: spark Updated Branches: refs/heads/branch-1.6 a4e134827 -> ef6f8c262 http://git-wip-us.apache.org/repos/asf/spark/blob/ef6f8c26/network/common/src/test/java/org/apache/spark/network/RequestTimeoutIntegrationSuite.java

spark git commit: [SPARK-12049][CORE] User JVM shutdown hook can cause deadlock at shutdown

Repository: spark Updated Branches: refs/heads/master 9bf212067 -> 96bf468c7 [SPARK-12049][CORE] User JVM shutdown hook can cause deadlock at shutdown Avoid potential deadlock with a user app's shutdown hook thread by more narrowly synchronizing access to 'hooks' Author: Sean Owen

spark git commit: [SPARK-12049][CORE] User JVM shutdown hook can cause deadlock at shutdown

Repository: spark Updated Branches: refs/heads/branch-1.6 ef6f8c262 -> 2fc3fce8a [SPARK-12049][CORE] User JVM shutdown hook can cause deadlock at shutdown Avoid potential deadlock with a user app's shutdown hook thread by more narrowly synchronizing access to 'hooks' Author: Sean Owen

spark git commit: [SPARK-12035] Add more debug information in include_example tag of Jekyll

Repository: spark Updated Branches: refs/heads/master d3ca8cfac -> e6dc89a33 [SPARK-12035] Add more debug information in include_example tag of Jekyll https://issues.apache.org/jira/browse/SPARK-12035 When we debuging lots of example code files, like in

[2/2] spark git commit: [SPARK-12007][NETWORK] Avoid copies in the network lib's RPC layer.

[SPARK-12007][NETWORK] Avoid copies in the network lib's RPC layer. This change seems large, but most of it is just replacing `byte[]` with `ByteBuffer` and `new byte[]` with `ByteBuffer.allocate()`, since it changes the network library's API. The following are parts of the code that actually

[2/2] spark git commit: [SPARK-12007][NETWORK] Avoid copies in the network lib's RPC layer.

[SPARK-12007][NETWORK] Avoid copies in the network lib's RPC layer. This change seems large, but most of it is just replacing `byte[]` with `ByteBuffer` and `new byte[]` with `ByteBuffer.allocate()`, since it changes the network library's API. The following are parts of the code that actually

spark git commit: [SPARK-12049][CORE] User JVM shutdown hook can cause deadlock at shutdown

Repository: spark Updated Branches: refs/heads/branch-1.5 9b6216171 -> d78f1bc45 [SPARK-12049][CORE] User JVM shutdown hook can cause deadlock at shutdown Avoid potential deadlock with a user app's shutdown hook thread by more narrowly synchronizing access to 'hooks' Author: Sean Owen

spark git commit: [HOTFIX][SPARK-12000] Add missing quotes in Jekyll API docs plugin.

Repository: spark Updated Branches: refs/heads/branch-1.6 2fc3fce8a -> 86a46ce68 [HOTFIX][SPARK-12000] Add missing quotes in Jekyll API docs plugin. I accidentally omitted these as part of #10049. Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit:

spark git commit: [HOTFIX][SPARK-12000] Add missing quotes in Jekyll API docs plugin.

Repository: spark Updated Branches: refs/heads/master 96bf468c7 -> f73379be2 [HOTFIX][SPARK-12000] Add missing quotes in Jekyll API docs plugin. I accidentally omitted these as part of #10049. Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit:

spark git commit: [SPARK-12053][CORE] EventLoggingListener.getLogPath needs 4 parameters

Repository: spark Updated Branches: refs/heads/branch-1.6 0978ec11c -> a8c6d8acc [SPARK-12053][CORE] EventLoggingListener.getLogPath needs 4 parameters ```EventLoggingListener.getLogPath``` needs 4 input arguments:

spark git commit: [SPARK-12053][CORE] EventLoggingListener.getLogPath needs 4 parameters

Repository: spark Updated Branches: refs/heads/master 2c5dee0fb -> a8ceec5e8 [SPARK-12053][CORE] EventLoggingListener.getLogPath needs 4 parameters ```EventLoggingListener.getLogPath``` needs 4 input arguments:

spark git commit: [SPARK-11960][MLLIB][DOC] User guide for streaming tests

Repository: spark Updated Branches: refs/heads/branch-1.6 a387cef3a -> ebf87ebc0 [SPARK-11960][MLLIB][DOC] User guide for streaming tests CC jkbradley mengxr josepablocam Author: Feynman Liang Closes #10005 from feynmanliang/streaming-test-user-guide. (cherry

spark git commit: [SPARK-12053][CORE] EventLoggingListener.getLogPath needs 4 parameters

Repository: spark Updated Branches: refs/heads/branch-1.5 7900d192e -> 9b6216171 [SPARK-12053][CORE] EventLoggingListener.getLogPath needs 4 parameters ```EventLoggingListener.getLogPath``` needs 4 input arguments:

spark git commit: [SPARK-11689][ML] Add user guide and example code for LDA under spark.ml

Repository: spark Updated Branches: refs/heads/branch-1.6 a8c6d8acc -> 1562ef10f [SPARK-11689][ML] Add user guide and example code for LDA under spark.ml jira: https://issues.apache.org/jira/browse/SPARK-11689 Add simple user guide for LDA under spark.ml and example code under examples/.

spark git commit: fix Maven build

Repository: spark Updated Branches: refs/heads/branch-1.6 ebf87ebc0 -> 436151780 fix Maven build Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/43615178 Tree: http://git-wip-us.apache.org/repos/asf/spark/tree/43615178

spark git commit: [SPARK-11975][ML] Remove duplicate mllib example (DT/RF/GBT in Java/Python)

Repository: spark Updated Branches: refs/heads/master e232720a6 -> de64b65f7 [SPARK-11975][ML] Remove duplicate mllib example (DT/RF/GBT in Java/Python) Remove duplicate mllib example (DT/RF/GBT in Java/Python). Since we have tutorial code for DT/RF/GBT classification/regression in

spark git commit: [SPARK-11975][ML] Remove duplicate mllib example (DT/RF/GBT in Java/Python)

Repository: spark Updated Branches: refs/heads/branch-1.6 1562ef10f -> a387cef3a [SPARK-11975][ML] Remove duplicate mllib example (DT/RF/GBT in Java/Python) Remove duplicate mllib example (DT/RF/GBT in Java/Python). Since we have tutorial code for DT/RF/GBT classification/regression in

spark git commit: [SPARK-11689][ML] Add user guide and example code for LDA under spark.ml

Repository: spark Updated Branches: refs/heads/master a8ceec5e8 -> e232720a6 [SPARK-11689][ML] Add user guide and example code for LDA under spark.ml jira: https://issues.apache.org/jira/browse/SPARK-11689 Add simple user guide for LDA under spark.ml and example code under examples/. Use

spark git commit: fix Maven build

Repository: spark Updated Branches: refs/heads/master 553588893 -> ecc00ec3f fix Maven build Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/ecc00ec3 Tree: http://git-wip-us.apache.org/repos/asf/spark/tree/ecc00ec3 Diff:

spark git commit: [SPARK-12000] Fix API doc generation issues

Repository: spark Updated Branches: refs/heads/master edb26e7f4 -> d3ca8cfac [SPARK-12000] Fix API doc generation issues This pull request fixes multiple issues with API doc generation. - Modify the Jekyll plugin so that the entire doc build fails if API docs cannot be generated. This will

spark git commit: [SPARK-12000] Fix API doc generation issues

Repository: spark Updated Branches: refs/heads/branch-1.6 436151780 -> 43ffa0373 [SPARK-12000] Fix API doc generation issues This pull request fixes multiple issues with API doc generation. - Modify the Jekyll plugin so that the entire doc build fails if API docs cannot be generated. This

spark git commit: [SPARK-12058][HOTFIX] Disable KinesisStreamTests

Repository: spark Updated Branches: refs/heads/master ecc00ec3f -> edb26e7f4 [SPARK-12058][HOTFIX] Disable KinesisStreamTests KinesisStreamTests in test.py is broken because of #9403. See

spark git commit: [SPARK-12018][SQL] Refactor common subexpression elimination code

Repository: spark Updated Branches: refs/heads/master f73379be2 -> 9693b0d5a [SPARK-12018][SQL] Refactor common subexpression elimination code JIRA: https://issues.apache.org/jira/browse/SPARK-12018 The code of common subexpression elimination can be factored and simplified. Some

spark git commit: [SPARK-12018][SQL] Refactor common subexpression elimination code

Repository: spark Updated Branches: refs/heads/branch-1.6 86a46ce68 -> 1aa39bdb1 [SPARK-12018][SQL] Refactor common subexpression elimination code JIRA: https://issues.apache.org/jira/browse/SPARK-12018 The code of common subexpression elimination can be factored and simplified. Some

spark git commit: [SPARK-11989][SQL] Only use commit in JDBC data source if the underlying database supports transactions

Repository: spark Updated Branches: refs/heads/master bf0e85a70 -> 2db4662fe [SPARK-11989][SQL] Only use commit in JDBC data source if the underlying database supports transactions Fixes [SPARK-11989](https://issues.apache.org/jira/browse/SPARK-11989) Author: CK50

spark git commit: [SPARK-11989][SQL] Only use commit in JDBC data source if the underlying database supports transactions

Repository: spark Updated Branches: refs/heads/branch-1.6 33cd171b2 -> a589736a1 [SPARK-11989][SQL] Only use commit in JDBC data source if the underlying database supports transactions Fixes [SPARK-11989](https://issues.apache.org/jira/browse/SPARK-11989) Author: CK50

spark git commit: [DOC] Explicitly state that top maintains the order of elements

Repository: spark Updated Branches: refs/heads/branch-1.6 e9653921e -> aaf835f1d [DOC] Explicitly state that top maintains the order of elements Top is implemented in terms of takeOrdered, which already maintains the order, so top should, too. Author: Wieland Hoffmann

spark git commit: [DOC] Explicitly state that top maintains the order of elements

Repository: spark Updated Branches: refs/heads/master 953e8e6dc -> 26c3581f1 [DOC] Explicitly state that top maintains the order of elements Top is implemented in terms of takeOrdered, which already maintains the order, so top should, too. Author: Wieland Hoffmann

spark git commit: [MINOR][BUILD] Changed the comment to reflect the plugin project is there to support SBT pom reader only.

Repository: spark Updated Branches: refs/heads/master e07494420 -> 953e8e6dc [MINOR][BUILD] Changed the comment to reflect the plugin project is there to support SBT pom reader only. Author: Prashant Sharma Closes #10012 from ScrapCodes/minor-build-comment. Project:

spark git commit: [MINOR][BUILD] Changed the comment to reflect the plugin project is there to support SBT pom reader only.

Repository: spark Updated Branches: refs/heads/branch-1.6 12d97b0c5 -> e9653921e [MINOR][BUILD] Changed the comment to reflect the plugin project is there to support SBT pom reader only. Author: Prashant Sharma Closes #10012 from ScrapCodes/minor-build-comment.