spark git commit: [MINOR][ML] Avoid 2D array flatten in NB training.

2016-10-05 Thread yliang
Repository: spark Updated Branches: refs/heads/master b678e465a -> 7aeb20be7 [MINOR][ML] Avoid 2D array flatten in NB training. ## What changes were proposed in this pull request? Avoid 2D array flatten in ```NaiveBayes``` training, since flatten method might be expensive (It will create anot

spark git commit: [SPARK-17346][SQL][TEST-MAVEN] Generate the sql test jar to fix the maven build

2016-10-05 Thread tdas
Repository: spark Updated Branches: refs/heads/master 9293734d3 -> b678e465a [SPARK-17346][SQL][TEST-MAVEN] Generate the sql test jar to fix the maven build ## What changes were proposed in this pull request? Generate the sql test jar to fix the maven build ## How was this patch tested? Jen

spark git commit: [SPARK-17643] Remove comparable requirement from Offset (backport for branch-2.0)

2016-10-05 Thread zsxwing
Repository: spark Updated Branches: refs/heads/branch-2.0 3b6463a79 -> 1c2dff1ee [SPARK-17643] Remove comparable requirement from Offset (backport for branch-2.0) ## What changes were proposed in this pull request? Backport https://github.com/apache/spark/commit/988c71457354b0a443471f501cef

[2/2] spark git commit: [SPARK-17346][SQL] Add Kafka source for Structured Streaming

2016-10-05 Thread tdas
[SPARK-17346][SQL] Add Kafka source for Structured Streaming ## What changes were proposed in this pull request? This PR adds a new project ` external/kafka-0-10-sql` for Structured Streaming Kafka source. It's based on the design doc: https://docs.google.com/document/d/19t2rWe51x7tq2e5AOfrsM9

[1/2] spark git commit: [SPARK-17346][SQL] Add Kafka source for Structured Streaming

2016-10-05 Thread tdas
Repository: spark Updated Branches: refs/heads/master 5fd54b994 -> 9293734d3 http://git-wip-us.apache.org/repos/asf/spark/blob/9293734d/external/kafka-0-10-sql/src/test/scala/org/apache/spark/sql/kafka010/KafkaSourceSuite.scala ---

spark git commit: [SPARK-17758][SQL] Last returns wrong result in case of empty partition

2016-10-05 Thread yhuai
Repository: spark Updated Branches: refs/heads/master 221b418b1 -> 5fd54b994 [SPARK-17758][SQL] Last returns wrong result in case of empty partition ## What changes were proposed in this pull request? The result of the `Last` function can be wrong when the last partition processed is empty. I

spark git commit: [SPARK-17758][SQL] Last returns wrong result in case of empty partition

2016-10-05 Thread yhuai
Repository: spark Updated Branches: refs/heads/branch-2.0 b8df2e53c -> 3b6463a79 [SPARK-17758][SQL] Last returns wrong result in case of empty partition ## What changes were proposed in this pull request? The result of the `Last` function can be wrong when the last partition processed is empt

spark git commit: [SPARK-17778][TESTS] Mock SparkContext to reduce memory usage of BlockManagerSuite

2016-10-05 Thread zsxwing
Repository: spark Updated Branches: refs/heads/branch-2.0 a4f7df423 -> b8df2e53c [SPARK-17778][TESTS] Mock SparkContext to reduce memory usage of BlockManagerSuite ## What changes were proposed in this pull request? Mock SparkContext to reduce memory usage of BlockManagerSuite ## How was th

spark git commit: [SPARK-17778][TESTS] Mock SparkContext to reduce memory usage of BlockManagerSuite

2016-10-05 Thread zsxwing
Repository: spark Updated Branches: refs/heads/master 9df54f532 -> 221b418b1 [SPARK-17778][TESTS] Mock SparkContext to reduce memory usage of BlockManagerSuite ## What changes were proposed in this pull request? Mock SparkContext to reduce memory usage of BlockManagerSuite ## How was this p

[spark] Git Push Summary

2016-10-05 Thread rxin
Repository: spark Updated Tags: refs/tags/v2.0.1-rc1 [deleted] 00f2e28ed - To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org For additional commands, e-mail: commits-h...@spark.apache.org

[spark] Git Push Summary

2016-10-05 Thread rxin
Repository: spark Updated Tags: refs/tags/v2.0.1 [created] 933d2c1ea - To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org For additional commands, e-mail: commits-h...@spark.apache.org

[spark] Git Push Summary

2016-10-05 Thread rxin
Repository: spark Updated Tags: refs/tags/v2.0.1-rc4 [deleted] 933d2c1ea - To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org For additional commands, e-mail: commits-h...@spark.apache.org

[spark] Git Push Summary

2016-10-05 Thread rxin
Repository: spark Updated Tags: refs/tags/v2.0.1-rc3 [deleted] 9d28cc103 - To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org For additional commands, e-mail: commits-h...@spark.apache.org

[spark] Git Push Summary

2016-10-05 Thread rxin
Repository: spark Updated Tags: refs/tags/v2.0.1-rc2 [deleted] 04141ad49 - To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org For additional commands, e-mail: commits-h...@spark.apache.org

spark git commit: [SPARK-17239][ML][DOC] Update user guide for multiclass logistic regression

2016-10-05 Thread dbtsai
Repository: spark Updated Branches: refs/heads/master 6a05eb24d -> 9df54f532 [SPARK-17239][ML][DOC] Update user guide for multiclass logistic regression ## What changes were proposed in this pull request? Updates user guide to reflect that LogisticRegression now supports multiclass. Also adds

spark git commit: [SPARK-17328][SQL] Fix NPE with EXPLAIN DESCRIBE TABLE

2016-10-05 Thread hvanhovell
Repository: spark Updated Branches: refs/heads/master 89516c1c4 -> 6a05eb24d [SPARK-17328][SQL] Fix NPE with EXPLAIN DESCRIBE TABLE ## What changes were proposed in this pull request? This PR fixes the following NPE scenario in two ways. **Reported Error Scenario** ```scala scala> sql("EXPLA