[GitHub] spark issue #16054: dstreaming receiver for twitter

2016-11-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16054 Can one of the admins verify this patch? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[GitHub] spark issue #15935: [SPARK-18188] add checksum for blocks of broadcast

2016-11-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15935 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/69299/ Test PASSed. ---

[GitHub] spark issue #15935: [SPARK-18188] add checksum for blocks of broadcast

2016-11-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15935 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark pull request #16054: dstreaming receiver for twitter

2016-11-28 Thread Aegeaner
GitHub user Aegeaner opened a pull request: https://github.com/apache/spark/pull/16054 dstreaming receiver for twitter ## What changes were proposed in this pull request? implement a streaming receiver for twitter ## How was this patch tested?

[GitHub] spark issue #16048: [DO_NOT_MERGE]Test kafka deletion

2016-11-28 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16048 **[Test build #69309 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69309/consoleFull)** for PR 16048 at commit

[GitHub] spark issue #15935: [SPARK-18188] add checksum for blocks of broadcast

2016-11-28 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15935 **[Test build #69299 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69299/consoleFull)** for PR 15935 at commit

[GitHub] spark issue #15954: [WIP][SPARK-18516][SQL] Split state and progress in stre...

2016-11-28 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15954 **[Test build #69308 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69308/consoleFull)** for PR 15954 at commit

[GitHub] spark pull request #16052: [SPARK-18617][CORE][STREAMING] Close "kryo auto p...

2016-11-28 Thread rxin
Github user rxin commented on a diff in the pull request: https://github.com/apache/spark/pull/16052#discussion_r89954432 --- Diff: core/src/main/scala/org/apache/spark/serializer/SerializerManager.scala --- @@ -77,8 +77,8 @@ private[spark] class

[GitHub] spark pull request #15877: [SPARK-18429] [SQL] implement a new Aggregate for...

2016-11-28 Thread wzhfy
Github user wzhfy commented on a diff in the pull request: https://github.com/apache/spark/pull/15877#discussion_r89953368 --- Diff: common/sketch/src/main/java/org/apache/spark/util/sketch/CountMinSketchImpl.java --- @@ -152,6 +153,16 @@ public void add(Object item) {

[GitHub] spark issue #15788: [SPARK-18291][SparkR][ML] SparkR glm predict should outp...

2016-11-28 Thread yanboliang
Github user yanboliang commented on the issue: https://github.com/apache/spark/pull/15788 @jkbradley I agree that exposing probabilities is also useful to R users. Think more about this issue, I think we can add a new argument ```type``` to ```predict```, this argument controls the

[GitHub] spark issue #16030: [SPARK-18108][SQL] Fix a bug to fail partition schema in...

2016-11-28 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16030 **[Test build #69307 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69307/consoleFull)** for PR 16030 at commit

[GitHub] spark issue #16028: [SPARK-18518][ML] HasSolver supports override

2016-11-28 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16028 **[Test build #69305 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69305/consoleFull)** for PR 16028 at commit

[GitHub] spark issue #16017: [SPARK-18592][ML] Move DT/RF/GBT Param setter methods to...

2016-11-28 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16017 **[Test build #69306 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69306/consoleFull)** for PR 16017 at commit

[GitHub] spark issue #13557: [SPARK-15819][PYSPARK][ML] Add KMeanSummary in KMeans of...

2016-11-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13557 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #13557: [SPARK-15819][PYSPARK][ML] Add KMeanSummary in KMeans of...

2016-11-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13557 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/69302/ Test PASSed. ---

[GitHub] spark issue #13557: [SPARK-15819][PYSPARK][ML] Add KMeanSummary in KMeans of...

2016-11-28 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13557 **[Test build #69302 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69302/consoleFull)** for PR 13557 at commit

[GitHub] spark pull request #15949: [SPARK-18339] [SPARK-18513] [SQL] Don't push down...

2016-11-28 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/15949 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark issue #15949: [SPARK-18339] [SPARK-18513] [SQL] Don't push down curren...

2016-11-28 Thread tdas
Github user tdas commented on the issue: https://github.com/apache/spark/pull/15949 Merging this to master and 2.1 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and

[GitHub] spark issue #15662: [SPARK-18141][SQL] Fix to quote column names in the pred...

2016-11-28 Thread sureshthalamati
Github user sureshthalamati commented on the issue: https://github.com/apache/spark/pull/15662 Thanks, @gatorsmile . Resolved the conflicts, and also added test case for empty in clause with mixed case column name. --- If your project is set up for it, you can reply to this email

[GitHub] spark issue #16045: [SPARK-18553][CORE] Fix leak of TaskSetManager following...

2016-11-28 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16045 **[Test build #69304 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69304/consoleFull)** for PR 16045 at commit

[GitHub] spark issue #16053: [SPARK-17931] Eliminate unncessary task (de) serializati...

2016-11-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16053 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark pull request #16017: [SPARK-18592][ML] Move DT/RF/GBT Param setter met...

2016-11-28 Thread yanboliang
Github user yanboliang commented on a diff in the pull request: https://github.com/apache/spark/pull/16017#discussion_r89949760 --- Diff: mllib/src/main/scala/org/apache/spark/ml/tree/treeParams.scala --- @@ -107,25 +107,41 @@ private[ml] trait DecisionTreeParams extends

[GitHub] spark issue #16053: [SPARK-17931] Eliminate unncessary task (de) serializati...

2016-11-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16053 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/69301/ Test FAILed. ---

[GitHub] spark issue #16053: [SPARK-17931] Eliminate unncessary task (de) serializati...

2016-11-28 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16053 **[Test build #69301 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69301/consoleFull)** for PR 16053 at commit

[GitHub] spark issue #16045: [SPARK-18553][CORE] Fix leak of TaskSetManager following...

2016-11-28 Thread JoshRosen
Github user JoshRosen commented on the issue: https://github.com/apache/spark/pull/16045 Jenkins, retest this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and

[GitHub] spark issue #16052: [SPARK-18617][CORE][STREAMING] Close "kryo auto pick" fe...

2016-11-28 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16052 **[Test build #69303 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69303/consoleFull)** for PR 16052 at commit

[GitHub] spark issue #15505: [SPARK-17931][CORE] taskScheduler has some unneeded seri...

2016-11-28 Thread kayousterhout
Github user kayousterhout commented on the issue: https://github.com/apache/spark/pull/15505 @witgo I took a look at this and had an idea for an alternate approach that is much simpler. Can you take a look at #16053 and let me know what you think? If we decide to go with the

[GitHub] spark issue #13557: [SPARK-15819][PYSPARK][ML] Add KMeanSummary in KMeans of...

2016-11-28 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13557 **[Test build #69302 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69302/consoleFull)** for PR 13557 at commit

[GitHub] spark issue #16053: [SPARK-17931] Eliminate unncessary task (de) serializati...

2016-11-28 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16053 **[Test build #69301 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69301/consoleFull)** for PR 16053 at commit

[GitHub] spark pull request #16053: [SPARK-17931] Eliminate unncessary task (de) seri...

2016-11-28 Thread kayousterhout
GitHub user kayousterhout opened a pull request: https://github.com/apache/spark/pull/16053 [SPARK-17931] Eliminate unncessary task (de) serialization ## What changes were proposed in this pull request? In the existing code, there are three layers of serialization

[GitHub] spark issue #15949: [SPARK-18339] [SPARK-18513] [SQL] Don't push down curren...

2016-11-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15949 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/69294/ Test PASSed. ---

[GitHub] spark issue #15949: [SPARK-18339] [SPARK-18513] [SQL] Don't push down curren...

2016-11-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15949 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #15949: [SPARK-18339] [SPARK-18513] [SQL] Don't push down curren...

2016-11-28 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15949 **[Test build #69294 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69294/consoleFull)** for PR 15949 at commit

[GitHub] spark issue #15620: [SPARK-18091] [SQL] Deep if expressions cause Generated ...

2016-11-28 Thread kapilsingh5050
Github user kapilsingh5050 commented on the issue: https://github.com/apache/spark/pull/15620 I'm not sure whether I understand the problem completely. It seems WholeStage CodeGen wants the complete stage code in a single function. The fix I made violates this because it creates

[GitHub] spark issue #16052: [SPARK-18617][CORE][STREAMING] Close "kryo auto pick" fe...

2016-11-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16052 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #16052: [SPARK-18617][CORE][STREAMING] Close "kryo auto pick" fe...

2016-11-28 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16052 **[Test build #69300 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69300/consoleFull)** for PR 16052 at commit

[GitHub] spark issue #16052: [SPARK-18617][CORE][STREAMING] Close "kryo auto pick" fe...

2016-11-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16052 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/69300/ Test FAILed. ---

[GitHub] spark issue #16011: [SPARK-18587][ML] Remove handleInvalid from QuantileDisc...

2016-11-28 Thread yanboliang
Github user yanboliang commented on the issue: https://github.com/apache/spark/pull/16011 That's OK. I will improve the docs in another 2.1 QA PR and close this one. Thanks for all your clarification. @MLnick @jkbradley --- If your project is set up for it, you can reply to this

[GitHub] spark issue #15848: [SPARK-9487] Use the same num. worker threads in Java/Sc...

2016-11-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15848 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark pull request #16011: [SPARK-18587][ML] Remove handleInvalid from Quant...

2016-11-28 Thread yanboliang
Github user yanboliang closed the pull request at: https://github.com/apache/spark/pull/16011 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature

[GitHub] spark issue #15848: [SPARK-9487] Use the same num. worker threads in Java/Sc...

2016-11-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15848 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/69297/ Test FAILed. ---

[GitHub] spark issue #15848: [SPARK-9487] Use the same num. worker threads in Java/Sc...

2016-11-28 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15848 **[Test build #69297 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69297/consoleFull)** for PR 15848 at commit

[GitHub] spark issue #16052: [SPARK-18617][CORE][STREAMING] Close "kryo auto pick" fe...

2016-11-28 Thread uncleGen
Github user uncleGen commented on the issue: https://github.com/apache/spark/pull/16052 cc @zsxwing --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if

[GitHub] spark issue #16052: [SPARK-18617][CORE][STREAMING] Close "kryo auto pick" fe...

2016-11-28 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16052 **[Test build #69300 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69300/consoleFull)** for PR 16052 at commit

[GitHub] spark pull request #15255: [SPARK-17680] [SQL] [TEST] Added a Testcase for V...

2016-11-28 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/15255#discussion_r89946590 --- Diff: sql/hive/src/test/scala/org/apache/spark/sql/hive/execution/HiveDDLSuite.scala --- @@ -148,6 +148,52 @@ class HiveDDLSuite } }

[GitHub] spark pull request #16052: [SPARK-18617][CORE][STREAMING] Close "kryo auto p...

2016-11-28 Thread uncleGen
GitHub user uncleGen opened a pull request: https://github.com/apache/spark/pull/16052 [SPARK-18617][CORE][STREAMING] Close "kryo auto pick" feature for Spark Streaming ## What changes were proposed in this pull request? #15992 provided a solution to fix the bug, i.e.

[GitHub] spark issue #15255: [SPARK-17680] [SQL] [TEST] Added a Testcase for Verifyin...

2016-11-28 Thread gatorsmile
Github user gatorsmile commented on the issue: https://github.com/apache/spark/pull/15255 cc @cloud-fan Could you review this PR? Thanks! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request #15975: [SPARK-18538] [SQL] Fix Concurrent Table Fetching...

2016-11-28 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/15975#discussion_r89946424 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/jdbc/JDBCOptions.scala --- @@ -76,9 +76,6 @@ class JDBCOptions(

[GitHub] spark pull request #15877: [SPARK-18429] [SQL] implement a new Aggregate for...

2016-11-28 Thread rxin
Github user rxin commented on a diff in the pull request: https://github.com/apache/spark/pull/15877#discussion_r89946344 --- Diff: common/sketch/src/main/java/org/apache/spark/util/sketch/CountMinSketchImpl.java --- @@ -152,6 +153,16 @@ public void add(Object item) {

[GitHub] spark pull request #15975: [SPARK-18538] [SQL] Fix Concurrent Table Fetching...

2016-11-28 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/15975#discussion_r89946224 --- Diff: sql/core/src/test/scala/org/apache/spark/sql/jdbc/JDBCSuite.scala --- @@ -209,6 +209,14 @@ class JDBCSuite extends SparkFunSuite

[GitHub] spark pull request #16000: [SPARK-18537][Web UI]Add a REST api to spark stre...

2016-11-28 Thread ChorPangChan
Github user ChorPangChan commented on a diff in the pull request: https://github.com/apache/spark/pull/16000#discussion_r89945721 --- Diff: streaming/src/main/scala/org/apache/spark/streaming/ui/StreamingPage.scala --- @@ -145,6 +146,10 @@ private[ui] class StreamingPage(parent:

[GitHub] spark pull request #15983: [SPARK-18544] [SQL] Append with df.saveAsTable wr...

2016-11-28 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/15983 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark pull request #15975: [SPARK-18538] [SQL] Fix Concurrent Table Fetching...

2016-11-28 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/15975#discussion_r89945683 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/jdbc/JdbcUtils.scala --- @@ -667,13 +667,13 @@ object JdbcUtils extends

[GitHub] spark pull request #14517: [SPARK-16931][PYTHON] PySpark APIS for bucketBy a...

2016-11-28 Thread HyukjinKwon
Github user HyukjinKwon commented on a diff in the pull request: https://github.com/apache/spark/pull/14517#discussion_r89945485 --- Diff: python/pyspark/sql/readwriter.py --- @@ -747,16 +800,25 @@ def _test(): except py4j.protocol.Py4JError: spark =

[GitHub] spark issue #15983: [SPARK-18544] [SQL] Append with df.saveAsTable writes da...

2016-11-28 Thread rxin
Github user rxin commented on the issue: https://github.com/apache/spark/pull/15983 Merging in master/branch-2.1. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and

[GitHub] spark issue #15620: [SPARK-18091] [SQL] Deep if expressions cause Generated ...

2016-11-28 Thread rxin
Github user rxin commented on the issue: https://github.com/apache/spark/pull/15620 @kapilsingh5050 any update? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and

[GitHub] spark issue #16014: [SPARK-18590][SPARKR] build R source package when making...

2016-11-28 Thread rxin
Github user rxin commented on the issue: https://github.com/apache/spark/pull/16014 Why is this a blocker thing? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and

[GitHub] spark issue #16048: [DO_NOT_MERGE]Test kafka deletion

2016-11-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16048 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #16048: [DO_NOT_MERGE]Test kafka deletion

2016-11-28 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16048 **[Test build #69284 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69284/consoleFull)** for PR 16048 at commit

[GitHub] spark issue #16048: [DO_NOT_MERGE]Test kafka deletion

2016-11-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16048 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/69284/ Test FAILed. ---

[GitHub] spark pull request #16041: [SPARK-18058][SQL][TRIVIAL] Use dataType.sameResu...

2016-11-28 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/16041 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark issue #16041: [SPARK-18058][SQL][TRIVIAL] Use dataType.sameResult(...)...

2016-11-28 Thread rxin
Github user rxin commented on the issue: https://github.com/apache/spark/pull/16041 Merging in master/branch-2.1. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and

[GitHub] spark issue #16028: [SPARK-18518][ML] HasSolver supports override

2016-11-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16028 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark pull request #16000: [SPARK-18537][Web UI]Add a REST api to spark stre...

2016-11-28 Thread ajbozarth
Github user ajbozarth commented on a diff in the pull request: https://github.com/apache/spark/pull/16000#discussion_r89943946 --- Diff: streaming/src/main/scala/org/apache/spark/streaming/ui/StreamingPage.scala --- @@ -145,6 +146,10 @@ private[ui] class StreamingPage(parent:

[GitHub] spark issue #16028: [SPARK-18518][ML] HasSolver supports override

2016-11-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16028 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/69298/ Test FAILed. ---

[GitHub] spark issue #16028: [SPARK-18518][ML] HasSolver supports override

2016-11-28 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16028 **[Test build #69298 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69298/consoleFull)** for PR 16028 at commit

[GitHub] spark issue #15954: [WIP][SPARK-18516][SQL] Split state and progress in stre...

2016-11-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15954 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/69290/ Test FAILed. ---

[GitHub] spark issue #15954: [WIP][SPARK-18516][SQL] Split state and progress in stre...

2016-11-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15954 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #15954: [WIP][SPARK-18516][SQL] Split state and progress in stre...

2016-11-28 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15954 **[Test build #69290 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69290/consoleFull)** for PR 15954 at commit

[GitHub] spark pull request #16033: SPARK-18607 get a result on a percent of the task...

2016-11-28 Thread rxin
Github user rxin commented on a diff in the pull request: https://github.com/apache/spark/pull/16033#discussion_r89942478 --- Diff: core/src/main/scala/org/apache/spark/partial/ApproximateActionListener.scala --- @@ -34,11 +34,13 @@ private[spark] class

[GitHub] spark issue #15935: [SPARK-18188] add checksum for blocks of broadcast

2016-11-28 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15935 **[Test build #69299 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69299/consoleFull)** for PR 15935 at commit

[GitHub] spark pull request #15981: [SPARK-18547][core] Propagate I/O encryption key ...

2016-11-28 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/15981 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark issue #15935: [SPARK-18188] add checksum for blocks of broadcast

2016-11-28 Thread zsxwing
Github user zsxwing commented on the issue: https://github.com/apache/spark/pull/15935 retest this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so,

[GitHub] spark issue #15981: [SPARK-18547][core] Propagate I/O encryption key when ex...

2016-11-28 Thread zsxwing
Github user zsxwing commented on the issue: https://github.com/apache/spark/pull/15981 LGTM. The build for the latest commit passed. Merging to master and 2.1. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark issue #13690: [SPARK-15767][R][ML] Decision Tree Regression wrapper in...

2016-11-28 Thread HyukjinKwon
Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/13690 gentle ping @vectorijk --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and

[GitHub] spark pull request #16051: [SPARK-18588][SS][Kafka]Ignore the flaky kafka te...

2016-11-28 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/16051 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark issue #16051: [SPARK-18588][SS][Kafka]Ignore the flaky kafka test

2016-11-28 Thread zsxwing
Github user zsxwing commented on the issue: https://github.com/apache/spark/pull/16051 Merging to master and 2.1 to unblock other PRs. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[GitHub] spark issue #16051: [SPARK-18588][SS][Kafka]Ignore the flaky kafka test

2016-11-28 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16051 **[Test build #69296 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69296/consoleFull)** for PR 16051 at commit

[GitHub] spark issue #16051: [SPARK-18588][SS][Kafka]Ignore the flaky kafka test

2016-11-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16051 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/69296/ Test PASSed. ---

[GitHub] spark issue #16051: [SPARK-18588][SS][Kafka]Ignore the flaky kafka test

2016-11-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16051 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #15954: [WIP][SPARK-18516][SQL] Split state and progress in stre...

2016-11-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15954 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/69288/ Test FAILed. ---

[GitHub] spark issue #15954: [WIP][SPARK-18516][SQL] Split state and progress in stre...

2016-11-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15954 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #16028: [SPARK-18518][ML] HasSolver supports override

2016-11-28 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16028 **[Test build #69298 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69298/consoleFull)** for PR 16028 at commit

[GitHub] spark issue #15954: [WIP][SPARK-18516][SQL] Split state and progress in stre...

2016-11-28 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15954 **[Test build #69288 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69288/consoleFull)** for PR 15954 at commit

[GitHub] spark issue #16050: [SPARK-18615][DOCS] Switch to multi-line doc to avoid a ...

2016-11-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16050 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/69285/ Test PASSed. ---

[GitHub] spark issue #16050: [SPARK-18615][DOCS] Switch to multi-line doc to avoid a ...

2016-11-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16050 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #16050: [SPARK-18615][DOCS] Switch to multi-line doc to avoid a ...

2016-11-28 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16050 **[Test build #69285 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69285/consoleFull)** for PR 16050 at commit

[GitHub] spark issue #16044: [Spark-18614][SQL] Incorrect predicate pushdown from Exi...

2016-11-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16044 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/69287/ Test PASSed. ---

[GitHub] spark issue #16044: [Spark-18614][SQL] Incorrect predicate pushdown from Exi...

2016-11-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16044 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #16044: [Spark-18614][SQL] Incorrect predicate pushdown from Exi...

2016-11-28 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16044 **[Test build #69287 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69287/consoleFull)** for PR 16044 at commit

[GitHub] spark issue #15954: [WIP][SPARK-18516][SQL] Split state and progress in stre...

2016-11-28 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15954 **[Test build #69293 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69293/consoleFull)** for PR 15954 at commit

[GitHub] spark issue #15954: [WIP][SPARK-18516][SQL] Split state and progress in stre...

2016-11-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15954 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #15954: [WIP][SPARK-18516][SQL] Split state and progress in stre...

2016-11-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15954 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/69293/ Test FAILed. ---

[GitHub] spark issue #15848: [SPARK-9487] Use the same num. worker threads in Java/Sc...

2016-11-28 Thread skanjila
Github user skanjila commented on the issue: https://github.com/apache/spark/pull/15848 I've changed the underlying trait for LogisticRegressionSuite and OneVsRestSuite to use local[2], will add in python changes next , want to get this PR across with this set of changes --- If

[GitHub] spark pull request #16049: [SPARK-16282][SQL] Follow-up: remove "percentile"...

2016-11-28 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/16049 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark issue #15848: [SPARK-9487] Use the same num. worker threads in Java/Sc...

2016-11-28 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15848 **[Test build #69297 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69297/consoleFull)** for PR 15848 at commit

[GitHub] spark issue #16049: [SPARK-16282][SQL] Follow-up: remove "percentile" from t...

2016-11-28 Thread gatorsmile
Github user gatorsmile commented on the issue: https://github.com/apache/spark/pull/16049 Merging to master/2.1! Thanks! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled

[GitHub] spark issue #16045: [SPARK-18553][CORE] Fix leak of TaskSetManager following...

2016-11-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16045 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/69286/ Test FAILed. ---

[GitHub] spark issue #16045: [SPARK-18553][CORE] Fix leak of TaskSetManager following...

2016-11-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16045 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #16045: [SPARK-18553][CORE] Fix leak of TaskSetManager following...

2016-11-28 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16045 **[Test build #69286 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69286/consoleFull)** for PR 16045 at commit

  1   2   3   4   5   6   7   >