[GitHub] spark issue #18039: [SPARK-20751][SQL] Add cot test in MathExpressionsSuite

2017-05-20 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18039 **[Test build #77117 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/77117/testReport)** for PR 18039 at commit

[GitHub] spark issue #18039: [SPARK-20751][SQL] Add cot test in MathExpressionsSuite

2017-05-20 Thread wangyum
Github user wangyum commented on the issue: https://github.com/apache/spark/pull/18039 Jenkins, retest this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and

[GitHub] spark pull request #12646: [SPARK-14878][SQL] Trim characters string functio...

2017-05-20 Thread wzhfy
Github user wzhfy commented on a diff in the pull request: https://github.com/apache/spark/pull/12646#discussion_r117604491 --- Diff: common/unsafe/src/main/java/org/apache/spark/unsafe/types/UTF8String.java --- @@ -510,6 +510,69 @@ public UTF8String trim() { } }

[GitHub] spark issue #17298: [SPARK-19094][WIP][PySpark] Plumb through logging for IJ...

2017-05-20 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17298 **[Test build #77118 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/77118/testReport)** for PR 17298 at commit

[GitHub] spark pull request #17308: [SPARK-19968][SPARK-20737][SS] Use a cached insta...

2017-05-20 Thread viirya
Github user viirya commented on a diff in the pull request: https://github.com/apache/spark/pull/17308#discussion_r117605187 --- Diff: external/kafka-0-10-sql/src/test/scala/org/apache/spark/sql/kafka010/CanonicalizeKafkaParamsSuite.scala --- @@ -0,0 +1,61 @@ +/* + *

[GitHub] spark pull request #17308: [SPARK-19968][SPARK-20737][SS] Use a cached insta...

2017-05-20 Thread viirya
Github user viirya commented on a diff in the pull request: https://github.com/apache/spark/pull/17308#discussion_r117605188 --- Diff: external/kafka-0-10-sql/src/test/scala/org/apache/spark/sql/kafka010/CanonicalizeKafkaParamsSuite.scala --- @@ -0,0 +1,61 @@ +/* + *

[GitHub] spark issue #18038: [MINOR][SPARKRSQL]Remove unnecessary comment in SqlBase....

2017-05-20 Thread srowen
Github user srowen commented on the issue: https://github.com/apache/spark/pull/18038 It still leads to the underlying issue. Why remove? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[GitHub] spark issue #18042: [SPARK-20817][core] Benchmark.getProcessorName() returns...

2017-05-20 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18042 **[Test build #77119 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/77119/testReport)** for PR 18042 at commit

[GitHub] spark issue #17298: [SPARK-19094][WIP][PySpark] Plumb through logging for IJ...

2017-05-20 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17298 **[Test build #77122 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/77122/testReport)** for PR 17298 at commit

[GitHub] spark pull request #18043: [SPARK-20506][DOCS] Add HTML links to highlight l...

2017-05-20 Thread MLnick
GitHub user MLnick opened a pull request: https://github.com/apache/spark/pull/18043 [SPARK-20506][DOCS] Add HTML links to highlight list Quick follow up to #17996 - forgot to add the HTML links to the relevant sections of the guide in the highlights list. ## How was this

[GitHub] spark issue #17996: [SPARK-20506][DOCS] 2.2 migration guide

2017-05-20 Thread MLnick
Github user MLnick commented on the issue: https://github.com/apache/spark/pull/17996 I actually realized I forgot to add the HTML links to the relevant guide sections in the highlight list - opened a little PR at #18043 to fix that. --- If your project is set up for it, you can

[GitHub] spark issue #17967: [SPARK-14659][ML] RFormula consistent with R when handli...

2017-05-20 Thread actuaryzhang
Github user actuaryzhang commented on the issue: https://github.com/apache/spark/pull/17967 @felixcheung @HyukjinKwon Thanks much for pointing out the documentation issues. I still prefer to have a table to clearly illustrate what each option is doing. Made a new commit to

[GitHub] spark pull request #18041: [SPARK-20816][CORE] MetricsConfig doen't trim the...

2017-05-20 Thread LantaoJin
GitHub user LantaoJin opened a pull request: https://github.com/apache/spark/pull/18041 [SPARK-20816][CORE] MetricsConfig doen't trim the properties file cau… …se the exception very confused ## What changes were proposed in this pull request? (Please fill in

[GitHub] spark issue #17967: [SPARK-14659][ML] RFormula consistent with R when handli...

2017-05-20 Thread HyukjinKwon
Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/17967 (FWIW, `{{{ ... }}}` should work for Javadoc too given my past try - https://github.com/apache/spark/pull/15999#discussion_r89580586) --- If your project is set up for it, you can reply to

[GitHub] spark issue #18022: [SPARK-20790] [MLlib] Correctly handle negative values f...

2017-05-20 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18022 **[Test build #3745 has started](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/3745/testReport)** for PR 18022 at commit

[GitHub] spark pull request #18042: [SPARK-20817][core] Benchmark.getProcessorName() ...

2017-05-20 Thread kiszk
GitHub user kiszk opened a pull request: https://github.com/apache/spark/pull/18042 [SPARK-20817][core] Benchmark.getProcessorName() returns "Unknown processor" on ppc and 390 platforms ## What changes were proposed in this pull request? This PR fixes that

[GitHub] spark issue #17996: [SPARK-20506][DOCS] 2.2 migration guide

2017-05-20 Thread MLnick
Github user MLnick commented on the issue: https://github.com/apache/spark/pull/17996 @felixcheung ok - the KMeans behavior change was in 2.1 actually (so not in this migration guide, in this PR it was moved to the "old versions migration guides" page). For `spark.lda` issue

[GitHub] spark pull request #18044: Branch 2.2

2017-05-20 Thread NewBoLing
GitHub user NewBoLing opened a pull request: https://github.com/apache/spark/pull/18044 Branch 2.2 ## What changes were proposed in this pull request? (Please fill in changes proposed in this fix) ## How was this patch tested? (Please explain how this

[GitHub] spark issue #18039: [SPARK-20751][SQL] Add cot test in MathExpressionsSuite

2017-05-20 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18039 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #18039: [SPARK-20751][SQL] Add cot test in MathExpressionsSuite

2017-05-20 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18039 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/77113/ Test FAILed. ---

[GitHub] spark issue #17953: [SPARK-20680][SQL] Spark-sql do not support for void col...

2017-05-20 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17953 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/77115/ Test FAILed. ---

[GitHub] spark issue #17953: [SPARK-20680][SQL] Spark-sql do not support for void col...

2017-05-20 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17953 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #18039: [SPARK-20751][SQL] Add cot test in MathExpressionsSuite

2017-05-20 Thread wzhfy
Github user wzhfy commented on the issue: https://github.com/apache/spark/pull/18039 It's a followup pr for [SPARK-20751](https://github.com/apache/spark/commit/bff021dfaf4b5c9ab84c71dad2a37f60907e32d6). Could you add a followup tag in the title? --- If your project is set up for

[GitHub] spark issue #17967: [SPARK-14659][ML] RFormula consistent with R when handli...

2017-05-20 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17967 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/77116/ Test PASSed. ---

[GitHub] spark issue #17967: [SPARK-14659][ML] RFormula consistent with R when handli...

2017-05-20 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17967 **[Test build #77116 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/77116/testReport)** for PR 17967 at commit

[GitHub] spark pull request #18040: [SPARK-20815] [SPARKR] NullPointerException in RP...

2017-05-20 Thread jrshust
GitHub user jrshust opened a pull request: https://github.com/apache/spark/pull/18040 [SPARK-20815] [SPARKR] NullPointerException in RPackageUtils#checkManifestForR ## What changes were proposed in this pull request? - Add a null check to RPackageUtils#checkManifestForR so

[GitHub] spark issue #18010: [SPARK-20778][SQL] Implement array_intersect function.

2017-05-20 Thread srowen
Github user srowen commented on the issue: https://github.com/apache/spark/pull/18010 Per comment in the JIRA, I don't think this should be added. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request #18031: [SPARK-20801] Record accurate size of blocks in M...

2017-05-20 Thread wzhfy
Github user wzhfy commented on a diff in the pull request: https://github.com/apache/spark/pull/18031#discussion_r117605849 --- Diff: core/src/main/scala/org/apache/spark/scheduler/MapStatus.scala --- @@ -193,8 +219,27 @@ private[spark] object HighlyCompressedMapStatus { }

[GitHub] spark issue #17298: [SPARK-19094][WIP][PySpark] Plumb through logging for IJ...

2017-05-20 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17298 **[Test build #77120 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/77120/testReport)** for PR 17298 at commit

[GitHub] spark issue #18043: [SPARK-20506][DOCS] Add HTML links to highlight list in ...

2017-05-20 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18043 **[Test build #77123 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/77123/testReport)** for PR 18043 at commit

[GitHub] spark issue #18043: [SPARK-20506][DOCS] Add HTML links to highlight list in ...

2017-05-20 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18043 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/77123/ Test PASSed. ---

[GitHub] spark issue #18043: [SPARK-20506][DOCS] Add HTML links to highlight list in ...

2017-05-20 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18043 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #18040: [SPARK-20815] [SPARKR] NullPointerException in RPackageU...

2017-05-20 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18040 Can one of the admins verify this patch? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[GitHub] spark issue #18041: [SPARK-20816][CORE] MetricsConfig doen't trim the proper...

2017-05-20 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18041 Can one of the admins verify this patch? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[GitHub] spark pull request #18031: [SPARK-20801] Record accurate size of blocks in M...

2017-05-20 Thread viirya
Github user viirya commented on a diff in the pull request: https://github.com/apache/spark/pull/18031#discussion_r117606196 --- Diff: core/src/main/scala/org/apache/spark/scheduler/MapStatus.scala --- @@ -121,48 +126,69 @@ private[spark] class CompressedMapStatus( }

[GitHub] spark issue #17923: [SPARK-20591][WEB UI] Succeeded tasks num not equal in a...

2017-05-20 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17923 **[Test build #3743 has started](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/3743/testReport)** for PR 17923 at commit

[GitHub] spark issue #17869: [SPARK-20609][CORE]Run the SortShuffleSuite unit tests h...

2017-05-20 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17869 **[Test build #3744 has started](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/3744/testReport)** for PR 17869 at commit

[GitHub] spark issue #18043: [SPARK-20506][DOCS] Add HTML links to highlight list in ...

2017-05-20 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18043 **[Test build #77123 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/77123/testReport)** for PR 18043 at commit

[GitHub] spark issue #18044: Branch 2.2

2017-05-20 Thread srowen
Github user srowen commented on the issue: https://github.com/apache/spark/pull/18044 @NewBoLing close this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and

[GitHub] spark issue #18044: Branch 2.2

2017-05-20 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18044 Can one of the admins verify this patch? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[GitHub] spark pull request #17308: [SPARK-19968][SPARK-20737][SS] Use a cached insta...

2017-05-20 Thread viirya
Github user viirya commented on a diff in the pull request: https://github.com/apache/spark/pull/17308#discussion_r117604874 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/streaming/StreamExecution.scala --- @@ -683,6 +685,17 @@ class StreamExecution( }

[GitHub] spark pull request #17308: [SPARK-19968][SPARK-20737][SS] Use a cached insta...

2017-05-20 Thread viirya
Github user viirya commented on a diff in the pull request: https://github.com/apache/spark/pull/17308#discussion_r117605102 --- Diff: external/kafka-0-10-sql/src/main/scala/org/apache/spark/sql/kafka010/KafkaSink.scala --- @@ -22,6 +22,7 @@ import java.{util => ju} import

[GitHub] spark issue #18039: [SPARK-20751][SQL][FOLLOWUP] Add cot test in MathExpress...

2017-05-20 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18039 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/77117/ Test PASSed. ---

[GitHub] spark issue #18039: [SPARK-20751][SQL][FOLLOWUP] Add cot test in MathExpress...

2017-05-20 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18039 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #18039: [SPARK-20751][SQL][FOLLOWUP] Add cot test in MathExpress...

2017-05-20 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18039 **[Test build #77117 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/77117/testReport)** for PR 18039 at commit

[GitHub] spark issue #17978: [SPARK-20736][Python] PySpark StringIndexer supports Str...

2017-05-20 Thread MLnick
Github user MLnick commented on the issue: https://github.com/apache/spark/pull/17978 LGTM @felixcheung --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so,

[GitHub] spark issue #17967: [SPARK-14659][ML] RFormula consistent with R when handli...

2017-05-20 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17967 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark pull request #17308: [SPARK-19968][SPARK-20737][SS] Use a cached insta...

2017-05-20 Thread viirya
Github user viirya commented on a diff in the pull request: https://github.com/apache/spark/pull/17308#discussion_r117604954 --- Diff: external/kafka-0-10-sql/src/main/scala/org/apache/spark/sql/kafka010/CachedKafkaProducer.scala --- @@ -0,0 +1,148 @@ +/* + * Licensed to

[GitHub] spark issue #17967: [SPARK-14659][ML] RFormula consistent with R when handli...

2017-05-20 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17967 **[Test build #77116 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/77116/testReport)** for PR 17967 at commit

[GitHub] spark pull request #18031: [SPARK-20801] Record accurate size of blocks in M...

2017-05-20 Thread viirya
Github user viirya commented on a diff in the pull request: https://github.com/apache/spark/pull/18031#discussion_r117605781 --- Diff: core/src/main/scala/org/apache/spark/scheduler/MapStatus.scala --- @@ -193,8 +219,27 @@ private[spark] object HighlyCompressedMapStatus {

[GitHub] spark pull request #16989: [SPARK-19659] Fetch big blocks to disk when shuff...

2017-05-20 Thread viirya
Github user viirya commented on a diff in the pull request: https://github.com/apache/spark/pull/16989#discussion_r117606109 --- Diff: core/src/main/scala/org/apache/spark/internal/config/package.scala --- @@ -278,4 +278,21 @@ package object config {

[GitHub] spark issue #17298: [SPARK-19094][WIP][PySpark] Plumb through logging for IJ...

2017-05-20 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17298 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #17298: [SPARK-19094][WIP][PySpark] Plumb through logging for IJ...

2017-05-20 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17298 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/77118/ Test FAILed. ---

[GitHub] spark issue #17298: [SPARK-19094][WIP][PySpark] Plumb through logging for IJ...

2017-05-20 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17298 **[Test build #77118 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/77118/testReport)** for PR 17298 at commit

[GitHub] spark issue #18025: [WIP][SparkR] Update doc and examples for sql functions

2017-05-20 Thread actuaryzhang
Github user actuaryzhang commented on the issue: https://github.com/apache/spark/pull/18025 @felixcheung I'm curious what is the motivation to remove the style `avg,Column-method`? This is the default and preferred (I believe) way to reference to S4 methods in R. Suppose

[GitHub] spark pull request #18034: [SPARK-20797][MLLIB]fix LocalLDAModel.save() bug.

2017-05-20 Thread srowen
Github user srowen commented on a diff in the pull request: https://github.com/apache/spark/pull/18034#discussion_r117606918 --- Diff: mllib/src/main/scala/org/apache/spark/mllib/clustering/LDAModel.scala --- @@ -468,7 +469,16 @@ object LocalLDAModel extends Loader[LocalLDAModel]

[GitHub] spark issue #18029: [SPARK-20168][WIP][DStream] Add changes to use kinesis f...

2017-05-20 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18029 **[Test build #77121 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/77121/testReport)** for PR 18029 at commit

[GitHub] spark issue #18041: [SPARK-20816][CORE] MetricsConfig doen't trim the proper...

2017-05-20 Thread srowen
Github user srowen commented on the issue: https://github.com/apache/spark/pull/18041 Why do you think this relates to trimming whitespace? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark issue #17558: [SPARK-20247][CORE] Add jar but this jar is missing late...

2017-05-20 Thread barrybecker4
Github user barrybecker4 commented on the issue: https://github.com/apache/spark/pull/17558 I just checked out the spark branch-2.1 branch. I can build everything successfully if I do not run the tests, but if I run the tests, I see this unit test failure: {code} add jar

[GitHub] spark issue #17150: [SPARK-19810][BUILD][CORE] Remove support for Scala 2.10

2017-05-20 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17150 **[Test build #77124 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/77124/testReport)** for PR 17150 at commit

[GitHub] spark issue #18045: Update SVDPlusPlus.scala

2017-05-20 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18045 Can one of the admins verify this patch? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[GitHub] spark issue #18022: [SPARK-20790] [MLlib] Correctly handle negative values f...

2017-05-20 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18022 **[Test build #3745 has finished](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/3745/testReport)** for PR 18022 at commit

[GitHub] spark issue #17869: [SPARK-20609][CORE]Run the SortShuffleSuite unit tests h...

2017-05-20 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17869 **[Test build #3744 has finished](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/3744/testReport)** for PR 17869 at commit

[GitHub] spark issue #17899: [SPARK-20636] Add new optimization rule to flip adjacent...

2017-05-20 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17899 **[Test build #77126 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/77126/testReport)** for PR 17899 at commit

[GitHub] spark issue #18029: [SPARK-20168][WIP][DStream] Add changes to use kinesis f...

2017-05-20 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18029 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #18029: [SPARK-20168][WIP][DStream] Add changes to use kinesis f...

2017-05-20 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18029 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/77121/ Test FAILed. ---

[GitHub] spark issue #17758: [SPARK-20460][SQL] Make it more consistent to handle col...

2017-05-20 Thread maropu
Github user maropu commented on the issue: https://github.com/apache/spark/pull/17758 @gatorsmile ping --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or

[GitHub] spark issue #18029: [SPARK-20168][WIP][DStream] Add changes to use kinesis f...

2017-05-20 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18029 **[Test build #77121 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/77121/testReport)** for PR 18029 at commit

[GitHub] spark issue #17400: [SPARK-19981][SQL] Update output partitioning info. when...

2017-05-20 Thread maropu
Github user maropu commented on the issue: https://github.com/apache/spark/pull/17400 @gatorsmile ping --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or

[GitHub] spark issue #17899: [SPARK-20636] Add new optimization rule to flip adjacent...

2017-05-20 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17899 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/77126/ Test PASSed. ---

[GitHub] spark issue #17899: [SPARK-20636] Add new optimization rule to flip adjacent...

2017-05-20 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17899 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #17558: [SPARK-20247][CORE] Add jar but this jar is missing late...

2017-05-20 Thread barrybecker4
Github user barrybecker4 commented on the issue: https://github.com/apache/spark/pull/17558 The 3rd time I ran, it ran for 42 minutes, and failed further on in catalyst tests. Like you say, it does seem that the tests are flaky, but why? The failures seem so random. ```

[GitHub] spark issue #17435: [SPARK-20098][PYSPARK] dataType's typeName fix

2017-05-20 Thread szalai1
Github user szalai1 commented on the issue: https://github.com/apache/spark/pull/17435 @holdenk I am happy to contribute to this project. I changed the error message and added a test case. --- If your project is set up for it, you can reply to this email and have your reply appear

[GitHub] spark pull request #17940: [SPARK-20687][MLLIB] mllib.Matrices.fromBreeze ma...

2017-05-20 Thread hhbyyh
Github user hhbyyh commented on a diff in the pull request: https://github.com/apache/spark/pull/17940#discussion_r117592116 --- Diff: mllib/src/main/scala/org/apache/spark/mllib/linalg/Matrices.scala --- @@ -992,7 +992,16 @@ object Matrices { new DenseMatrix(dm.rows,

[GitHub] spark issue #17923: [SPARK-20591][WEB UI] Succeeded tasks num not equal in a...

2017-05-20 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17923 **[Test build #3743 has finished](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/3743/testReport)** for PR 17923 at commit

[GitHub] spark issue #17923: [SPARK-20591][WEB UI] Succeeded tasks num not equal in a...

2017-05-20 Thread fjh100456
Github user fjh100456 commented on the issue: https://github.com/apache/spark/pull/17923 Yes, I've fixed the use case and bugs. @srowen --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[GitHub] spark issue #18045: Update SVDPlusPlus.scala

2017-05-20 Thread srowen
Github user srowen commented on the issue: https://github.com/apache/spark/pull/18045 Please read http://spark.apache.org/contributing.html and fix the title Does it make sense to send updateP twice? Maybe @ankurdave can return to comment --- If your project is set up for it,

[GitHub] spark pull request #18031: [SPARK-20801] Record accurate size of blocks in M...

2017-05-20 Thread viirya
Github user viirya commented on a diff in the pull request: https://github.com/apache/spark/pull/18031#discussion_r117610528 --- Diff: core/src/main/scala/org/apache/spark/scheduler/MapStatus.scala --- @@ -193,8 +219,27 @@ private[spark] object HighlyCompressedMapStatus {

[GitHub] spark issue #18040: [SPARK-20815] [SPARKR] NullPointerException in RPackageU...

2017-05-20 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18040 **[Test build #77128 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/77128/testReport)** for PR 18040 at commit

[GitHub] spark issue #18037: [SPARK-20814][mesos] Restore support for spark.executor....

2017-05-20 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18037 **[Test build #77129 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/77129/testReport)** for PR 18037 at commit

[GitHub] spark issue #18029: [SPARK-20168][WIP][DStream] Add changes to use kinesis f...

2017-05-20 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18029 **[Test build #77125 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/77125/testReport)** for PR 18029 at commit

[GitHub] spark issue #17923: [SPARK-20591][WEB UI] Succeeded tasks num not equal in a...

2017-05-20 Thread srowen
Github user srowen commented on the issue: https://github.com/apache/spark/pull/17923 Oh @fjh100456 actually this test failure is legitimate, not due to recent Jenkins problems. The UI test needs to reflect the new display. `Cause:

[GitHub] spark issue #17982: [SPARK-20395][BUILD] Update Scala to 2.11.11 and zinc to...

2017-05-20 Thread srowen
Github user srowen commented on the issue: https://github.com/apache/spark/pull/17982 Darn. I don't know if this is going to work. I'm closing this for now. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark pull request #18032: [SPARK-20806][DEPLOY] Launcher: redundant check f...

2017-05-20 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/18032 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark pull request #17982: [SPARK-20395][BUILD] Update Scala to 2.11.11 and ...

2017-05-20 Thread srowen
Github user srowen closed the pull request at: https://github.com/apache/spark/pull/17982 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark issue #17558: [SPARK-20247][CORE] Add jar but this jar is missing late...

2017-05-20 Thread barrybecker4
Github user barrybecker4 commented on the issue: https://github.com/apache/spark/pull/17558 I ran it again, and got a different failure this time. Still in the core module, but not sure if its before or after the tests that failed the first time. ``` - caching in memory,

[GitHub] spark issue #18041: [SPARK-20816][CORE] MetricsConfig doen't trim the proper...

2017-05-20 Thread LantaoJin
Github user LantaoJin commented on the issue: https://github.com/apache/spark/pull/18041 @srowen It's not a real normal class not found case. And I do know what happened here. What I point out is a case that a whitespace at the end of the class name will cause ClassNotFound

[GitHub] spark issue #18038: [MINOR][SPARKRSQL]Remove unnecessary comment in SqlBase....

2017-05-20 Thread lys0716
Github user lys0716 commented on the issue: https://github.com/apache/spark/pull/18038 Sorry, it is duplicate to https://github.com/antlr/antlr4/issues/773. But on the second thought, the rule is still a workaround for that issue. --- If your project is set up for it, you can reply

[GitHub] spark issue #17298: [SPARK-19094][WIP][PySpark] Plumb through logging for IJ...

2017-05-20 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17298 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/77122/ Test FAILed. ---

[GitHub] spark issue #17298: [SPARK-19094][WIP][PySpark] Plumb through logging for IJ...

2017-05-20 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17298 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #17978: [SPARK-20736][Python] PySpark StringIndexer supports Str...

2017-05-20 Thread holdenk
Github user holdenk commented on the issue: https://github.com/apache/spark/pull/17978 One minor optional comment, but not a blocker so LGTM (although if you decide to update the docstring LGTM pending tests). --- If your project is set up for it, you can reply to this email and

[GitHub] spark pull request #17978: [SPARK-20736][Python] PySpark StringIndexer suppo...

2017-05-20 Thread holdenk
Github user holdenk commented on a diff in the pull request: https://github.com/apache/spark/pull/17978#discussion_r117612782 --- Diff: python/pyspark/ml/feature.py --- @@ -2111,26 +2112,45 @@ class StringIndexer(JavaEstimator, HasInputCol, HasOutputCol, HasHandleInvalid,

[GitHub] spark issue #17435: [SPARK-20098][PYSPARK] dataType's typeName fix

2017-05-20 Thread holdenk
Github user holdenk commented on the issue: https://github.com/apache/spark/pull/17435 Thanks for working on this. I feel like the error message could maybe be improved to suggest what the user should be doing? It would be nicer to eventually not have this depend on DataType since we

[GitHub] spark issue #17150: [SPARK-19810][BUILD][CORE] Remove support for Scala 2.10

2017-05-20 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17150 **[Test build #77124 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/77124/testReport)** for PR 17150 at commit

[GitHub] spark issue #18029: [SPARK-20168][WIP][DStream] Add changes to use kinesis f...

2017-05-20 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18029 **[Test build #77125 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/77125/testReport)** for PR 18029 at commit

[GitHub] spark issue #18029: [SPARK-20168][WIP][DStream] Add changes to use kinesis f...

2017-05-20 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18029 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #18029: [SPARK-20168][WIP][DStream] Add changes to use kinesis f...

2017-05-20 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18029 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/77125/ Test PASSed. ---

[GitHub] spark issue #17298: [SPARK-19094][WIP][PySpark] Plumb through logging for IJ...

2017-05-20 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17298 **[Test build #77122 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/77122/testReport)** for PR 17298 at commit

[GitHub] spark pull request #18031: [SPARK-20801] Record accurate size of blocks in M...

2017-05-20 Thread jinxing64
Github user jinxing64 commented on a diff in the pull request: https://github.com/apache/spark/pull/18031#discussion_r117610285 --- Diff: core/src/main/scala/org/apache/spark/scheduler/MapStatus.scala --- @@ -193,8 +219,27 @@ private[spark] object HighlyCompressedMapStatus {

[GitHub] spark issue #17150: [SPARK-19810][BUILD][CORE] Remove support for Scala 2.10

2017-05-20 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17150 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/77124/ Test PASSed. ---

  1   2   >