[GitHub] spark issue #16109: [SPARK-18588][Tests]Fix flaky test: KafkaSourceStressFor...

2016-12-02 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16109 **[Test build #3461 has finished](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/3461/consoleFull)** for PR 16109 at commit

[GitHub] spark issue #16127: [SPARK-12409][SPARK-12387][SPARK-12391][SQL][BACKPORT-1....

2016-12-02 Thread dongjoon-hyun
Github user dongjoon-hyun commented on the issue: https://github.com/apache/spark/pull/16127 The my comment was > Hi, @rxin , @gatorsmile , @hvanhovell , @srowen . > Could you give some opinion? What I hoped here is having these 6 commits in branch-1.6. > But, if backports

[GitHub] spark issue #16115: [SPARK-18667][PySpark][SQL] Change the way to group row ...

2016-12-02 Thread viirya
Github user viirya commented on the issue: https://github.com/apache/spark/pull/16115 retest this please. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so,

[GitHub] spark issue #16110: [SPARK-18674][SQL][Follow-Up] improve the error message ...

2016-12-02 Thread gatorsmile
Github user gatorsmile commented on the issue: https://github.com/apache/spark/pull/16110 retest this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes

[GitHub] spark pull request #16114: [SPARK-18620][Streaming][Kinesis] Flatten input r...

2016-12-02 Thread maropu
Github user maropu commented on a diff in the pull request: https://github.com/apache/spark/pull/16114#discussion_r90601340 --- Diff: external/kinesis-asl/src/main/scala/org/apache/spark/streaming/kinesis/KinesisReceiver.scala --- @@ -221,6 +221,12 @@ private[kinesis] class

[GitHub] spark issue #15795: [SPARK-18081] Add user guide for Locality Sensitive Hash...

2016-12-02 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15795 **[Test build #69555 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69555/consoleFull)** for PR 15795 at commit

[GitHub] spark issue #16116: [SPARK-18685][TESTS] Fix URI and release resources after...

2016-12-02 Thread HyukjinKwon
Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/16116 retest this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes

[GitHub] spark issue #16076: [SPARK-18324][ML][DOC] Update ML programming and migrati...

2016-12-02 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16076 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #16076: [SPARK-18324][ML][DOC] Update ML programming and migrati...

2016-12-02 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16076 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/69559/ Test PASSed. ---

[GitHub] spark issue #16118: [SPARK-18291][SPARKR][ML] Revert "[SPARK-18291][SPARKR][...

2016-12-02 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16118 **[Test build #69560 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69560/consoleFull)** for PR 16118 at commit

[GitHub] spark issue #16119: reuse SparkSession if sparkContext specified same as act...

2016-12-02 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16119 **[Test build #69562 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69562/consoleFull)** for PR 16119 at commit

[GitHub] spark issue #16043: [SPARK-18601][SQL] Simplify Create/Get complex expressio...

2016-12-02 Thread hvanhovell
Github user hvanhovell commented on the issue: https://github.com/apache/spark/pull/16043 retest this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes

[GitHub] spark pull request #16114: [SPARK-18620][Streaming][Kinesis] Flatten input r...

2016-12-02 Thread srowen
Github user srowen commented on a diff in the pull request: https://github.com/apache/spark/pull/16114#discussion_r90600774 --- Diff: external/kinesis-asl/src/main/scala/org/apache/spark/streaming/kinesis/KinesisReceiver.scala --- @@ -221,6 +221,12 @@ private[kinesis] class

[GitHub] spark pull request #16114: [SPARK-18620][Streaming][Kinesis] Flatten input r...

2016-12-02 Thread srowen
Github user srowen commented on a diff in the pull request: https://github.com/apache/spark/pull/16114#discussion_r90600716 --- Diff: external/kinesis-asl/src/main/scala/org/apache/spark/streaming/kinesis/KinesisRecordProcessor.scala --- @@ -56,6 +56,38 @@ private[kinesis] class

[GitHub] spark issue #16037: [SPARK-18471][MLLIB] In LBFGS, avoid sending huge vector...

2016-12-02 Thread MLnick
Github user MLnick commented on the issue: https://github.com/apache/spark/pull/16037 I'm sure this will be net positive, and _shouldn't_ cause any regression. Still, we must be certain. @AnthonyTruchet can you provide for posterity the detailed test results for the vector sizes you

[GitHub] spark issue #16117: [SPARK-18686][SparkR][ML] Several cleanup and improvemen...

2016-12-02 Thread yanboliang
Github user yanboliang commented on the issue: https://github.com/apache/spark/pull/16117 cc @wangmiao1981 @felixcheung @jkbradley --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[GitHub] spark pull request #16030: [SPARK-18108][SQL] Fix a bug to fail partition sc...

2016-12-02 Thread maropu
Github user maropu commented on a diff in the pull request: https://github.com/apache/spark/pull/16030#discussion_r90619967 --- Diff: sql/core/src/test/scala/org/apache/spark/sql/execution/datasources/parquet/ParquetPartitionDiscoverySuite.scala --- @@ -969,4 +969,15 @@ class

[GitHub] spark pull request #16030: [SPARK-18108][SQL] Fix a bug to fail partition sc...

2016-12-02 Thread maropu
Github user maropu commented on a diff in the pull request: https://github.com/apache/spark/pull/16030#discussion_r90620033 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/DataSource.scala --- @@ -174,22 +185,18 @@ case class DataSource(

[GitHub] spark pull request #16030: [SPARK-18108][SQL] Fix a bug to fail partition sc...

2016-12-02 Thread maropu
Github user maropu commented on a diff in the pull request: https://github.com/apache/spark/pull/16030#discussion_r90620001 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/DataSource.scala --- @@ -174,22 +185,18 @@ case class DataSource(

[GitHub] spark issue #16069: [WIP][SPARK-18638][BUILD] Upgrade sbt, Zinc, and Maven p...

2016-12-02 Thread srowen
Github user srowen commented on the issue: https://github.com/apache/spark/pull/16069 Do you happen to know if the changes to the SBT build will still work with earlier versions of SBT? that is, is it just some cleanup or some required change? Regarding plugins, maven

[GitHub] spark issue #15795: [SPARK-18081] Add user guide for Locality Sensitive Hash...

2016-12-02 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15795 **[Test build #69555 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69555/consoleFull)** for PR 15795 at commit

[GitHub] spark pull request #16058: [SPARK-18291][SparkR][ML][FOLLOW-UP] Encode proba...

2016-12-02 Thread yanboliang
Github user yanboliang closed the pull request at: https://github.com/apache/spark/pull/16058 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature

[GitHub] spark issue #16110: [SPARK-18674][SQL][Follow-Up] improve the error message ...

2016-12-02 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16110 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #16110: [SPARK-18674][SQL][Follow-Up] improve the error message ...

2016-12-02 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16110 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/69554/ Test PASSed. ---

[GitHub] spark issue #16110: [SPARK-18674][SQL][Follow-Up] improve the error message ...

2016-12-02 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16110 **[Test build #69554 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69554/consoleFull)** for PR 16110 at commit

[GitHub] spark issue #16110: [SPARK-18674][SQL][Follow-Up] improve the error message ...

2016-12-02 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16110 **[Test build #69554 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69554/consoleFull)** for PR 16110 at commit

[GitHub] spark pull request #16114: [SPARK-18620][Streaming][Kinesis] Flatten input r...

2016-12-02 Thread maropu
Github user maropu commented on a diff in the pull request: https://github.com/apache/spark/pull/16114#discussion_r90600966 --- Diff: external/kinesis-asl/src/main/scala/org/apache/spark/streaming/kinesis/KinesisRecordProcessor.scala --- @@ -56,6 +56,38 @@ private[kinesis] class

[GitHub] spark pull request #16116: [SPARK-18685][TESTS] Fix URI and release resource...

2016-12-02 Thread HyukjinKwon
Github user HyukjinKwon commented on a diff in the pull request: https://github.com/apache/spark/pull/16116#discussion_r90609056 --- Diff: repl/src/test/scala/org/apache/spark/repl/ExecutorClassLoaderSuite.scala --- @@ -118,8 +115,17 @@ class ExecutorClassLoaderSuite val

[GitHub] spark issue #16116: [SPARK-18685][TESTS] Fix URI and release resources after...

2016-12-02 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16116 **[Test build #69561 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69561/consoleFull)** for PR 16116 at commit

[GitHub] spark issue #12968: [SPARK-15064][ML] Locale support in StopWordsRemover

2016-12-02 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/12968 Can one of the admins verify this patch? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[GitHub] spark issue #16037: [SPARK-18471][MLLIB] In LBFGS, avoid sending huge vector...

2016-12-02 Thread AnthonyTruchet
Github user AnthonyTruchet commented on the issue: https://github.com/apache/spark/pull/16037 L-BFGS is the only optimizer I've used so far. I'm not sure how much time I can free to take care of the other ones, but I'll try :-) Regarding the bench, I'll check if we have

[GitHub] spark issue #16116: [SPARK-18685][TESTS] Fix URI and release resources after...

2016-12-02 Thread HyukjinKwon
Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/16116 Build started: [Tests] `org.apache.spark.repl.ExecutorClassLoaderSuite`

[GitHub] spark issue #16118: [SPARK-18291][SPARKR][ML] Revert "[SPARK-18291][SPARKR][...

2016-12-02 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16118 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/69560/ Test PASSed. ---

[GitHub] spark issue #16118: [SPARK-18291][SPARKR][ML] Revert "[SPARK-18291][SPARKR][...

2016-12-02 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16118 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #16118: [SPARK-18291][SPARKR][ML] Revert "[SPARK-18291][SPARKR][...

2016-12-02 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16118 **[Test build #69560 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69560/consoleFull)** for PR 16118 at commit

[GitHub] spark issue #16116: [SPARK-18685][TESTS] Fix URI and release resources after...

2016-12-02 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16116 **[Test build #69557 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69557/consoleFull)** for PR 16116 at commit

[GitHub] spark issue #16116: [SPARK-18685][TESTS] Fix URI and release resources after...

2016-12-02 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16116 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #16117: [SPARK-18686][SparkR][ML] Several cleanup and improvemen...

2016-12-02 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16117 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/69556/ Test PASSed. ---

[GitHub] spark issue #16117: [SPARK-18686][SparkR][ML] Several cleanup and improvemen...

2016-12-02 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16117 **[Test build #69556 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69556/consoleFull)** for PR 16117 at commit

[GitHub] spark issue #16117: [SPARK-18686][SparkR][ML] Several cleanup and improvemen...

2016-12-02 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16117 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #16115: [SPARK-18667][PySpark][SQL] Change the way to group row ...

2016-12-02 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16115 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #16115: [SPARK-18667][PySpark][SQL] Change the way to group row ...

2016-12-02 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16115 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/69553/ Test FAILed. ---

[GitHub] spark issue #16030: [SPARK-18108][SQL] Fix a bug to fail partition schema in...

2016-12-02 Thread maropu
Github user maropu commented on the issue: https://github.com/apache/spark/pull/16030 @brkyvz How should we handle this query? I think we have some overheads to check the constant value (`1480617712537`) in path matches all the data in DataFrame and to throw an exception if illegal

[GitHub] spark issue #16059: [SPARK-18625][ML] OneVsRestModel should support setFeatu...

2016-12-02 Thread srowen
Github user srowen commented on the issue: https://github.com/apache/spark/pull/16059 CC @yanboliang ? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or

[GitHub] spark issue #16110: [SPARK-18674][SQL][Follow-Up] improve the error message ...

2016-12-02 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16110 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #16115: [SPARK-18667][PySpark][SQL] Change the way to group row ...

2016-12-02 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16115 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/69549/ Test FAILed. ---

[GitHub] spark issue #15620: [SPARK-18091] [SQL] Deep if expressions cause Generated ...

2016-12-02 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15620 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #16110: [SPARK-18674][SQL][Follow-Up] improve the error message ...

2016-12-02 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16110 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/69548/ Test FAILed. ---

[GitHub] spark issue #16115: [SPARK-18667][PySpark][SQL] Change the way to group row ...

2016-12-02 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16115 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #15620: [SPARK-18091] [SQL] Deep if expressions cause Generated ...

2016-12-02 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15620 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/69550/ Test FAILed. ---

[GitHub] spark issue #16116: [SPARK-18685][TESTS] Fix URI and release resources after...

2016-12-02 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16116 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/69552/ Test FAILed. ---

[GitHub] spark issue #16116: [SPARK-18685][TESTS] Fix URI and release resources after...

2016-12-02 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16116 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #16116: [SPARK-18685][TESTS] Fix URI and release resources after...

2016-12-02 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16116 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/69557/ Test FAILed. ---

[GitHub] spark issue #16114: [SPARK-18620][Streaming][Kinesis] Flatten input rates in...

2016-12-02 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16114 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/69558/ Test PASSed. ---

[GitHub] spark issue #16114: [SPARK-18620][Streaming][Kinesis] Flatten input rates in...

2016-12-02 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16114 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #16114: [SPARK-18620][Streaming][Kinesis] Flatten input rates in...

2016-12-02 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16114 **[Test build #69558 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69558/consoleFull)** for PR 16114 at commit

[GitHub] spark issue #15620: [SPARK-18091] [SQL] Deep if expressions cause Generated ...

2016-12-02 Thread kapilsingh5050
Github user kapilsingh5050 commented on the issue: https://github.com/apache/spark/pull/15620 I didn't find any failure/error message in the PR Builder job logs apart from: Traceback (most recent call last): File "./dev/run-tests-jenkins.py", line 232, in

[GitHub] spark issue #16115: [SPARK-18667][PySpark][SQL] Change the way to group row ...

2016-12-02 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16115 **[Test build #69563 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69563/consoleFull)** for PR 16115 at commit

[GitHub] spark issue #16119: [SPARK-18687][Pyspark][SQL]Backward compatibility - crea...

2016-12-02 Thread vijoshi
Github user vijoshi commented on the issue: https://github.com/apache/spark/pull/16119 ping @holdenk @srowen --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes

[GitHub] spark issue #16043: [SPARK-18601][SQL] Simplify Create/Get complex expressio...

2016-12-02 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16043 **[Test build #69564 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69564/consoleFull)** for PR 16043 at commit

[GitHub] spark issue #16119: [SPARK-18687][Pyspark][SQL]Backward compatibility - crea...

2016-12-02 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16119 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/69562/ Test PASSed. ---

[GitHub] spark issue #16119: [SPARK-18687][Pyspark][SQL]Backward compatibility - crea...

2016-12-02 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16119 **[Test build #69562 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69562/consoleFull)** for PR 16119 at commit

[GitHub] spark pull request #16030: [SPARK-18108][SQL] Fix a bug to fail partition sc...

2016-12-02 Thread maropu
Github user maropu commented on a diff in the pull request: https://github.com/apache/spark/pull/16030#discussion_r90620083 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/DataSource.scala --- @@ -132,13 +132,24 @@ case class DataSource(

[GitHub] spark issue #16030: [SPARK-18108][SQL] Fix a bug to fail partition schema in...

2016-12-02 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16030 **[Test build #69565 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69565/consoleFull)** for PR 16030 at commit

[GitHub] spark issue #16116: [SPARK-18685][TESTS] Fix URI and release resources after...

2016-12-02 Thread HyukjinKwon
Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/16116 cc @srowen and @mridulm, Could I please ask to take a look? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does

[GitHub] spark issue #16058: [SPARK-18291][SparkR][ML][FOLLOW-UP] Encode probability ...

2016-12-02 Thread yanboliang
Github user yanboliang commented on the issue: https://github.com/apache/spark/pull/16058 Since we decided revert SPARK-18291 for 2.1 and add it back after SPARK-18618 resolved, I can directly add this change at that time. So I will close this PR. Thanks for reviewing. --- If your

[GitHub] spark pull request #16119: reuse SparkSession if sparkContext specified same...

2016-12-02 Thread vijoshi
GitHub user vijoshi opened a pull request: https://github.com/apache/spark/pull/16119 reuse SparkSession if sparkContext specified same as active one ## What changes were proposed in this pull request? Change is for SQLContext to reuse the active SparkSession during

[GitHub] spark issue #16119: [SPARK-18687][Pyspark][SQL]Backward compatibility - crea...

2016-12-02 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16119 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #16115: [SPARK-18667][PySpark][SQL] Change the way to group row ...

2016-12-02 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16115 **[Test build #69553 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69553/consoleFull)** for PR 16115 at commit

[GitHub] spark issue #15795: [SPARK-18081] Add user guide for Locality Sensitive Hash...

2016-12-02 Thread MLnick
Github user MLnick commented on the issue: https://github.com/apache/spark/pull/15795 ok to test --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the

[GitHub] spark issue #16116: [SPARK-18685][TESTS] Fix URI and release resources after...

2016-12-02 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16116 **[Test build #69557 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69557/consoleFull)** for PR 16116 at commit

[GitHub] spark issue #16117: [SPARK-18686][SparkR][ML] Several cleanup and improvemen...

2016-12-02 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16117 **[Test build #69556 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69556/consoleFull)** for PR 16117 at commit

[GitHub] spark pull request #16117: [SPARK-18686][SparkR][ML] Several cleanup and imp...

2016-12-02 Thread yanboliang
GitHub user yanboliang opened a pull request: https://github.com/apache/spark/pull/16117 [SPARK-18686][SparkR][ML] Several cleanup and improvements for spark.logit. ## What changes were proposed in this pull request? Several cleanup and improvements for ```spark.logit```: *

[GitHub] spark issue #16114: [SPARK-18620][Streaming][Kinesis] Flatten input rates in...

2016-12-02 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16114 **[Test build #69558 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69558/consoleFull)** for PR 16114 at commit

[GitHub] spark pull request #16076: [SPARK-18324][ML][DOC] Update ML programming and ...

2016-12-02 Thread yanboliang
Github user yanboliang commented on a diff in the pull request: https://github.com/apache/spark/pull/16076#discussion_r90603174 --- Diff: docs/ml-guide.md --- @@ -60,152 +60,37 @@ MLlib is under active development. The APIs marked `Experimental`/`DeveloperApi` may change in

[GitHub] spark issue #16076: [SPARK-18324][ML][DOC] Update ML programming and migrati...

2016-12-02 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16076 **[Test build #69559 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69559/consoleFull)** for PR 16076 at commit

[GitHub] spark pull request #16116: [SPARK-18685][TESTS] Fix URI and release resource...

2016-12-02 Thread srowen
Github user srowen commented on a diff in the pull request: https://github.com/apache/spark/pull/16116#discussion_r90604612 --- Diff: repl/src/test/scala/org/apache/spark/repl/ExecutorClassLoaderSuite.scala --- @@ -118,8 +115,17 @@ class ExecutorClassLoaderSuite val

[GitHub] spark issue #16076: [SPARK-18324][ML][DOC] Update ML programming and migrati...

2016-12-02 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16076 **[Test build #69559 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69559/consoleFull)** for PR 16076 at commit

[GitHub] spark issue #15795: [SPARK-18081] Add user guide for Locality Sensitive Hash...

2016-12-02 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15795 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #15795: [SPARK-18081] Add user guide for Locality Sensitive Hash...

2016-12-02 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15795 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/69555/ Test PASSed. ---

[GitHub] spark pull request #16118: [SPARK-18291][SPARKR][ML] Revert "[SPARK-18291][S...

2016-12-02 Thread yanboliang
GitHub user yanboliang opened a pull request: https://github.com/apache/spark/pull/16118 [SPARK-18291][SPARKR][ML] Revert "[SPARK-18291][SPARKR][ML] SparkR glm predict should output original label when family = binomial." ## What changes were proposed in this pull request? It's

[GitHub] spark issue #16115: [SPARK-18667][PySpark][SQL] Change the way to group row ...

2016-12-02 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16115 **[Test build #69553 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69553/consoleFull)** for PR 16115 at commit

[GitHub] spark pull request #15795: [SPARK-18081][ML][DOCS] Add user guide for Locali...

2016-12-02 Thread Yunni
Github user Yunni commented on a diff in the pull request: https://github.com/apache/spark/pull/15795#discussion_r90736878 --- Diff: docs/ml-features.md --- @@ -1478,3 +1478,139 @@ for more details on the API. {% include_example python/ml/chisq_selector_example.py %}

[GitHub] spark pull request #15795: [SPARK-18081][ML][DOCS] Add user guide for Locali...

2016-12-02 Thread Yunni
Github user Yunni commented on a diff in the pull request: https://github.com/apache/spark/pull/15795#discussion_r90736862 --- Diff: docs/ml-features.md --- @@ -1478,3 +1478,139 @@ for more details on the API. {% include_example python/ml/chisq_selector_example.py %}

[GitHub] spark pull request #16113: [SPARK-18657][SPARK-18668] Make StreamingQuery.id...

2016-12-02 Thread tdas
Github user tdas commented on a diff in the pull request: https://github.com/apache/spark/pull/16113#discussion_r90739276 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/streaming/StreamExecution.scala --- @@ -605,34 +629,64 @@ class StreamExecution( case

[GitHub] spark pull request #16124: [SPARK-12446][SQL] Add unit tests for JDBCRDD int...

2016-12-02 Thread dongjoon-hyun
GitHub user dongjoon-hyun opened a pull request: https://github.com/apache/spark/pull/16124 [SPARK-12446][SQL] Add unit tests for JDBCRDD internal functions No tests done for JDBCRDD#compileFilter. Author: Takeshi YAMAMURO Closes #10409 from

[GitHub] spark issue #16124: [SPARK-12446][SQL] Add unit tests for JDBCRDD internal f...

2016-12-02 Thread dongjoon-hyun
Github user dongjoon-hyun commented on the issue: https://github.com/apache/spark/pull/16124 This is the first commit for #16021. cc @gatorsmile . --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does

[GitHub] spark issue #16125: [SPARK-18694][SS]Add StreamingQuery.explain and exceptio...

2016-12-02 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16125 **[Test build #69597 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69597/consoleFull)** for PR 16125 at commit

[GitHub] spark pull request #16123: [SPARK-18690][PYTHON][SQL] Backward compatibility...

2016-12-02 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/16123 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark issue #16124: [SPARK-12446][SQL][BACKPORT-1.6] Add unit tests for JDBC...

2016-12-02 Thread gatorsmile
Github user gatorsmile commented on the issue: https://github.com/apache/spark/pull/16124 LGTM --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the

[GitHub] spark pull request #16128: [SPARK-18671][SS] Added tests to ensure stability...

2016-12-02 Thread tdas
GitHub user tdas opened a pull request: https://github.com/apache/spark/pull/16128 [SPARK-18671][SS] Added tests to ensure stability of that all Structured Streaming log formats ## What changes were proposed in this pull request? To be able to restart StreamingQueries

[GitHub] spark issue #16127: [SPARK-12409][SPARK-12387][SPARK-12391][SQL][BACKPORT-1....

2016-12-02 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16127 **[Test build #69604 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69604/consoleFull)** for PR 16127 at commit

[GitHub] spark issue #16098: [SPARK-18672][CORE] Close recordwriter in SparkHadoopMap...

2016-12-02 Thread HyukjinKwon
Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/16098 retest this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes

[GitHub] spark issue #16092: [SPARK-18662] Move resource managers to separate directo...

2016-12-02 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16092 **[Test build #3465 has finished](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/3465/consoleFull)** for PR 16092 at commit

[GitHub] spark issue #16125: [SPARK-18694][SS]Add StreamingQuery.explain and exceptio...

2016-12-02 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16125 **[Test build #69596 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69596/consoleFull)** for PR 16125 at commit

[GitHub] spark pull request #16113: [SPARK-18657][SPARK-18668] Make StreamingQuery.id...

2016-12-02 Thread tdas
Github user tdas commented on a diff in the pull request: https://github.com/apache/spark/pull/16113#discussion_r90743054 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/streaming/StreamExecution.scala --- @@ -605,34 +629,64 @@ class StreamExecution( case

[GitHub] spark issue #16076: [SPARK-18324][ML][DOC] Update ML programming and migrati...

2016-12-02 Thread jkbradley
Github user jkbradley commented on the issue: https://github.com/apache/spark/pull/16076 LGTM I'll merge this with master and branch-2.1 Thank you! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark pull request #16113: [SPARK-18657][SPARK-18668] Make StreamingQuery.id...

2016-12-02 Thread tdas
Github user tdas commented on a diff in the pull request: https://github.com/apache/spark/pull/16113#discussion_r90743078 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/streaming/StreamingQuery.scala --- @@ -32,21 +32,33 @@ import org.apache.spark.sql.SparkSession

[GitHub] spark issue #16069: [WIP][SPARK-18638][BUILD] Upgrade sbt, Zinc, and Maven p...

2016-12-02 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16069 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #16113: [SPARK-18657][SPARK-18668] Make StreamingQuery.id persis...

2016-12-02 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16113 **[Test build #69593 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69593/consoleFull)** for PR 16113 at commit

<    1   2   3   4   5   6   >