[GitHub] spark issue #16098: [SPARK-18672][CORE] Close recordwriter in SparkHadoopMap...

2016-12-02 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16098 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/69606/ Test FAILed. ---

[GitHub] spark issue #16098: [SPARK-18672][CORE] Close recordwriter in SparkHadoopMap...

2016-12-02 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16098 **[Test build #69606 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69606/consoleFull)** for PR 16098 at commit

[GitHub] spark issue #16098: [SPARK-18672][CORE] Close recordwriter in SparkHadoopMap...

2016-12-02 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16098 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #16125: [SPARK-18694][SS]Add StreamingQuery.explain and exceptio...

2016-12-02 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16125 **[Test build #69607 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69607/consoleFull)** for PR 16125 at commit

[GitHub] spark issue #15795: [SPARK-18081][ML][DOCS] Add user guide for Locality Sens...

2016-12-02 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15795 **[Test build #69612 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69612/consoleFull)** for PR 15795 at commit

[GitHub] spark issue #15795: [SPARK-18081][ML][DOCS] Add user guide for Locality Sens...

2016-12-02 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15795 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/69612/ Test PASSed. ---

[GitHub] spark issue #16098: [SPARK-18672][CORE] Close recordwriter in SparkHadoopMap...

2016-12-02 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16098 **[Test build #69614 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69614/consoleFull)** for PR 16098 at commit

[GitHub] spark issue #15795: [SPARK-18081][ML][DOCS] Add user guide for Locality Sens...

2016-12-02 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15795 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #16068: [SPARK-18637][SQL]Stateful UDF should be considered as n...

2016-12-02 Thread gatorsmile
Github user gatorsmile commented on the issue: https://github.com/apache/spark/pull/16068 We have a rule

[GitHub] spark issue #16128: [SPARK-18671][SS] Added tests to ensure stability of tha...

2016-12-02 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16128 **[Test build #69609 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69609/consoleFull)** for PR 16128 at commit

[GitHub] spark pull request #16068: [SPARK-18637][SQL]Stateful UDF should be consider...

2016-12-02 Thread gatorsmile
Github user gatorsmile commented on a diff in the pull request: https://github.com/apache/spark/pull/16068#discussion_r90752814 --- Diff: sql/hive/src/test/scala/org/apache/spark/sql/hive/execution/HiveUDFSuite.scala --- @@ -487,6 +488,29 @@ class HiveUDFSuite extends QueryTest

[GitHub] spark issue #16127: [SPARK-12409][SPARK-12387][SPARK-12391][SQL][BACKPORT-1....

2016-12-02 Thread rxin
Github user rxin commented on the issue: https://github.com/apache/spark/pull/16127 I didn't actually look at the content. I thought they were bug fixes and as a result said we should backport them. The title and description of the original pr implied they were bug fixes. --- If

[GitHub] spark pull request #16126: [SPARK-18695] Bump master branch version to 2.2.0...

2016-12-02 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/16126 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark issue #16127: [SPARK-12409][SPARK-12387][SPARK-12391][SQL][BACKPORT-1....

2016-12-02 Thread dongjoon-hyun
Github user dongjoon-hyun commented on the issue: https://github.com/apache/spark/pull/16127 I will close this now. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and

[GitHub] spark pull request #16127: [SPARK-12409][SPARK-12387][SPARK-12391][SQL][BACK...

2016-12-02 Thread dongjoon-hyun
Github user dongjoon-hyun closed the pull request at: https://github.com/apache/spark/pull/16127 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the

[GitHub] spark issue #16127: [SPARK-12409][SPARK-12387][SPARK-12391][SQL][BACKPORT-1....

2016-12-02 Thread dongjoon-hyun
Github user dongjoon-hyun commented on the issue: https://github.com/apache/spark/pull/16127 I see. If then, it's my fault. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #15813: [SPARK-18362][SQL] Use TextFileFormat in implementation ...

2016-12-02 Thread rxin
Github user rxin commented on the issue: https://github.com/apache/spark/pull/15813 Merging in master. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or

[GitHub] spark issue #16030: [SPARK-18108][SQL] Fix a bug to fail partition schema in...

2016-12-02 Thread brkyvz
Github user brkyvz commented on the issue: https://github.com/apache/spark/pull/16030 That is something I tried to standardize. I think we should standardize it, otherwise it is very confusing. I think it's the right thing to do. I just don't want people's production jobs

[GitHub] spark issue #16030: [SPARK-18108][SQL] Fix a bug to fail partition schema in...

2016-12-02 Thread maropu
Github user maropu commented on the issue: https://github.com/apache/spark/pull/16030 @brkyvz yea, I think so, but the issue of column ordering seems to be out of scope in this original ticket. So, why don't we open a new jira and discuss there? --- If your project is set up for

[GitHub] spark issue #15795: [SPARK-18081][ML][DOCS] Add user guide for Locality Sens...

2016-12-02 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15795 **[Test build #69613 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69613/consoleFull)** for PR 15795 at commit

[GitHub] spark issue #16098: [SPARK-18672][CORE] Close recordwriter in SparkHadoopMap...

2016-12-02 Thread HyukjinKwon
Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/16098 retest this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes

[GitHub] spark pull request #15813: [SPARK-18362][SQL] Use TextFileFormat in implemen...

2016-12-02 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/15813 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark pull request #15813: [SPARK-18362][SQL] Use TextFileFormat in implemen...

2016-12-02 Thread rxin
Github user rxin commented on a diff in the pull request: https://github.com/apache/spark/pull/15813#discussion_r90751405 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/csv/CSVFileFormat.scala --- @@ -173,51 +179,37 @@ class CSVFileFormat extends

[GitHub] spark issue #15795: [SPARK-18081][ML][DOCS] Add user guide for Locality Sens...

2016-12-02 Thread jkbradley
Github user jkbradley commented on the issue: https://github.com/apache/spark/pull/15795 I found myself wanting to make a number of tiny comments, so I thought it'd be easier to send a PR. Could you please take a look at this one? Thanks! --- If your project is set up for it,

[GitHub] spark issue #16120: [SPARK-18634][PySpark][SQL][WIP] Corruption and Correctn...

2016-12-02 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16120 **[Test build #69610 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69610/consoleFull)** for PR 16120 at commit

[GitHub] spark issue #16125: [SPARK-18694][SS]Add StreamingQuery.explain and exceptio...

2016-12-02 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16125 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/69607/ Test PASSed. ---

[GitHub] spark issue #16125: [SPARK-18694][SS]Add StreamingQuery.explain and exceptio...

2016-12-02 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16125 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #16030: [SPARK-18108][SQL] Fix a bug to fail partition schema in...

2016-12-02 Thread brkyvz
Github user brkyvz commented on the issue: https://github.com/apache/spark/pull/16030 Looks great! Thanks so much @maropu . @tdas or @liancheng would you mind taking a last look and possibly merging to 2.1? --- If your project is set up for it, you can reply to this email and have

[GitHub] spark issue #15795: [SPARK-18081][ML][DOCS] Add user guide for Locality Sens...

2016-12-02 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15795 **[Test build #69612 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69612/consoleFull)** for PR 15795 at commit

[GitHub] spark issue #16090: [SPARK-18661] [SQL] Creating a partitioned datasource ta...

2016-12-02 Thread ericl
Github user ericl commented on the issue: https://github.com/apache/spark/pull/16090 Seems like the caching broke a bunch of tests. I'll take a look at this again tomorrow. On Fri, Dec 2, 2016, 7:49 PM UCB AMPLab wrote: > Test FAILed.

[GitHub] spark issue #16126: [SPARK-18695] Bump master branch version to 2.2.0-SNAPSH...

2016-12-02 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16126 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/69599/ Test PASSed. ---

[GitHub] spark issue #16126: [SPARK-18695] Bump master branch version to 2.2.0-SNAPSH...

2016-12-02 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16126 **[Test build #69599 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69599/consoleFull)** for PR 16126 at commit

[GitHub] spark issue #16126: [SPARK-18695] Bump master branch version to 2.2.0-SNAPSH...

2016-12-02 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16126 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #16021: [SPARK-18593][SQL] JDBCRDD returns incorrect results for...

2016-12-02 Thread dongjoon-hyun
Github user dongjoon-hyun commented on the issue: https://github.com/apache/spark/pull/16021 Thank you all so much for giving your attentions and opinions here. I asked the one which is not allowed here. Please refer #16127 for more details, too. I'm closing this

[GitHub] spark pull request #16021: [SPARK-18593][SQL] JDBCRDD returns incorrect resu...

2016-12-02 Thread dongjoon-hyun
Github user dongjoon-hyun closed the pull request at: https://github.com/apache/spark/pull/16021 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the

[GitHub] spark issue #16128: [WIP][SPARK-18671][SS] Added tests to ensure stability o...

2016-12-02 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16128 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #16128: [WIP][SPARK-18671][SS] Added tests to ensure stability o...

2016-12-02 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16128 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/69609/ Test PASSed. ---

[GitHub] spark issue #16126: [SPARK-18695] Bump master branch version to 2.2.0-SNAPSH...

2016-12-02 Thread rxin
Github user rxin commented on the issue: https://github.com/apache/spark/pull/16126 Merging in master. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or

[GitHub] spark pull request #16113: [SPARK-18657][SPARK-18668] Make StreamingQuery.id...

2016-12-02 Thread tdas
Github user tdas commented on a diff in the pull request: https://github.com/apache/spark/pull/16113#discussion_r90751494 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/streaming/OffsetSeq.scala --- @@ -54,6 +61,26 @@ object OffsetSeq { * `nulls` in the

[GitHub] spark issue #16120: [SPARK-18634][PySpark][SQL][WIP] Corruption and Correctn...

2016-12-02 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16120 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/69608/ Test FAILed. ---

[GitHub] spark issue #16120: [SPARK-18634][PySpark][SQL][WIP] Corruption and Correctn...

2016-12-02 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16120 **[Test build #69608 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69608/consoleFull)** for PR 16120 at commit

[GitHub] spark issue #16120: [SPARK-18634][PySpark][SQL][WIP] Corruption and Correctn...

2016-12-02 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16120 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark pull request #16128: [SPARK-18671][SS] Added tests to ensure stability...

2016-12-02 Thread tdas
Github user tdas commented on a diff in the pull request: https://github.com/apache/spark/pull/16128#discussion_r90752217 --- Diff: sql/core/src/test/scala/org/apache/spark/sql/execution/streaming/OffsetSeqLogSuite.scala --- @@ -60,4 +60,39 @@ class OffsetSeqLogSuite extends

[GitHub] spark issue #16030: [SPARK-18108][SQL] Fix a bug to fail partition schema in...

2016-12-02 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16030 **[Test build #69611 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69611/consoleFull)** for PR 16030 at commit

[GitHub] spark issue #15795: [SPARK-18081][ML][DOCS] Add user guide for Locality Sens...

2016-12-02 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15795 **[Test build #69613 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69613/consoleFull)** for PR 15795 at commit

[GitHub] spark issue #15795: [SPARK-18081][ML][DOCS] Add user guide for Locality Sens...

2016-12-02 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15795 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/69613/ Test PASSed. ---

[GitHub] spark issue #15795: [SPARK-18081][ML][DOCS] Add user guide for Locality Sens...

2016-12-02 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15795 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #16128: [WIP][SPARK-18671][SS] Added tests to ensure stability o...

2016-12-02 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16128 **[Test build #69609 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69609/consoleFull)** for PR 16128 at commit

[GitHub] spark issue #15923: [SPARK-4105] retry the fetch or stage if shuffle block i...

2016-12-02 Thread rxin
Github user rxin commented on the issue: https://github.com/apache/spark/pull/15923 cc @zsxwing @JoshRosen does this look good? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #16043: [SPARK-18601][SQL] Simplify Create/Get complex expressio...

2016-12-02 Thread eyalfa
Github user eyalfa commented on the issue: https://github.com/apache/spark/pull/16043 Will do. I'm currently focusing on a functional issue with simplifying operations on createMap, I'll take care of these while on it. On Dec 2, 2016 11:09 PM, "Xiao Li"

[GitHub] spark pull request #16030: [SPARK-18108][SQL] Fix a bug to fail partition sc...

2016-12-02 Thread maropu
Github user maropu commented on a diff in the pull request: https://github.com/apache/spark/pull/16030#discussion_r90752283 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/DataSource.scala --- @@ -189,7 +189,15 @@ case class DataSource(

[GitHub] spark issue #16116: [SPARK-18685][TESTS] Fix URI and release resources after...

2016-12-02 Thread HyukjinKwon
Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/16116 Build started: [Tests] `org.apache.spark.repl.ExecutorClassLoaderSuite`

[GitHub] spark pull request #16090: [SPARK-18661] [SQL] Creating a partitioned dataso...

2016-12-02 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/16090#discussion_r90637793 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/command/createDataSourceTables.scala --- @@ -58,13 +58,21 @@ case class

[GitHub] spark pull request #16110: [SPARK-18674][SQL][Follow-Up] improve the error m...

2016-12-02 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/16110 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark issue #16116: [SPARK-18685][TESTS] Fix URI and release resources after...

2016-12-02 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16116 **[Test build #69561 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69561/consoleFull)** for PR 16116 at commit

[GitHub] spark pull request #16062: [SPARK-18629][SQL] Fix numPartition of JDBCSuite ...

2016-12-02 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/16062 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark issue #16112: [SPARK-18679] [SQL] Fix regression in file listing perfo...

2016-12-02 Thread cloud-fan
Github user cloud-fan commented on the issue: https://github.com/apache/spark/pull/16112 thanks, merging to master/2.1! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled

[GitHub] spark issue #15863: [SPARK-18419][SQL] `JDBCRelation.insert` should not remo...

2016-12-02 Thread cloud-fan
Github user cloud-fan commented on the issue: https://github.com/apache/spark/pull/15863 thanks, merging to master/2.1! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled

[GitHub] spark issue #16098: [SPARK-18672][CORE] Close recordwriter in SparkHadoopMap...

2016-12-02 Thread mridulm
Github user mridulm commented on the issue: https://github.com/apache/spark/pull/16098 That looks like a bug in ParquetRecordWriter (the contract of close() is unambiguous) ... but then, I guess there is no point in fighting against buggy code : we have to integrate with a lot of

[GitHub] spark issue #16062: [SPARK-18629][SQL] Fix numPartition of JDBCSuite Testcas...

2016-12-02 Thread srowen
Github user srowen commented on the issue: https://github.com/apache/spark/pull/16062 Merged to master --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or

[GitHub] spark issue #16116: [SPARK-18685][TESTS] Fix URI and release resources after...

2016-12-02 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16116 **[Test build #69566 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69566/consoleFull)** for PR 16116 at commit

[GitHub] spark pull request #16098: [SPARK-18672][CORE] Close recordwriter in SparkHa...

2016-12-02 Thread HyukjinKwon
Github user HyukjinKwon commented on a diff in the pull request: https://github.com/apache/spark/pull/16098#discussion_r90634188 --- Diff: core/src/main/scala/org/apache/spark/internal/io/SparkHadoopMapReduceWriter.scala --- @@ -163,12 +163,22 @@ object SparkHadoopMapReduceWriter

[GitHub] spark issue #15620: [SPARK-18091] [SQL] Deep if expressions cause Generated ...

2016-12-02 Thread cloud-fan
Github user cloud-fan commented on the issue: https://github.com/apache/spark/pull/15620 retest this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes

[GitHub] spark pull request #16098: [SPARK-18672][CORE] Close recordwriter in SparkHa...

2016-12-02 Thread HyukjinKwon
Github user HyukjinKwon commented on a diff in the pull request: https://github.com/apache/spark/pull/16098#discussion_r90643022 --- Diff: core/src/main/scala/org/apache/spark/internal/io/SparkHadoopMapReduceWriter.scala --- @@ -146,29 +146,32 @@ object SparkHadoopMapReduceWriter

[GitHub] spark pull request #16098: [SPARK-18672][CORE] Close recordwriter in SparkHa...

2016-12-02 Thread srowen
Github user srowen commented on a diff in the pull request: https://github.com/apache/spark/pull/16098#discussion_r90625904 --- Diff: core/src/main/scala/org/apache/spark/internal/io/SparkHadoopMapReduceWriter.scala --- @@ -163,12 +163,22 @@ object SparkHadoopMapReduceWriter

[GitHub] spark issue #16098: [SPARK-18672][CORE] Close recordwriter in SparkHadoopMap...

2016-12-02 Thread HyukjinKwon
Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/16098 Thank you both sincerely. Let me fix it. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[GitHub] spark issue #16030: [SPARK-18108][SQL] Fix a bug to fail partition schema in...

2016-12-02 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16030 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/69565/ Test FAILed. ---

[GitHub] spark issue #16030: [SPARK-18108][SQL] Fix a bug to fail partition schema in...

2016-12-02 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16030 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #16103: [SPARK-18374][ML]Incorrect words in StopWords/english.tx...

2016-12-02 Thread srowen
Github user srowen commented on the issue: https://github.com/apache/spark/pull/16103 Seems reasonable to me too. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and

[GitHub] spark issue #16043: [SPARK-18601][SQL] Simplify Create/Get complex expressio...

2016-12-02 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16043 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/69564/ Test PASSed. ---

[GitHub] spark issue #16043: [SPARK-18601][SQL] Simplify Create/Get complex expressio...

2016-12-02 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16043 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark pull request #15863: [SPARK-18419][SQL] `JDBCRelation.insert` should n...

2016-12-02 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/15863 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark pull request #16088: [SPARK-18659] [SQL] Incorrect behaviors in overwr...

2016-12-02 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/16088 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark issue #16116: [SPARK-18685][TESTS] Fix URI and release resources after...

2016-12-02 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16116 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #16116: [SPARK-18685][TESTS] Fix URI and release resources after...

2016-12-02 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16116 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/69561/ Test PASSed. ---

[GitHub] spark issue #16030: [SPARK-18108][SQL] Fix a bug to fail partition schema in...

2016-12-02 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16030 **[Test build #69567 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69567/consoleFull)** for PR 16030 at commit

[GitHub] spark pull request #16112: [SPARK-18679] [SQL] Fix regression in file listin...

2016-12-02 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/16112 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark issue #16098: [SPARK-18672][CORE] Close recordwriter in SparkHadoopMap...

2016-12-02 Thread HyukjinKwon
Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/16098 Build started: [CORE] `org.apache.spark.JavaAPISuite`

[GitHub] spark issue #16107: SPARK-18677: Fix parsing ['key'] in JSON path expression...

2016-12-02 Thread srowen
Github user srowen commented on the issue: https://github.com/apache/spark/pull/16107 Seems correct to me, yes. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and

[GitHub] spark issue #16102: [SPARK-18586][BUILD] netty-3.8.0.Final.jar has vulnerabi...

2016-12-02 Thread srowen
Github user srowen commented on the issue: https://github.com/apache/spark/pull/16102 @rxin it's a weird one. This is all I know: https://issues.apache.org/jira/browse/SPARK-17875 https://github.com/apache/spark/pull/15436 It's unused but couldn't get the Python

[GitHub] spark pull request #15994: [SPARK-18555][SQL]DataFrameNaFunctions.fill miss ...

2016-12-02 Thread srowen
Github user srowen commented on a diff in the pull request: https://github.com/apache/spark/pull/15994#discussion_r90635187 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/DataFrameNaFunctions.scala --- @@ -130,6 +130,13 @@ final class DataFrameNaFunctions private[sql](df:

[GitHub] spark issue #16115: [SPARK-18667][PySpark][SQL] Change the way to group row ...

2016-12-02 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16115 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #16043: [SPARK-18601][SQL] Simplify Create/Get complex expressio...

2016-12-02 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16043 **[Test build #69564 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69564/consoleFull)** for PR 16043 at commit

[GitHub] spark issue #16115: [SPARK-18667][PySpark][SQL] Change the way to group row ...

2016-12-02 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16115 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/69563/ Test PASSed. ---

[GitHub] spark issue #16090: [SPARK-18661] [SQL] Creating a partitioned datasource ta...

2016-12-02 Thread cloud-fan
Github user cloud-fan commented on the issue: https://github.com/apache/spark/pull/16090 My main concern is that, in `CreateDataSourceTableCommand`, we call `DataSource.resolveRelation` to infer the schema and partition columns. At that time, the table is not created yet, so

[GitHub] spark issue #16098: [SPARK-18672][CORE] Close recordwriter in SparkHadoopMap...

2016-12-02 Thread mridulm
Github user mridulm commented on the issue: https://github.com/apache/spark/pull/16098 @srowen This is where try-with-resources is really useful in java. Util.tryWithSafeFinallyAndFailureCallbacks is an attempt at doing that in scala with mixed results. I agree, the

[GitHub] spark issue #16115: [SPARK-18667][PySpark][SQL] Change the way to group row ...

2016-12-02 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16115 **[Test build #69563 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69563/consoleFull)** for PR 16115 at commit

[GitHub] spark issue #15620: [SPARK-18091] [SQL] Deep if expressions cause Generated ...

2016-12-02 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15620 **[Test build #69569 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69569/consoleFull)** for PR 15620 at commit

[GitHub] spark issue #16098: [SPARK-18672][CORE] Close recordwriter in SparkHadoopMap...

2016-12-02 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16098 **[Test build #69568 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69568/consoleFull)** for PR 16098 at commit

[GitHub] spark issue #16088: [SPARK-18659] [SQL] Incorrect behaviors in overwrite tab...

2016-12-02 Thread cloud-fan
Github user cloud-fan commented on the issue: https://github.com/apache/spark/pull/16088 thanks, merging to master/2.1! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled

[GitHub] spark issue #16110: [SPARK-18674][SQL][Follow-Up] improve the error message ...

2016-12-02 Thread cloud-fan
Github user cloud-fan commented on the issue: https://github.com/apache/spark/pull/16110 thanks, merging to master/2.1! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled

[GitHub] spark pull request #15795: [SPARK-18081][ML][DOCS] Add user guide for Locali...

2016-12-02 Thread Yunni
Github user Yunni commented on a diff in the pull request: https://github.com/apache/spark/pull/15795#discussion_r90736546 --- Diff: docs/ml-features.md --- @@ -1478,3 +1478,139 @@ for more details on the API. {% include_example python/ml/chisq_selector_example.py %}

[GitHub] spark issue #16122: [SPARK-18681][SQL] Fix filtering to compatible with part...

2016-12-02 Thread wangyum
Github user wangyum commented on the issue: https://github.com/apache/spark/pull/16122 @mallman MySQL and version is 5.6.29 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #16109: [SPARK-18588][Tests]Fix flaky test: KafkaSourceStressFor...

2016-12-02 Thread zsxwing
Github user zsxwing commented on the issue: https://github.com/apache/spark/pull/16109 > Test build #3459 has finished for PR 16109 at commit 0901a65. > > This patch fails PySpark unit tests. > This patch merges cleanly. > This patch adds no public classes.

[GitHub] spark issue #16125: [SPARK-18694][SS]Add StreamingQuery.explain and exceptio...

2016-12-02 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16125 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/69597/ Test FAILed. ---

[GitHub] spark issue #16124: [SPARK-12446][SQL] Add unit tests for JDBCRDD internal f...

2016-12-02 Thread gatorsmile
Github user gatorsmile commented on the issue: https://github.com/apache/spark/pull/16124 Can you please add [Backport-1.6] to the PR title? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark issue #16125: [SPARK-18694][SS]Add StreamingQuery.explain and exceptio...

2016-12-02 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16125 **[Test build #69597 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69597/consoleFull)** for PR 16125 at commit

[GitHub] spark issue #16125: [SPARK-18694][SS]Add StreamingQuery.explain and exceptio...

2016-12-02 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16125 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #16123: [SPARK-18690][PYTHON][SQL] Backward compatibility of unb...

2016-12-02 Thread rxin
Github user rxin commented on the issue: https://github.com/apache/spark/pull/16123 Thanks - merging in master/branch-2.1. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #16090: [SPARK-18661] [SQL] Creating a partitioned datasource ta...

2016-12-02 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16090 **[Test build #69600 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69600/consoleFull)** for PR 16090 at commit

  1   2   3   4   5   6   >