[GitHub] spark issue #15956: [SPARK-18519][SQL] map type can not be used in EqualTo

2016-11-22 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15956 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/68997/ Test PASSed. ---

[GitHub] spark issue #15956: [SPARK-18519][SQL] map type can not be used in EqualTo

2016-11-22 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15956 **[Test build #68997 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/68997/consoleFull)** for PR 15956 at commit

[GitHub] spark pull request #15956: [SPARK-18519][SQL] map type can not be used in Eq...

2016-11-22 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/15956#discussion_r89129936 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/predicates.scala --- @@ -440,6 +463,29 @@ case class EqualNullSafe(left:

[GitHub] spark pull request #15965: [SPARK-18356] [ML] Improve MLKmeans Performance

2016-11-22 Thread srowen
Github user srowen commented on a diff in the pull request: https://github.com/apache/spark/pull/15965#discussion_r89129439 --- Diff: mllib/src/main/scala/org/apache/spark/ml/clustering/KMeans.scala --- @@ -304,14 +305,21 @@ class KMeans @Since("1.5.0") ( @Since("1.5.0")

[GitHub] spark pull request #15965: [SPARK-18356] [ML] Improve MLKmeans Performance

2016-11-22 Thread srowen
Github user srowen commented on a diff in the pull request: https://github.com/apache/spark/pull/15965#discussion_r89129561 --- Diff: mllib/src/main/scala/org/apache/spark/ml/clustering/KMeans.scala --- @@ -304,14 +305,21 @@ class KMeans @Since("1.5.0") ( @Since("1.5.0")

[GitHub] spark issue #15956: [SPARK-18519][SQL] map type can not be used in EqualTo

2016-11-22 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15956 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark pull request #15956: [SPARK-18519][SQL] map type can not be used in Eq...

2016-11-22 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/15956#discussion_r89127871 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/analysis/CheckAnalysis.scala --- @@ -183,21 +183,6 @@ trait CheckAnalysis extends

[GitHub] spark pull request #13775: [SPARK-16060][SQL] Vectorized Orc reader

2016-11-22 Thread viirya
Github user viirya commented on a diff in the pull request: https://github.com/apache/spark/pull/13775#discussion_r89127052 --- Diff: sql/hive/src/main/java/org/apache/hadoop/hive/ql/io/orc/SparkVectorizedOrcRecordReader.java --- @@ -0,0 +1,189 @@ +/* + * Licensed to the

[GitHub] spark issue #15967: [SPARK-18073][DOCS][WIP] Migrate wiki to spark.apache.or...

2016-11-22 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15967 **[Test build #69001 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69001/consoleFull)** for PR 15967 at commit

[GitHub] spark issue #15979: [SPARK-18251][SQL] the type of Dataset can't be Option o...

2016-11-22 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15979 **[Test build #69000 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69000/consoleFull)** for PR 15979 at commit

[GitHub] spark issue #15979: [SPARK-18251][SQL] the type of Dataset can't be Option o...

2016-11-22 Thread cloud-fan
Github user cloud-fan commented on the issue: https://github.com/apache/spark/pull/15979 cc @yhuai @liancheng --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes

[GitHub] spark pull request #15979: [SPARK-18251][SQL] the type of Dataset can't be O...

2016-11-22 Thread cloud-fan
GitHub user cloud-fan opened a pull request: https://github.com/apache/spark/pull/15979 [SPARK-18251][SQL] the type of Dataset can't be Option of non-flat type ## What changes were proposed in this pull request? For input object of non-flat type, we can't encode it to row

[GitHub] spark issue #15212: [SPARK-17645][MLLIB][ML]add feature selector method base...

2016-11-22 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15212 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/68999/ Test PASSed. ---

[GitHub] spark issue #15212: [SPARK-17645][MLLIB][ML]add feature selector method base...

2016-11-22 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15212 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #15212: [SPARK-17645][MLLIB][ML]add feature selector method base...

2016-11-22 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15212 **[Test build #68999 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/68999/consoleFull)** for PR 15212 at commit

[GitHub] spark pull request #15965: [SPARK-18356] [ML] Improve MLKmeans Performance

2016-11-22 Thread ZakariaHili
Github user ZakariaHili commented on a diff in the pull request: https://github.com/apache/spark/pull/15965#discussion_r89108412 --- Diff: mllib/src/main/scala/org/apache/spark/ml/clustering/KMeans.scala --- @@ -306,12 +307,18 @@ class KMeans @Since("1.5.0") (

[GitHub] spark pull request #15965: [SPARK-18356] [ML] Improve MLKmeans Performance

2016-11-22 Thread ZakariaHili
Github user ZakariaHili commented on a diff in the pull request: https://github.com/apache/spark/pull/15965#discussion_r89120396 --- Diff: mllib/src/main/scala/org/apache/spark/ml/clustering/KMeans.scala --- @@ -305,11 +305,12 @@ class KMeans @Since("1.5.0") (

[GitHub] spark pull request #15956: [SPARK-18519][SQL] map type can not be used in Eq...

2016-11-22 Thread hvanhovell
Github user hvanhovell commented on a diff in the pull request: https://github.com/apache/spark/pull/15956#discussion_r89119453 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/analysis/CheckAnalysis.scala --- @@ -183,21 +183,6 @@ trait CheckAnalysis extends

[GitHub] spark pull request #15956: [SPARK-18519][SQL] map type can not be used in Eq...

2016-11-22 Thread hvanhovell
Github user hvanhovell commented on a diff in the pull request: https://github.com/apache/spark/pull/15956#discussion_r89119193 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/predicates.scala --- @@ -440,6 +463,29 @@ case class EqualNullSafe(left:

[GitHub] spark issue #15877: [SPARK-18429] [SQL] implement a new Aggregate for CountM...

2016-11-22 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15877 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/68994/ Test PASSed. ---

[GitHub] spark issue #15877: [SPARK-18429] [SQL] implement a new Aggregate for CountM...

2016-11-22 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15877 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #15877: [SPARK-18429] [SQL] implement a new Aggregate for CountM...

2016-11-22 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15877 **[Test build #68994 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/68994/consoleFull)** for PR 15877 at commit

[GitHub] spark pull request #15977: [SPARK-18436][SQL] isin causing SQL syntax error ...

2016-11-22 Thread srowen
Github user srowen commented on a diff in the pull request: https://github.com/apache/spark/pull/15977#discussion_r89115426 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/jdbc/JDBCRDD.scala --- @@ -120,7 +120,13 @@ object JDBCRDD extends Logging {

[GitHub] spark issue #13775: [SPARK-16060][SQL] Vectorized Orc reader

2016-11-22 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13775 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #13775: [SPARK-16060][SQL] Vectorized Orc reader

2016-11-22 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13775 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/68995/ Test PASSed. ---

[GitHub] spark issue #13775: [SPARK-16060][SQL] Vectorized Orc reader

2016-11-22 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13775 **[Test build #68995 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/68995/consoleFull)** for PR 13775 at commit

[GitHub] spark pull request #15959: [SPARK-18522][SQL] Explicit contract for column s...

2016-11-22 Thread wzhfy
Github user wzhfy commented on a diff in the pull request: https://github.com/apache/spark/pull/15959#discussion_r89113173 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/plans/logical/Statistics.scala --- @@ -58,60 +61,164 @@ case class Statistics( }

[GitHub] spark issue #13909: [SPARK-16213][SQL] Reduce runtime overhead of a program ...

2016-11-22 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13909 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #13909: [SPARK-16213][SQL] Reduce runtime overhead of a program ...

2016-11-22 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13909 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/68992/ Test PASSed. ---

[GitHub] spark issue #13909: [SPARK-16213][SQL] Reduce runtime overhead of a program ...

2016-11-22 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13909 **[Test build #68992 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/68992/consoleFull)** for PR 13909 at commit

[GitHub] spark issue #15413: [SPARK-17847][ML] Reduce shuffled data size of GaussianM...

2016-11-22 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15413 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/68996/ Test PASSed. ---

[GitHub] spark issue #15413: [SPARK-17847][ML] Reduce shuffled data size of GaussianM...

2016-11-22 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15413 **[Test build #68996 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/68996/consoleFull)** for PR 15413 at commit

[GitHub] spark issue #15413: [SPARK-17847][ML] Reduce shuffled data size of GaussianM...

2016-11-22 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15413 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #15212: [SPARK-17645][MLLIB][ML]add feature selector method base...

2016-11-22 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15212 **[Test build #68999 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/68999/consoleFull)** for PR 15212 at commit

[GitHub] spark pull request #13909: [SPARK-16213][SQL] Reduce runtime overhead of a p...

2016-11-22 Thread viirya
Github user viirya commented on a diff in the pull request: https://github.com/apache/spark/pull/13909#discussion_r89110298 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/CatalystTypeConverters.scala --- @@ -412,7 +412,8 @@ object CatalystTypeConverters {

[GitHub] spark pull request #13909: [SPARK-16213][SQL] Reduce runtime overhead of a p...

2016-11-22 Thread viirya
Github user viirya commented on a diff in the pull request: https://github.com/apache/spark/pull/13909#discussion_r89108723 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/CatalystTypeConverters.scala --- @@ -412,7 +412,8 @@ object CatalystTypeConverters {

[GitHub] spark issue #15978: [SPARK-18507][SQL] HiveExternalCatalog.listPartitions sh...

2016-11-22 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15978 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #15978: [SPARK-18507][SQL] HiveExternalCatalog.listPartitions sh...

2016-11-22 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15978 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/68993/ Test PASSed. ---

[GitHub] spark issue #15978: [SPARK-18507][SQL] HiveExternalCatalog.listPartitions sh...

2016-11-22 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15978 **[Test build #68993 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/68993/consoleFull)** for PR 15978 at commit

[GitHub] spark issue #15977: [SPARK-18436][SQL] isin causing SQL syntax error with JD...

2016-11-22 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15977 **[Test build #68998 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/68998/consoleFull)** for PR 15977 at commit

[GitHub] spark issue #15956: [SPARK-18519][SQL] map type can not be used in EqualTo

2016-11-22 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15956 **[Test build #68997 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/68997/consoleFull)** for PR 15956 at commit

[GitHub] spark issue #15977: [SPARK-18436][SQL] isin causing SQL syntax error with JD...

2016-11-22 Thread jiangxb1987
Github user jiangxb1987 commented on the issue: https://github.com/apache/spark/pull/15977 The failed unit test seems not related to our change here. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does

[GitHub] spark issue #15977: [SPARK-18436][SQL] isin causing SQL syntax error with JD...

2016-11-22 Thread jiangxb1987
Github user jiangxb1987 commented on the issue: https://github.com/apache/spark/pull/15977 @hvanhovell Thanks for that catch! I'll fix that too. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark issue #15977: [SPARK-18436][SQL] isin causing SQL syntax error with JD...

2016-11-22 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15977 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/68991/ Test FAILed. ---

[GitHub] spark issue #15977: [SPARK-18436][SQL] isin causing SQL syntax error with JD...

2016-11-22 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15977 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #15977: [SPARK-18436][SQL] isin causing SQL syntax error with JD...

2016-11-22 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15977 **[Test build #68991 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/68991/consoleFull)** for PR 15977 at commit

[GitHub] spark pull request #13909: [SPARK-16213][SQL] Reduce runtime overhead of a p...

2016-11-22 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/13909#discussion_r89099827 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/CatalystTypeConverters.scala --- @@ -412,7 +412,8 @@ object CatalystTypeConverters {

[GitHub] spark issue #15952: [SPARK-18514][DOCS] Fix the markdown for `Note:`/`NOTE:`...

2016-11-22 Thread HyukjinKwon
Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/15952 Thank you!!! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or

[GitHub] spark issue #15968: [SPARK-18533] Raise correct error upon specification of ...

2016-11-22 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15968 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #15968: [SPARK-18533] Raise correct error upon specification of ...

2016-11-22 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15968 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/68989/ Test PASSed. ---

[GitHub] spark issue #15413: [SPARK-17847][ML] Reduce shuffled data size of GaussianM...

2016-11-22 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15413 **[Test build #68996 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/68996/consoleFull)** for PR 15413 at commit

[GitHub] spark issue #15968: [SPARK-18533] Raise correct error upon specification of ...

2016-11-22 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15968 **[Test build #68989 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/68989/consoleFull)** for PR 15968 at commit

[GitHub] spark issue #14872: [SPARK-3162][MLlib][WIP] Add local tree training for dec...

2016-11-22 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14872 Can one of the admins verify this patch? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[GitHub] spark pull request #15848: [SPARK-9487] Use the same num. worker threads in ...

2016-11-22 Thread srowen
Github user srowen commented on a diff in the pull request: https://github.com/apache/spark/pull/15848#discussion_r89098150 --- Diff: streaming/src/test/java/org/apache/spark/streaming/JavaAPISuite.java --- @@ -1244,7 +1244,15 @@ public void testCountByValue() {

[GitHub] spark pull request #15947: [SPARK-18447][DOCS] Fix the markdown for `Note:`/...

2016-11-22 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/15947 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark pull request #15962: [SPARK-18526][SQL][KAFKA] Allow users to configur...

2016-11-22 Thread ScrapCodes
Github user ScrapCodes closed the pull request at: https://github.com/apache/spark/pull/15962 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature

[GitHub] spark issue #15962: [SPARK-18526][SQL][KAFKA] Allow users to configure max.p...

2016-11-22 Thread ScrapCodes
Github user ScrapCodes commented on the issue: https://github.com/apache/spark/pull/15962 You are right @marmbrus , I am sorry for not actually doing the proper comparison. Only after seeing the code I realized, we use `consumer.poll(0)` not for pulling records but to

[GitHub] spark issue #15947: [SPARK-18447][DOCS] Fix the markdown for `Note:`/`NOTE:`...

2016-11-22 Thread srowen
Github user srowen commented on the issue: https://github.com/apache/spark/pull/15947 Merged to master/2.1 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so,

[GitHub] spark issue #15960: [SPARK-18521] Add `NoRedundantStringInterpolator` Scala ...

2016-11-22 Thread srowen
Github user srowen commented on the issue: https://github.com/apache/spark/pull/15960 No, doing it in stages over years doesn't change the drawback, and just makes this more confusing. I agree with fixing this where performance may matter, or, fixing these issues when code is being

[GitHub] spark pull request #15952: [SPARK-18514][DOCS] Fix the markdown for `Note:`/...

2016-11-22 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/15952 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark issue #15952: [SPARK-18514][DOCS] Fix the markdown for `Note:`/`NOTE:`...

2016-11-22 Thread srowen
Github user srowen commented on the issue: https://github.com/apache/spark/pull/15952 Merged to master/2.1 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so,

[GitHub] spark issue #15648: [SPARK-18119][SPARK-CORE] Namenode safemode check is onl...

2016-11-22 Thread srowen
Github user srowen commented on the issue: https://github.com/apache/spark/pull/15648 HDFS folks internally indicated this is likely the right change. Let's leave it for a bit before committing. --- If your project is set up for it, you can reply to this email and have your reply

[GitHub] spark issue #15717: [SPARK-17910][SQL] Allow users to update the comment of ...

2016-11-22 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15717 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #15717: [SPARK-17910][SQL] Allow users to update the comment of ...

2016-11-22 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15717 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/68988/ Test PASSed. ---

[GitHub] spark issue #15717: [SPARK-17910][SQL] Allow users to update the comment of ...

2016-11-22 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15717 **[Test build #68988 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/68988/consoleFull)** for PR 15717 at commit

[GitHub] spark issue #15877: [SPARK-18429] [SQL] implement a new Aggregate for CountM...

2016-11-22 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15877 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/68985/ Test PASSed. ---

[GitHub] spark issue #15877: [SPARK-18429] [SQL] implement a new Aggregate for CountM...

2016-11-22 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15877 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #15877: [SPARK-18429] [SQL] implement a new Aggregate for CountM...

2016-11-22 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15877 **[Test build #68985 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/68985/consoleFull)** for PR 15877 at commit

[GitHub] spark issue #15951: [SPARK-18510] Fix data corruption from inferred partitio...

2016-11-22 Thread cloud-fan
Github user cloud-fan commented on the issue: https://github.com/apache/spark/pull/15951 shall we update the document of `DataSource.partitionColumns`? `When this ist is empty, the relation is unpartitioned.` this is wrong now, the relation can be partitioned even if

[GitHub] spark pull request #15944: [SPARK-18511] Added the Api for join with only on...

2016-11-22 Thread shiv4nsh
Github user shiv4nsh closed the pull request at: https://github.com/apache/spark/pull/15944 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark issue #15820: [SPARK-18373][SS][Kafka]Make failOnDataLoss=false work w...

2016-11-22 Thread srowen
Github user srowen commented on the issue: https://github.com/apache/spark/pull/15820 @zsxwing should the title include SPARK-18529 per your comment on the JIRA? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark issue #13775: [SPARK-16060][SQL] Vectorized Orc reader

2016-11-22 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13775 **[Test build #68995 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/68995/consoleFull)** for PR 13775 at commit

[GitHub] spark issue #15978: [SPARK-18507][SQL] HiveExternalCatalog.listPartitions sh...

2016-11-22 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15978 **[Test build #68993 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/68993/consoleFull)** for PR 15978 at commit

[GitHub] spark issue #15944: [SPARK-18511] Added the Api for join with only one colum...

2016-11-22 Thread srowen
Github user srowen commented on the issue: https://github.com/apache/spark/pull/15944 @shiv4nsh you will have to close this PR --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #15877: [SPARK-18429] [SQL] implement a new Aggregate for CountM...

2016-11-22 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15877 **[Test build #68994 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/68994/consoleFull)** for PR 15877 at commit

[GitHub] spark pull request #15965: [SPARK-18356] [ML] Improve MLKmeans Performance

2016-11-22 Thread srowen
Github user srowen commented on a diff in the pull request: https://github.com/apache/spark/pull/15965#discussion_r89091350 --- Diff: mllib/src/main/scala/org/apache/spark/ml/clustering/KMeans.scala --- @@ -306,12 +307,18 @@ class KMeans @Since("1.5.0") (

[GitHub] spark issue #15977: [SPARK-18436][SQL] isin causing SQL syntax error with JD...

2016-11-22 Thread hvanhovell
Github user hvanhovell commented on the issue: https://github.com/apache/spark/pull/15977 Could you also fix (the actual problem): https://github.com/apache/spark/blob/master/sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/jdbc/JDBCRDD.scala#L123 --- If your

[GitHub] spark issue #15978: [SPARK-18507][SQL] HiveExternalCatalog.listPartitions sh...

2016-11-22 Thread cloud-fan
Github user cloud-fan commented on the issue: https://github.com/apache/spark/pull/15978 cc @yhuai @mallman @ericl --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and

[GitHub] spark pull request #15978: [SPARK-18507][SQL] HiveExternalCatalog.listPartit...

2016-11-22 Thread cloud-fan
GitHub user cloud-fan opened a pull request: https://github.com/apache/spark/pull/15978 [SPARK-18507][SQL] HiveExternalCatalog.listPartitions should only call getTable once ## What changes were proposed in this pull request? HiveExternalCatalog.listPartitions should only

[GitHub] spark issue #13909: [SPARK-16213][SQL] Reduce runtime overhead of a program ...

2016-11-22 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13909 **[Test build #68992 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/68992/consoleFull)** for PR 13909 at commit

[GitHub] spark pull request #13909: [SPARK-16213][SQL] Reduce runtime overhead of a p...

2016-11-22 Thread kiszk
Github user kiszk commented on a diff in the pull request: https://github.com/apache/spark/pull/13909#discussion_r89088454 --- Diff: sql/catalyst/src/test/scala/org/apache/spark/sql/catalyst/expressions/ExpressionEvalHelper.scala --- @@ -42,15 +42,51 @@ trait ExpressionEvalHelper

[GitHub] spark pull request #15975: [SPARK-18538] [SQL] Fix Concurrent Table Fetching...

2016-11-22 Thread viirya
Github user viirya commented on a diff in the pull request: https://github.com/apache/spark/pull/15975#discussion_r89087942 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/jdbc/JDBCRelation.scala --- @@ -137,7 +137,8 @@ private[sql] case class

[GitHub] spark pull request #15975: [SPARK-18538] [SQL] Fix Concurrent Table Fetching...

2016-11-22 Thread viirya
Github user viirya commented on a diff in the pull request: https://github.com/apache/spark/pull/15975#discussion_r89086596 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/DataFrameReader.scala --- @@ -159,7 +159,11 @@ class DataFrameReader private[sql](sparkSession:

[GitHub] spark issue #15958: [SPARK-17932][SQL] Failed to run SQL "show table extende...

2016-11-22 Thread jiangxb1987
Github user jiangxb1987 commented on the issue: https://github.com/apache/spark/pull/15958 cc @hvanhovell @gatorsmile --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled

[GitHub] spark pull request #13909: [SPARK-16213][SQL] Reduce runtime overhead of a p...

2016-11-22 Thread viirya
Github user viirya commented on a diff in the pull request: https://github.com/apache/spark/pull/13909#discussion_r89086237 --- Diff: sql/catalyst/src/test/scala/org/apache/spark/sql/catalyst/expressions/ExpressionEvalHelper.scala --- @@ -42,15 +42,51 @@ trait

[GitHub] spark issue #15780: [SPARK-18284][SQL] Make ExpressionEncoder.serializer.nul...

2016-11-22 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15780 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/68984/ Test FAILed. ---

[GitHub] spark issue #15780: [SPARK-18284][SQL] Make ExpressionEncoder.serializer.nul...

2016-11-22 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15780 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #15780: [SPARK-18284][SQL] Make ExpressionEncoder.serializer.nul...

2016-11-22 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15780 **[Test build #68984 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/68984/consoleFull)** for PR 15780 at commit

[GitHub] spark issue #15977: [SPARK-18436][SQL] isin causing SQL syntax error with JD...

2016-11-22 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15977 **[Test build #68991 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/68991/consoleFull)** for PR 15977 at commit

[GitHub] spark issue #15977: [SPARK-18436][SQL] isin causing SQL syntax error with JD...

2016-11-22 Thread jiangxb1987
Github user jiangxb1987 commented on the issue: https://github.com/apache/spark/pull/15977 cc @hvanhovell @rxin @srowen @gatorsmile @windpiger --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request #15977: [SPARK-18436][SQL] isin causing SQL syntax error ...

2016-11-22 Thread jiangxb1987
GitHub user jiangxb1987 opened a pull request: https://github.com/apache/spark/pull/15977 [SPARK-18436][SQL] isin causing SQL syntax error with JDBC ## What changes were proposed in this pull request? `in(empty seq)` is invalid in some data source. Since `in(empty seq)` is

[GitHub] spark pull request #15965: [SPARK-18356] [ML] Improve MLKmeans Performance

2016-11-22 Thread ZakariaHili
Github user ZakariaHili commented on a diff in the pull request: https://github.com/apache/spark/pull/15965#discussion_r89079674 --- Diff: mllib/src/main/scala/org/apache/spark/ml/clustering/KMeans.scala --- @@ -306,12 +307,19 @@ class KMeans @Since("1.5.0") (

[GitHub] spark pull request #15965: [SPARK-18356] [ML] Improve MLKmeans Performance

2016-11-22 Thread ZakariaHili
Github user ZakariaHili commented on a diff in the pull request: https://github.com/apache/spark/pull/15965#discussion_r89079712 --- Diff: mllib/src/main/scala/org/apache/spark/ml/clustering/KMeans.scala --- @@ -321,12 +329,15 @@ class KMeans @Since("1.5.0") (

[GitHub] spark pull request #13909: [SPARK-16213][SQL] Reduce runtime overhead of a p...

2016-11-22 Thread kiszk
Github user kiszk commented on a diff in the pull request: https://github.com/apache/spark/pull/13909#discussion_r89082742 --- Diff: sql/catalyst/src/test/scala/org/apache/spark/sql/catalyst/expressions/ExpressionEvalHelper.scala --- @@ -42,15 +42,51 @@ trait ExpressionEvalHelper

[GitHub] spark pull request #15968: [SPARK-18533] Raise correct error upon specificat...

2016-11-22 Thread viirya
Github user viirya commented on a diff in the pull request: https://github.com/apache/spark/pull/15968#discussion_r89082612 --- Diff: sql/catalyst/src/main/antlr4/org/apache/spark/sql/catalyst/parser/SqlBase.g4 --- @@ -71,11 +71,7 @@ statement | createTableHeader ('('

[GitHub] spark issue #15959: [SPARK-18522][SQL] Explicit contract for column stats se...

2016-11-22 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15959 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/68987/ Test FAILed. ---

[GitHub] spark issue #15959: [SPARK-18522][SQL] Explicit contract for column stats se...

2016-11-22 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15959 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #15959: [SPARK-18522][SQL] Explicit contract for column stats se...

2016-11-22 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15959 **[Test build #68987 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/68987/consoleFull)** for PR 15959 at commit

[GitHub] spark issue #15959: [SPARK-18522][SQL] Explicit contract for column stats se...

2016-11-22 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15959 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #15959: [SPARK-18522][SQL] Explicit contract for column stats se...

2016-11-22 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15959 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/68986/ Test FAILed. ---

<    1   2   3   4   5   6   7   >