[GitHub] spark pull request #16269: [SPARK-19080][SQL] simplify data source analysis

2017-02-03 Thread gatorsmile
Github user gatorsmile commented on a diff in the pull request: https://github.com/apache/spark/pull/16269#discussion_r99401502 --- Diff: sql/hive/src/main/scala/org/apache/spark/sql/hive/HiveStrategies.scala --- @@ -80,13 +80,17 @@ class DetermineHiveSerde(conf: SQLConf) extends

[GitHub] spark pull request #16269: [SPARK-19080][SQL] simplify data source analysis

2017-02-03 Thread gatorsmile
Github user gatorsmile commented on a diff in the pull request: https://github.com/apache/spark/pull/16269#discussion_r99401545 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/DataSourceStrategy.scala --- @@ -45,7 +45,8 @@ import

[GitHub] spark issue #16791: [SPARK-19409][SPARK-17213] Cleanup Parquet workarounds/h...

2017-02-03 Thread dongjoon-hyun
Github user dongjoon-hyun commented on the issue: https://github.com/apache/spark/pull/16791 Great, @liancheng . BTW, could you specify the test dependency like the following in this PR? ``` diff --git a/sql/core/pom.xml b/sql/core/pom.xml index b8aa698090..f9acf815e3

[GitHub] spark issue #16791: [SPARK-19409][SPARK-17213] Cleanup Parquet workarounds/h...

2017-02-03 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16791 **[Test build #72315 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/72315/testReport)** for PR 16791 at commit

[GitHub] spark issue #16791: [SPARK-19409][SPARK-17213] Cleanup Parquet workarounds/h...

2017-02-03 Thread liancheng
Github user liancheng commented on the issue: https://github.com/apache/spark/pull/16791 I see, thanks for the context. But I'd like to keep this Maven build failure fix in a separate PR so that people can easily cherry-pick the fix. Also, it helps to keep this PR easier to follow.

[GitHub] spark issue #16784: [SPARK-19382][ML]:Test sparse vectors in LinearSVCSuite

2017-02-03 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16784 **[Test build #72312 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/72312/testReport)** for PR 16784 at commit

[GitHub] spark issue #16791: [SPARK-19409][SPARK-17213] Cleanup Parquet workarounds/h...

2017-02-03 Thread liancheng
Github user liancheng commented on the issue: https://github.com/apache/spark/pull/16791 Hope we finally have proper Parquet filter push-down for string/binary columns (cross fingers)! --- If your project is set up for it, you can reply to this email and have your reply appear on

[GitHub] spark issue #16791: [SPARK-19409][SPARK-17213] Cleanup Parquet workarounds/h...

2017-02-03 Thread dongjoon-hyun
Github user dongjoon-hyun commented on the issue: https://github.com/apache/spark/pull/16791 Here, https://amplab.cs.berkeley.edu/jenkins/view/Spark%20QA%20Test%20(Dashboard)/job/spark-master-test-maven-hadoop-2.7/2530/consoleFull ```

[GitHub] spark pull request #16686: [SPARK-18682][SS] Batch Source for Kafka

2017-02-03 Thread tcondie
Github user tcondie commented on a diff in the pull request: https://github.com/apache/spark/pull/16686#discussion_r99382639 --- Diff: external/kafka-0-10-sql/src/main/scala/org/apache/spark/sql/kafka010/KafkaTopicPartitionOffsetReader.scala --- @@ -0,0 +1,300 @@ +/* + *

[GitHub] spark issue #16787: [SPARK-19448][SQL]optimize some duplication functions in...

2017-02-03 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16787 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/72309/ Test FAILed. ---

[GitHub] spark pull request #16664: [SPARK-18120 ][SQL] Call QueryExecutionListener c...

2017-02-03 Thread salilsurendran
Github user salilsurendran commented on a diff in the pull request: https://github.com/apache/spark/pull/16664#discussion_r99386276 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/DataFrameWriter.scala --- @@ -190,6 +192,32 @@ final class DataFrameWriter[T] private[sql](ds:

[GitHub] spark pull request #16757: [SPARK-18609][SPARK-18841][SQL] Fix redundant Ali...

2017-02-03 Thread hvanhovell
Github user hvanhovell commented on a diff in the pull request: https://github.com/apache/spark/pull/16757#discussion_r99390416 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/optimizer/Optimizer.scala --- @@ -154,56 +155,108 @@ class SimpleTestOptimizer

[GitHub] spark pull request #16269: [SPARK-19080][SQL] simplify data source analysis

2017-02-03 Thread gatorsmile
Github user gatorsmile commented on a diff in the pull request: https://github.com/apache/spark/pull/16269#discussion_r99390405 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/analysis/CheckAnalysis.scala --- @@ -376,28 +376,6 @@ trait CheckAnalysis extends

[GitHub] spark issue #16784: [SPARK-19382][ML]:Test sparse vectors in LinearSVCSuite

2017-02-03 Thread wangmiao1981
Github user wangmiao1981 commented on the issue: https://github.com/apache/spark/pull/16784 Jenkins, retest this please. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled

[GitHub] spark issue #16269: [SPARK-19080][SQL] simplify data source analysis

2017-02-03 Thread gatorsmile
Github user gatorsmile commented on the issue: https://github.com/apache/spark/pull/16269 LGTM except a few comment. The major concern is about our error checking for structured streaming. It sounds like the test case coverage in that area is weak. --- If your project is set up for

[GitHub] spark issue #16791: [SPARK-19409][SPARK-17213] Cleanup Parquet workarounds/h...

2017-02-03 Thread liancheng
Github user liancheng commented on the issue: https://github.com/apache/spark/pull/16791 @dongjoon-hyun Ah, thanks! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and

[GitHub] spark pull request #13712: [SPARK-15990][YARN] Add rolling log aggregation s...

2017-02-03 Thread jerryshao
Github user jerryshao commented on a diff in the pull request: https://github.com/apache/spark/pull/13712#discussion_r99450752 --- Diff: yarn/src/main/scala/org/apache/spark/deploy/yarn/Client.scala --- @@ -271,6 +271,33 @@ private[spark] class Client(

[GitHub] spark issue #16786: [SPARK-19446][SQL] Remove unused findTightestCommonType ...

2017-02-03 Thread gatorsmile
Github user gatorsmile commented on the issue: https://github.com/apache/spark/pull/16786 Could you rename `findTightestCommonTypeOfTwo` to `findTightestCommonType`? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If

[GitHub] spark issue #16794: [SPARK-19452][SparkR] Fix bug in the name assignment met...

2017-02-03 Thread actuaryzhang
Github user actuaryzhang commented on the issue: https://github.com/apache/spark/pull/16794 Not sure why the unit test on kmeans summary failed since nothing was changed there. Also, all unit tests passed on my computer. --- If your project is set up for it, you can reply to this

[GitHub] spark pull request #16776: [SPARK-19436][SQL] Add missing tests for approxQu...

2017-02-03 Thread gatorsmile
Github user gatorsmile commented on a diff in the pull request: https://github.com/apache/spark/pull/16776#discussion_r99440166 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/DataFrameStatFunctions.scala --- @@ -80,18 +80,16 @@ final class DataFrameStatFunctions

[GitHub] spark issue #16794: [SPARK-19452][SparkR] Fix bug in the name assignment met...

2017-02-03 Thread actuaryzhang
Github user actuaryzhang commented on the issue: https://github.com/apache/spark/pull/16794 jenkins, retest this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #16795: [WIP][SPARK-19409][BUILD] Fix ParquetAvroCompatibilitySu...

2017-02-03 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16795 **[Test build #72322 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/72322/testReport)** for PR 16795 at commit

[GitHub] spark issue #16794: [SPARK-19452][SparkR] Fix bug in the name assignment met...

2017-02-03 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16794 **[Test build #72330 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/72330/testReport)** for PR 16794 at commit

[GitHub] spark issue #16533: [SPARK-19160][PYTHON][SQL] Add udf decorator

2017-02-03 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16533 **[Test build #72331 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/72331/testReport)** for PR 16533 at commit

[GitHub] spark issue #16783: [SPARK-19441] [SQL] Remove IN type coercion from Promote...

2017-02-03 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16783 **[Test build #72324 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/72324/testReport)** for PR 16783 at commit

[GitHub] spark issue #16786: [SPARK-19446][SQL] Remove unused findTightestCommonType ...

2017-02-03 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16786 **[Test build #72332 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/72332/testReport)** for PR 16786 at commit

[GitHub] spark issue #16794: [SPARK-19452][SparkR] Fix bug in the name assignment met...

2017-02-03 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16794 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/72330/ Test FAILed. ---

[GitHub] spark issue #16794: [SPARK-19452][SparkR] Fix bug in the name assignment met...

2017-02-03 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16794 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #16797: [SPARK-19455][SQL] Add option for case-insensitive Parqu...

2017-02-03 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16797 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #16797: [SPARK-19455][SQL] Add option for case-insensitive Parqu...

2017-02-03 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16797 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/72326/ Test FAILed. ---

[GitHub] spark issue #16797: [SPARK-19455][SQL] Add option for case-insensitive Parqu...

2017-02-03 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16797 **[Test build #72326 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/72326/testReport)** for PR 16797 at commit

[GitHub] spark pull request #16798: [SPARK-18873][SQL][TEST] New test cases for scala...

2017-02-03 Thread nsyca
GitHub user nsyca opened a pull request: https://github.com/apache/spark/pull/16798 [SPARK-18873][SQL][TEST] New test cases for scalar subquery (part 2 of 2) - scalar subquery in predicate context ## What changes were proposed in this pull request? This PR adds new test cases

[GitHub] spark issue #16794: [SPARK-19452][SparkR] Fix bug in the name assignment met...

2017-02-03 Thread actuaryzhang
Github user actuaryzhang commented on the issue: https://github.com/apache/spark/pull/16794 @felixcheung @wangmiao1981 I spent quite some time on this b/c I could not replicate the results and all tests on my end worked. Then I updated my local spark with a pull request and

[GitHub] spark issue #16799: [SparkR] fix error in vignettes

2017-02-03 Thread actuaryzhang
Github user actuaryzhang commented on the issue: https://github.com/apache/spark/pull/16799 Errors can be seen in #16794. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #16791: [SPARK-19409][SPARK-17213] Cleanup Parquet workarounds/h...

2017-02-03 Thread HyukjinKwon
Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/16791 BTW, LGTM for the changes in `ParquetSchrmaConverter` as i have the exact same changes ready for a PR in my local. However, do you mind if I ask PARQUET-686 is fixed in another JIRA? it seems

[GitHub] spark issue #16798: [SPARK-18873][SQL][TEST] New test cases for scalar subqu...

2017-02-03 Thread nsyca
Github user nsyca commented on the issue: https://github.com/apache/spark/pull/16798 Below are a modified version of the test cases to run on DB2 and the result from DB2, as a second source to compare to the result from Spark. [Modified test file to run on

[GitHub] spark issue #16786: [SPARK-19446][SQL] Remove unused findTightestCommonType ...

2017-02-03 Thread gatorsmile
Github user gatorsmile commented on the issue: https://github.com/apache/spark/pull/16786 Also clean up the comments? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and

[GitHub] spark issue #16794: [SPARK-19452][SparkR] Fix bug in the name assignment met...

2017-02-03 Thread wangmiao1981
Github user wangmiao1981 commented on the issue: https://github.com/apache/spark/pull/16794 Warning in FUN(X[[1L]], ...) : Use Sepal_Length instead of Sepal.Length as column name Warning in FUN(X[[2L]], ...) : Use Sepal_Width instead of Sepal.Width as column name

[GitHub] spark issue #16794: [SPARK-19452][SparkR] Fix bug in the name assignment met...

2017-02-03 Thread wangmiao1981
Github user wangmiao1981 commented on the issue: https://github.com/apache/spark/pull/16794 try {r, warning=FALSE} for the warning cases? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[GitHub] spark issue #16664: [SPARK-18120 ][SQL] Call QueryExecutionListener callback...

2017-02-03 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16664 **[Test build #72329 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/72329/testReport)** for PR 16664 at commit

[GitHub] spark issue #16794: [SPARK-19452][SparkR] Fix bug in the name assignment met...

2017-02-03 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16794 **[Test build #72327 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/72327/testReport)** for PR 16794 at commit

[GitHub] spark issue #16794: [SPARK-19452][SparkR] Fix bug in the name assignment met...

2017-02-03 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16794 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/72327/ Test FAILed. ---

[GitHub] spark issue #16794: [SPARK-19452][SparkR] Fix bug in the name assignment met...

2017-02-03 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16794 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #16794: [SPARK-19452][SparkR] Fix bug in the name assignment met...

2017-02-03 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16794 **[Test build #72330 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/72330/testReport)** for PR 16794 at commit

[GitHub] spark issue #16800: [SPARK-19456][SparkR][WIP]:Add LinearSVC R API

2017-02-03 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16800 **[Test build #72339 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/72339/testReport)** for PR 16800 at commit

[GitHub] spark issue #16156: [SPARK-18539][SQL]: tolerate pushed-down filter on non-e...

2017-02-03 Thread xwu0226
Github user xwu0226 commented on the issue: https://github.com/apache/spark/pull/16156 https://issues.apache.org/jira/browse/SPARK-19409 is resolved to upgrade to parquet-1.8.2 that fixes this issue. --- If your project is set up for it, you can reply to this email and have your

[GitHub] spark pull request #16156: [SPARK-18539][SQL]: tolerate pushed-down filter o...

2017-02-03 Thread xwu0226
Github user xwu0226 closed the pull request at: https://github.com/apache/spark/pull/16156 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark issue #16726: [SPARK-19390][SQL] Replace the unnecessary usages of hiv...

2017-02-03 Thread gatorsmile
Github user gatorsmile commented on the issue: https://github.com/apache/spark/pull/16726 cc @cloud-fan --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so,

[GitHub] spark issue #16794: [SPARK-19452][SparkR] Fix bug in the name assignment met...

2017-02-03 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16794 **[Test build #72327 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/72327/testReport)** for PR 16794 at commit

[GitHub] spark issue #16533: [SPARK-19160][PYTHON][SQL] Add udf decorator

2017-02-03 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16533 **[Test build #72328 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/72328/testReport)** for PR 16533 at commit

[GitHub] spark issue #16776: [SPARK-19436][SQL] Add missing tests for approxQuantile

2017-02-03 Thread gatorsmile
Github user gatorsmile commented on the issue: https://github.com/apache/spark/pull/16776 Thank you! What is the expected output if the input dataset is empty? Could you also add a test case? --- If your project is set up for it, you can reply to this email and have your reply

[GitHub] spark issue #16795: [WIP][SPARK-19409][BUILD] Fix ParquetAvroCompatibilitySu...

2017-02-03 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16795 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #16533: [SPARK-19160][PYTHON][SQL] Add udf decorator

2017-02-03 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16533 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/72328/ Test PASSed. ---

[GitHub] spark issue #16795: [WIP][SPARK-19409][BUILD] Fix ParquetAvroCompatibilitySu...

2017-02-03 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16795 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/72322/ Test FAILed. ---

[GitHub] spark issue #16533: [SPARK-19160][PYTHON][SQL] Add udf decorator

2017-02-03 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16533 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #16533: [SPARK-19160][PYTHON][SQL] Add udf decorator

2017-02-03 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16533 **[Test build #72328 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/72328/testReport)** for PR 16533 at commit

[GitHub] spark issue #16533: [SPARK-19160][PYTHON][SQL] Add udf decorator

2017-02-03 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16533 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/72331/ Test PASSed. ---

[GitHub] spark issue #16686: [SPARK-18682][SS] Batch Source for Kafka

2017-02-03 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16686 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/72333/ Test PASSed. ---

[GitHub] spark issue #16797: [SPARK-19455][SQL] Add option for case-insensitive Parqu...

2017-02-03 Thread budde
Github user budde commented on the issue: https://github.com/apache/spark/pull/16797 Relevant part of [Jenkins output](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/72326/console) for SparkR tests: ``` Error: processing vignette

[GitHub] spark pull request #16799: [SparkR] fix error in vignettes

2017-02-03 Thread actuaryzhang
GitHub user actuaryzhang opened a pull request: https://github.com/apache/spark/pull/16799 [SparkR] fix error in vignettes ## What changes were proposed in this pull request? Current version has error in vignettes: ``` model <- spark.bisectingKmeans(df, Sepal_Length

[GitHub] spark issue #16794: [SPARK-19452][SparkR] Fix bug in the name assignment met...

2017-02-03 Thread felixcheung
Github user felixcheung commented on the issue: https://github.com/apache/spark/pull/16794 good catch, seems reasonable (although might be a small breaking behavior change) Error in tests is with doc generation: ``` Error: processing vignette 'sparkr-vignettes.Rmd'

[GitHub] spark issue #16797: [SPARK-19455][SQL] Add option for case-insensitive Parqu...

2017-02-03 Thread budde
Github user budde commented on the issue: https://github.com/apache/spark/pull/16797 Pinging @ericl, @cloud-fan and @davies, committers who have all reviewed or submitted changes related to this. --- If your project is set up for it, you can reply to this email and have your reply

[GitHub] spark issue #16797: [SPARK-19455][SQL] Add option for case-insensitive Parqu...

2017-02-03 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16797 **[Test build #72326 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/72326/testReport)** for PR 16797 at commit

[GitHub] spark issue #16757: [SPARK-18609][SPARK-18841][SQL] Fix redundant Alias remo...

2017-02-03 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16757 **[Test build #72323 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/72323/testReport)** for PR 16757 at commit

[GitHub] spark issue #16686: [SPARK-18682][SS] Batch Source for Kafka

2017-02-03 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16686 **[Test build #72333 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/72333/testReport)** for PR 16686 at commit

[GitHub] spark issue #16796: [SPARK-10063] Follow-up: remove dead code related to an ...

2017-02-03 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16796 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #16796: [SPARK-10063] Follow-up: remove dead code related to an ...

2017-02-03 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16796 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/72325/ Test FAILed. ---

[GitHub] spark issue #16796: [SPARK-10063] Follow-up: remove dead code related to an ...

2017-02-03 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16796 **[Test build #72325 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/72325/testReport)** for PR 16796 at commit

[GitHub] spark issue #16795: [WIP][SPARK-19409][BUILD] Fix ParquetAvroCompatibilitySu...

2017-02-03 Thread dongjoon-hyun
Github user dongjoon-hyun commented on the issue: https://github.com/apache/spark/pull/16795 Retest this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and

[GitHub] spark issue #16664: [SPARK-18120 ][SQL] Call QueryExecutionListener callback...

2017-02-03 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16664 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/72329/ Test FAILed. ---

[GitHub] spark issue #16664: [SPARK-18120 ][SQL] Call QueryExecutionListener callback...

2017-02-03 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16664 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark pull request #16786: [SPARK-19446][SQL] Remove unused findTightestComm...

2017-02-03 Thread gatorsmile
Github user gatorsmile commented on a diff in the pull request: https://github.com/apache/spark/pull/16786#discussion_r99453060 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/json/InferSchema.scala --- @@ -253,7 +253,7 @@ private[sql] object

[GitHub] spark issue #16797: [SPARK-19455][SQL] Add option for case-insensitive Parqu...

2017-02-03 Thread budde
Github user budde commented on the issue: https://github.com/apache/spark/pull/16797 Looks like SparkR unit tests have been failing for all or most PRs after [this commit.](https://github.com/apache/spark/commit/48aafeda7db879491ed36fff89d59ca7ec3136fa) --- If your project is set

[GitHub] spark issue #16798: [SPARK-18873][SQL][TEST] New test cases for scalar subqu...

2017-02-03 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16798 **[Test build #72337 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/72337/testReport)** for PR 16798 at commit

[GitHub] spark pull request #16800: [SPARK-19456][SparkR][WIP]:Add LinearSVC R API

2017-02-03 Thread wangmiao1981
GitHub user wangmiao1981 opened a pull request: https://github.com/apache/spark/pull/16800 [SPARK-19456][SparkR][WIP]:Add LinearSVC R API ## What changes were proposed in this pull request? Linear SVM classifier is newly added into ML and python API has been added. This

[GitHub] spark issue #16626: [SPARK-19261][SQL] Alter add columns for Hive serde and ...

2017-02-03 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16626 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #16626: [SPARK-19261][SQL] Alter add columns for Hive serde and ...

2017-02-03 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16626 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/72320/ Test FAILed. ---

[GitHub] spark issue #16626: [SPARK-19261][SQL] Alter add columns for Hive serde and ...

2017-02-03 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16626 **[Test build #72320 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/72320/testReport)** for PR 16626 at commit

[GitHub] spark issue #16757: [SPARK-18609][SPARK-18841][SQL] Fix redundant Alias remo...

2017-02-03 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16757 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/72323/ Test FAILed. ---

[GitHub] spark issue #16757: [SPARK-18609][SPARK-18841][SQL] Fix redundant Alias remo...

2017-02-03 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16757 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #16783: [SPARK-19441] [SQL] Remove IN type coercion from Promote...

2017-02-03 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16783 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #16783: [SPARK-19441] [SQL] Remove IN type coercion from Promote...

2017-02-03 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16783 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/72324/ Test FAILed. ---

[GitHub] spark issue #16786: [SPARK-19446][SQL] Remove unused findTightestCommonType ...

2017-02-03 Thread HyukjinKwon
Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/16786 Thanks, I just updated and rebased. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #16533: [SPARK-19160][PYTHON][SQL] Add udf decorator

2017-02-03 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16533 **[Test build #72331 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/72331/testReport)** for PR 16533 at commit

[GitHub] spark issue #16533: [SPARK-19160][PYTHON][SQL] Add udf decorator

2017-02-03 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16533 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #16795: [WIP][SPARK-19409][BUILD] Fix ParquetAvroCompatibilitySu...

2017-02-03 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16795 **[Test build #72334 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/72334/testReport)** for PR 16795 at commit

[GitHub] spark issue #16794: [SPARK-19452][SparkR] Fix bug in the name assignment met...

2017-02-03 Thread wangmiao1981
Github user wangmiao1981 commented on the issue: https://github.com/apache/spark/pull/16794 still document failures. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and

[GitHub] spark issue #16794: [SPARK-19452][SparkR] Fix bug in the name assignment met...

2017-02-03 Thread wangmiao1981
Github user wangmiao1981 commented on the issue: https://github.com/apache/spark/pull/16794 retest this please. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and

[GitHub] spark issue #16664: [SPARK-18120 ][SQL] Call QueryExecutionListener callback...

2017-02-03 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16664 **[Test build #72329 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/72329/testReport)** for PR 16664 at commit

[GitHub] spark issue #16794: [SPARK-19452][SparkR] Fix bug in the name assignment met...

2017-02-03 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16794 **[Test build #72335 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/72335/testReport)** for PR 16794 at commit

[GitHub] spark issue #16783: [SPARK-19441] [SQL] Remove IN type coercion from Promote...

2017-02-03 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16783 **[Test build #72336 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/72336/testReport)** for PR 16783 at commit

[GitHub] spark issue #16799: [SparkR] fix error in vignettes

2017-02-03 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16799 **[Test build #72338 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/72338/testReport)** for PR 16799 at commit

[GitHub] spark pull request #16797: [SPARK-19455][SQL] Add option for case-insensitiv...

2017-02-03 Thread budde
GitHub user budde opened a pull request: https://github.com/apache/spark/pull/16797 [SPARK-19455][SQL] Add option for case-insensitive Parquet field resolution ## What changes were proposed in this pull request? **Summary** - Add

[GitHub] spark issue #16533: [SPARK-19160][PYTHON][SQL] Add udf decorator

2017-02-03 Thread zero323
Github user zero323 commented on the issue: https://github.com/apache/spark/pull/16533 @holdenk If believe this is a good as it gets at this moment. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does

[GitHub] spark issue #16686: [SPARK-18682][SS] Batch Source for Kafka

2017-02-03 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16686 **[Test build #72333 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/72333/testReport)** for PR 16686 at commit

[GitHub] spark issue #16686: [SPARK-18682][SS] Batch Source for Kafka

2017-02-03 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16686 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #16783: [SPARK-19441] [SQL] Remove IN type coercion from Promote...

2017-02-03 Thread gatorsmile
Github user gatorsmile commented on the issue: https://github.com/apache/spark/pull/16783 retest this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes

[GitHub] spark pull request #16664: [SPARK-18120 ][SQL] Call QueryExecutionListener c...

2017-02-03 Thread gatorsmile
Github user gatorsmile commented on a diff in the pull request: https://github.com/apache/spark/pull/16664#discussion_r99453218 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/DataFrameWriter.scala --- @@ -428,8 +465,10 @@ final class DataFrameWriter[T] private[sql](ds:

[GitHub] spark pull request #16664: [SPARK-18120 ][SQL] Call QueryExecutionListener c...

2017-02-03 Thread gatorsmile
Github user gatorsmile commented on a diff in the pull request: https://github.com/apache/spark/pull/16664#discussion_r99453252 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/DataFrameWriter.scala --- @@ -218,7 +246,14 @@ final class DataFrameWriter[T] private[sql](ds:

[GitHub] spark pull request #16798: [SPARK-18873][SQL][TEST] New test cases for scala...

2017-02-03 Thread nsyca
Github user nsyca commented on a diff in the pull request: https://github.com/apache/spark/pull/16798#discussion_r99453763 --- Diff: sql/core/src/test/resources/sql-tests/inputs/scalar-subquery.sql --- @@ -1,20 +0,0 @@ -CREATE OR REPLACE TEMPORARY VIEW p AS VALUES (1, 1) AS

<    1   2   3   4   5   6   >