[GitHub] spark issue #21103: [SPARK-23915][SQL] Add array_except function

2018-07-14 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/21103 **[Test build #92997 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/92997/testReport)** for PR 21103 at commit [`5c06922`](https://github.com/apache/spark/commit/5

[GitHub] spark issue #21102: [SPARK-23913][SQL] Add array_intersect function

2018-07-14 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/21102 **[Test build #92998 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/92998/testReport)** for PR 21102 at commit [`5492572`](https://github.com/apache/spark/commit/5

[GitHub] spark issue #21102: [SPARK-23913][SQL] Add array_intersect function

2018-07-14 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21102 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/92998/ Test FAILed. ---

[GitHub] spark issue #21102: [SPARK-23913][SQL] Add array_intersect function

2018-07-14 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21102 Merged build finished. Test FAILed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional comma

[GitHub] spark issue #21103: [SPARK-23915][SQL] Add array_except function

2018-07-14 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21103 Merged build finished. Test FAILed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional comma

[GitHub] spark issue #21103: [SPARK-23915][SQL] Add array_except function

2018-07-14 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21103 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/92997/ Test FAILed. ---

[GitHub] spark pull request #21767: SPARK-24804 There are duplicate words in the titl...

2018-07-14 Thread httfighter
GitHub user httfighter opened a pull request: https://github.com/apache/spark/pull/21767 SPARK-24804 There are duplicate words in the title in the DatasetSuite ## What changes were proposed in this pull request? In DatasetSuite.scala, in the 1299 line, test("SPARK-19896: can

[GitHub] spark issue #21767: SPARK-24804 There are duplicate words in the title in th...

2018-07-14 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21767 Can one of the admins verify this patch? --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #21767: SPARK-24804 There are duplicate words in the title in th...

2018-07-14 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21767 Can one of the admins verify this patch? --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #21767: SPARK-24804 There are duplicate words in the title in th...

2018-07-14 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21767 Can one of the admins verify this patch? --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #20611: [SPARK-23425][SQL]Support wildcard in HDFS path for load...

2018-07-14 Thread sujith71955
Github user sujith71955 commented on the issue: https://github.com/apache/spark/pull/20611 @srowen The only possible objection I can see is that the behavior for paths that contains a ? or * would now change :- There is no behavior change currently, currently user cannot provide

[GitHub] spark issue #18139: [SPARK-20787][PYTHON] PySpark can't handle datetimes bef...

2018-07-14 Thread rberenguel
Github user rberenguel commented on the issue: https://github.com/apache/spark/pull/18139 Hi @holdenk yup, I still have a to-do to address it in a clean way, I got sidetracked with other things. Helping Python since the 18th century! --- -

[GitHub] spark pull request #21768: [SPARK-24776][SQL]Improve Avro unit test

2018-07-14 Thread gengliangwang
GitHub user gengliangwang opened a pull request: https://github.com/apache/spark/pull/21768 [SPARK-24776][SQL]Improve Avro unit test ## What changes were proposed in this pull request? Improve Avro unit test: 1. use QueryTest/SharedSQLContext/SQLTestUtils, instead of the

[GitHub] spark issue #21768: [SPARK-24776][SQL]Improve Avro unit test

2018-07-14 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/21768 **[Test build #92999 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/92999/testReport)** for PR 21768 at commit [`4a7e60b`](https://github.com/apache/spark/commit/4a

[GitHub] spark issue #21768: [SPARK-24776][SQL]Improve Avro unit test

2018-07-14 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21768 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution-unified/949/

[GitHub] spark issue #21768: [SPARK-24776][SQL]Improve Avro unit test

2018-07-14 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21768 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional comma

[GitHub] spark issue #21768: [SPARK-24776][SQL]Improve Avro unit test

2018-07-14 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/21768 **[Test build #92999 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/92999/testReport)** for PR 21768 at commit [`4a7e60b`](https://github.com/apache/spark/commit/4

[GitHub] spark issue #21768: [SPARK-24776][SQL]Improve Avro unit test

2018-07-14 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21768 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional comma

[GitHub] spark issue #21768: [SPARK-24776][SQL]Improve Avro unit test

2018-07-14 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21768 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/92999/ Test PASSed. ---

[GitHub] spark issue #21603: [SPARK-17091][SQL] Add rule to convert IN predicate to e...

2018-07-14 Thread HyukjinKwon
Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/21603 Merged to master --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-

[GitHub] spark pull request #21603: [SPARK-17091][SQL] Add rule to convert IN predica...

2018-07-14 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/21603 --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org

[GitHub] spark issue #21763: Branch 2.1

2018-07-14 Thread HyukjinKwon
Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/21763 @rajesh7738 seems mistakenly open. mind closing this please? --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.o

[GitHub] spark issue #21768: [SPARK-24776][SQL]Improve Avro unit test

2018-07-14 Thread HyukjinKwon
Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/21768 @gengliangwang, mind if I ask to fix the PR title like Deduplicates codes and replace deprecated methods in Avro unit tests? --- ---

[GitHub] spark issue #21767: SPARK-24804 There are duplicate words in the test title ...

2018-07-14 Thread HyukjinKwon
Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/21767 @httfighter, it's okay but mind if I ask take a look and see if there are some typos like this? I'm pretty sure there are more and it'd be better to deal with them in a batch while we are here.

[GitHub] spark issue #21556: [SPARK-24549][SQL] Support Decimal type push down to the...

2018-07-14 Thread HyukjinKwon
Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/21556 @rdblue, ah, I misunderstood then. thanks for clarifying it. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.o

[GitHub] spark issue #21768: [SPARK-24776][SQL]Avro unit test: deduplicates code and ...

2018-07-14 Thread gengliangwang
Github user gengliangwang commented on the issue: https://github.com/apache/spark/pull/21768 @HyukjinKwon sure, thanks for the suggestion. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additi

[GitHub] spark pull request #21769: [SPARK-24805][SQL] Do not ignore avro files witho...

2018-07-14 Thread MaxGekk
GitHub user MaxGekk opened a pull request: https://github.com/apache/spark/pull/21769 [SPARK-24805][SQL] Do not ignore avro files without extensions ## What changes were proposed in this pull request? In the PR, I propose to change default behaviour of AVRO datasource which

[GitHub] spark issue #21769: [SPARK-24805][SQL] Do not ignore avro files without exte...

2018-07-14 Thread MaxGekk
Github user MaxGekk commented on the issue: https://github.com/apache/spark/pull/21769 @gengliangwang @gatorsmile Please, have a look at the PR. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For

[GitHub] spark issue #21769: [SPARK-24805][SQL] Do not ignore avro files without exte...

2018-07-14 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21769 Can one of the admins verify this patch? --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #21769: [SPARK-24805][SQL] Do not ignore avro files without exte...

2018-07-14 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21769 Can one of the admins verify this patch? --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #21769: [SPARK-24805][SQL] Do not ignore avro files without exte...

2018-07-14 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/21769 **[Test build #93000 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/93000/testReport)** for PR 21769 at commit [`8562a8d`](https://github.com/apache/spark/commit/85

[GitHub] spark issue #21769: [SPARK-24805][SQL] Do not ignore avro files without exte...

2018-07-14 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/21769 **[Test build #93000 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/93000/testReport)** for PR 21769 at commit [`8562a8d`](https://github.com/apache/spark/commit/8

[GitHub] spark issue #21769: [SPARK-24805][SQL] Do not ignore avro files without exte...

2018-07-14 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21769 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional comma

[GitHub] spark issue #21769: [SPARK-24805][SQL] Do not ignore avro files without exte...

2018-07-14 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21769 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/93000/ Test PASSed. ---

[GitHub] spark issue #19659: [SPARK-19668][ML] Multiple NGram sizes

2018-07-14 Thread mpetruska
Github user mpetruska commented on the issue: https://github.com/apache/spark/pull/19659 No, I'm not working on this one, the feature seems to lack any real interest. We can close it, if you like. --- - To unsubscri

[GitHub] spark pull request #21763: Branch 2.1

2018-07-14 Thread rajesh7738
Github user rajesh7738 closed the pull request at: https://github.com/apache/spark/pull/21763 --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org

[GitHub] spark issue #21763: Branch 2.1

2018-07-14 Thread rajesh7738
Github user rajesh7738 commented on the issue: https://github.com/apache/spark/pull/21763 yes..closed --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@s

[GitHub] spark issue #21766: [SPARK-24803][SQL] add support for numeric

2018-07-14 Thread maropu
Github user maropu commented on the issue: https://github.com/apache/spark/pull/21766 @gatorsmile Is it worth adding a numeric type as an alias of decimal? Both types seems to be in the SQL standard and some dbms (e.g., postgresql and sql server) can parse both. @wangtao605 Can yo

[GitHub] spark issue #21102: [SPARK-23913][SQL] Add array_intersect function

2018-07-14 Thread kiszk
Github user kiszk commented on the issue: https://github.com/apache/spark/pull/21102 retest this please --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...

[GitHub] spark issue #21103: [SPARK-23915][SQL] Add array_except function

2018-07-14 Thread kiszk
Github user kiszk commented on the issue: https://github.com/apache/spark/pull/21103 retest this please --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...

[GitHub] spark issue #21103: [SPARK-23915][SQL] Add array_except function

2018-07-14 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21103 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution-unified/950/

[GitHub] spark issue #21102: [SPARK-23913][SQL] Add array_intersect function

2018-07-14 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/21102 **[Test build #93002 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/93002/testReport)** for PR 21102 at commit [`5492572`](https://github.com/apache/spark/commit/54

[GitHub] spark issue #21103: [SPARK-23915][SQL] Add array_except function

2018-07-14 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/21103 **[Test build #93001 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/93001/testReport)** for PR 21103 at commit [`5c06922`](https://github.com/apache/spark/commit/5c

[GitHub] spark issue #21103: [SPARK-23915][SQL] Add array_except function

2018-07-14 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21103 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional comma

[GitHub] spark issue #21102: [SPARK-23913][SQL] Add array_intersect function

2018-07-14 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21102 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional comma

[GitHub] spark issue #21102: [SPARK-23913][SQL] Add array_intersect function

2018-07-14 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21102 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution-unified/951/

[GitHub] spark pull request #21770: [SPARK-24806][SQL] Brush up generated code so tha...

2018-07-14 Thread maropu
GitHub user maropu opened a pull request: https://github.com/apache/spark/pull/21770 [SPARK-24806][SQL] Brush up generated code so that JDK compilers can handle it ## What changes were proposed in this pull request? This pr brushed up code so that JDK compilers can handle it bec

[GitHub] spark issue #21770: [SPARK-24806][SQL] Brush up generated code so that JDK c...

2018-07-14 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/21770 **[Test build #93003 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/93003/testReport)** for PR 21770 at commit [`08fddcb`](https://github.com/apache/spark/commit/08

[GitHub] spark issue #21770: [SPARK-24806][SQL] Brush up generated code so that JDK c...

2018-07-14 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21770 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional comma

[GitHub] spark issue #21770: [SPARK-24806][SQL] Brush up generated code so that JDK c...

2018-07-14 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21770 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution-unified/952/

[GitHub] spark issue #21770: [SPARK-24806][SQL] Brush up generated code so that JDK c...

2018-07-14 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/21770 **[Test build #93003 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/93003/testReport)** for PR 21770 at commit [`08fddcb`](https://github.com/apache/spark/commit/0

[GitHub] spark issue #21770: [SPARK-24806][SQL] Brush up generated code so that JDK c...

2018-07-14 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21770 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/93003/ Test FAILed. ---

[GitHub] spark issue #21770: [SPARK-24806][SQL] Brush up generated code so that JDK c...

2018-07-14 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21770 Merged build finished. Test FAILed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional comma

[GitHub] spark issue #21770: [SPARK-24806][SQL] Brush up generated code so that JDK c...

2018-07-14 Thread maropu
Github user maropu commented on the issue: https://github.com/apache/spark/pull/21770 As I said in `SPARK-24498`, I think, whether `SPARK-24498` resolved or not, we'd be better to make generated code Java-compatible as far as possible. As @mgaido91 suggested there, there is no

[GitHub] spark issue #21770: [SPARK-24806][SQL] Brush up generated code so that JDK c...

2018-07-14 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/21770 **[Test build #93004 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/93004/testReport)** for PR 21770 at commit [`2441b07`](https://github.com/apache/spark/commit/24

[GitHub] spark issue #21770: [SPARK-24806][SQL] Brush up generated code so that JDK c...

2018-07-14 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21770 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution-unified/953/

[GitHub] spark issue #21770: [SPARK-24806][SQL] Brush up generated code so that JDK c...

2018-07-14 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21770 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional comma

[GitHub] spark issue #21770: [SPARK-24806][SQL] Brush up generated code so that JDK c...

2018-07-14 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21770 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution-unified/954/

[GitHub] spark issue #21770: [SPARK-24806][SQL] Brush up generated code so that JDK c...

2018-07-14 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21770 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional comma

[GitHub] spark issue #21770: [SPARK-24806][SQL] Brush up generated code so that JDK c...

2018-07-14 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21770 Merged build finished. Test FAILed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional comma

[GitHub] spark issue #21770: [SPARK-24806][SQL] Brush up generated code so that JDK c...

2018-07-14 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/21770 **[Test build #93004 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/93004/testReport)** for PR 21770 at commit [`2441b07`](https://github.com/apache/spark/commit/2

[GitHub] spark issue #21770: [SPARK-24806][SQL] Brush up generated code so that JDK c...

2018-07-14 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21770 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/93004/ Test FAILed. ---

[GitHub] spark issue #21764: [SPARK-24802] Optimization Rule Exclusion

2018-07-14 Thread maropu
Github user maropu commented on the issue: https://github.com/apache/spark/pull/21764 Do you have concrete usecases in your business? Basically, I think the optimizer is a black-box for most users and they don't easily understand how it works correctly when excluding some rules. Are t

[GitHub] spark pull request #21771: [SPARK-24807][SQL] Adding files/jars twice: outpu...

2018-07-14 Thread MaxGekk
GitHub user MaxGekk opened a pull request: https://github.com/apache/spark/pull/21771 [SPARK-24807][SQL] Adding files/jars twice: output a warning and add a note ## What changes were proposed in this pull request? In the PR, I propose to output an warning if the `addFile()`

[GitHub] spark issue #21771: [SPARK-24807][SQL] Adding files/jars twice: output a war...

2018-07-14 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/21771 **[Test build #93005 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/93005/testReport)** for PR 21771 at commit [`0942fd2`](https://github.com/apache/spark/commit/09

[GitHub] spark issue #21771: [SPARK-24807][SQL] Adding files/jars twice: output a war...

2018-07-14 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21771 Can one of the admins verify this patch? --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #21771: [SPARK-24807][SQL] Adding files/jars twice: output a war...

2018-07-14 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21771 Can one of the admins verify this patch? --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #21741: [SPARK-24718][SQL] Timestamp support pushdown to parquet...

2018-07-14 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/21741 **[Test build #93006 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/93006/testReport)** for PR 21741 at commit [`f206457`](https://github.com/apache/spark/commit/f2

[GitHub] spark issue #21741: [SPARK-24718][SQL] Timestamp support pushdown to parquet...

2018-07-14 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21741 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional comma

[GitHub] spark issue #21741: [SPARK-24718][SQL] Timestamp support pushdown to parquet...

2018-07-14 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21741 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution-unified/955/

[GitHub] spark issue #21771: [SPARK-24807][SQL] Adding files/jars twice: output a war...

2018-07-14 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/21771 **[Test build #93007 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/93007/testReport)** for PR 21771 at commit [`4a583c6`](https://github.com/apache/spark/commit/4a

[GitHub] spark issue #21767: SPARK-24804 There are duplicate words in the test title ...

2018-07-14 Thread wangyum
Github user wangyum commented on the issue: https://github.com/apache/spark/pull/21767 **Find more typos**: - Analyze > Run Inspection by Name ![image](https://user-images.githubusercontent.com/5399861/42726123-0500b75a-87c2-11e8-8fe8-8375b1e0f694.png) - Type "Typo"

[GitHub] spark issue #21764: [SPARK-24802] Optimization Rule Exclusion

2018-07-14 Thread gatorsmile
Github user gatorsmile commented on the issue: https://github.com/apache/spark/pull/21764 Let me give an example. The ticket https://issues.apache.org/jira/browse/SPARK-24624 shows a common issue in which our optimizer does not work well in all the cases. It is a bug but our users ar

[GitHub] spark pull request #21764: [SPARK-24802] Optimization Rule Exclusion

2018-07-14 Thread gatorsmile
Github user gatorsmile commented on a diff in the pull request: https://github.com/apache/spark/pull/21764#discussion_r202521451 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/optimizer/Optimizer.scala --- @@ -46,7 +47,23 @@ abstract class Optimizer(sessionCat

[GitHub] spark pull request #21769: [SPARK-24805][SQL] Do not ignore avro files witho...

2018-07-14 Thread gengliangwang
Github user gengliangwang commented on a diff in the pull request: https://github.com/apache/spark/pull/21769#discussion_r202521435 --- Diff: external/avro/src/test/scala/org/apache/spark/sql/avro/AvroSuite.scala --- @@ -809,4 +810,16 @@ class AvroSuite extends SparkFunSuite {

[GitHub] spark pull request #21769: [SPARK-24805][SQL] Do not ignore avro files witho...

2018-07-14 Thread gengliangwang
Github user gengliangwang commented on a diff in the pull request: https://github.com/apache/spark/pull/21769#discussion_r202521397 --- Diff: external/avro/src/main/scala/org/apache/spark/sql/avro/AvroFileFormat.scala --- @@ -64,7 +64,7 @@ private[avro] class AvroFileFormat extends

[GitHub] spark pull request #21769: [SPARK-24805][SQL] Do not ignore avro files witho...

2018-07-14 Thread gengliangwang
Github user gengliangwang commented on a diff in the pull request: https://github.com/apache/spark/pull/21769#discussion_r202521471 --- Diff: external/avro/src/test/scala/org/apache/spark/sql/avro/AvroSuite.scala --- @@ -623,7 +624,7 @@ class AvroSuite extends SparkFunSuite {

[GitHub] spark pull request #21764: [SPARK-24802] Optimization Rule Exclusion

2018-07-14 Thread gatorsmile
Github user gatorsmile commented on a diff in the pull request: https://github.com/apache/spark/pull/21764#discussion_r202521545 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/optimizer/Optimizer.scala --- @@ -175,6 +179,35 @@ abstract class Optimizer(sessionC

[GitHub] spark issue #21103: [SPARK-23915][SQL] Add array_except function

2018-07-14 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/21103 **[Test build #93001 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/93001/testReport)** for PR 21103 at commit [`5c06922`](https://github.com/apache/spark/commit/5

[GitHub] spark issue #21103: [SPARK-23915][SQL] Add array_except function

2018-07-14 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21103 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/93001/ Test PASSed. ---

[GitHub] spark issue #21103: [SPARK-23915][SQL] Add array_except function

2018-07-14 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21103 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional comma

[GitHub] spark issue #21102: [SPARK-23913][SQL] Add array_intersect function

2018-07-14 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/21102 **[Test build #93002 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/93002/testReport)** for PR 21102 at commit [`5492572`](https://github.com/apache/spark/commit/5

[GitHub] spark issue #21102: [SPARK-23913][SQL] Add array_intersect function

2018-07-14 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21102 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional comma

[GitHub] spark issue #21102: [SPARK-23913][SQL] Add array_intersect function

2018-07-14 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21102 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/93002/ Test PASSed. ---

[GitHub] spark issue #21741: [SPARK-24718][SQL] Timestamp support pushdown to parquet...

2018-07-14 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/21741 **[Test build #93006 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/93006/testReport)** for PR 21741 at commit [`f206457`](https://github.com/apache/spark/commit/f

[GitHub] spark issue #21741: [SPARK-24718][SQL] Timestamp support pushdown to parquet...

2018-07-14 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21741 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/93006/ Test PASSed. ---

[GitHub] spark issue #21741: [SPARK-24718][SQL] Timestamp support pushdown to parquet...

2018-07-14 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21741 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional comma

[GitHub] spark issue #21771: [SPARK-24807][CORE] Adding files/jars twice: output a wa...

2018-07-14 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/21771 **[Test build #93005 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/93005/testReport)** for PR 21771 at commit [`0942fd2`](https://github.com/apache/spark/commit/0

[GitHub] spark issue #21771: [SPARK-24807][CORE] Adding files/jars twice: output a wa...

2018-07-14 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21771 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional comma

[GitHub] spark issue #21771: [SPARK-24807][CORE] Adding files/jars twice: output a wa...

2018-07-14 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21771 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/93005/ Test PASSed. ---

[GitHub] spark issue #21771: [SPARK-24807][CORE] Adding files/jars twice: output a wa...

2018-07-14 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/21771 **[Test build #93007 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/93007/testReport)** for PR 21771 at commit [`4a583c6`](https://github.com/apache/spark/commit/4

[GitHub] spark issue #21771: [SPARK-24807][CORE] Adding files/jars twice: output a wa...

2018-07-14 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21771 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional comma

[GitHub] spark issue #21771: [SPARK-24807][CORE] Adding files/jars twice: output a wa...

2018-07-14 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21771 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/93007/ Test PASSed. ---

[GitHub] spark pull request #21769: [SPARK-24805][SQL] Do not ignore avro files witho...

2018-07-14 Thread MaxGekk
Github user MaxGekk commented on a diff in the pull request: https://github.com/apache/spark/pull/21769#discussion_r202524552 --- Diff: external/avro/src/main/scala/org/apache/spark/sql/avro/AvroFileFormat.scala --- @@ -64,7 +64,7 @@ private[avro] class AvroFileFormat extends FileF

[GitHub] spark issue #21556: [SPARK-24549][SQL] Support Decimal type push down to the...

2018-07-14 Thread rdblue
Github user rdblue commented on the issue: https://github.com/apache/spark/pull/21556 I misunderstood how it was safe as well. It was Yuming's clarification that helped. --- - To unsubscribe, e-mail: reviews-unsubsc

[GitHub] spark pull request #21769: [SPARK-24805][SQL] Do not ignore avro files witho...

2018-07-14 Thread MaxGekk
Github user MaxGekk commented on a diff in the pull request: https://github.com/apache/spark/pull/21769#discussion_r202524696 --- Diff: external/avro/src/test/scala/org/apache/spark/sql/avro/AvroSuite.scala --- @@ -809,4 +810,16 @@ class AvroSuite extends SparkFunSuite {

[GitHub] spark pull request #21769: [SPARK-24805][SQL] Do not ignore avro files witho...

2018-07-14 Thread MaxGekk
Github user MaxGekk commented on a diff in the pull request: https://github.com/apache/spark/pull/21769#discussion_r202524884 --- Diff: external/avro/src/main/scala/org/apache/spark/sql/avro/AvroFileFormat.scala --- @@ -64,7 +64,7 @@ private[avro] class AvroFileFormat extends FileF

[GitHub] spark pull request #21769: [SPARK-24805][SQL] Do not ignore avro files witho...

2018-07-14 Thread MaxGekk
Github user MaxGekk commented on a diff in the pull request: https://github.com/apache/spark/pull/21769#discussion_r202525034 --- Diff: external/avro/src/test/scala/org/apache/spark/sql/avro/AvroSuite.scala --- @@ -623,7 +624,7 @@ class AvroSuite extends SparkFunSuite {

[GitHub] spark issue #21750: [SPARK-24754][ML] Minhash integer overflow

2018-07-14 Thread srowen
Github user srowen commented on the issue: https://github.com/apache/spark/pull/21750 Merged to master --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@

[GitHub] spark pull request #21750: [SPARK-24754][ML] Minhash integer overflow

2018-07-14 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/21750 --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org

  1   2   >