[GitHub] [spark] HeartSaVioR commented on a change in pull request #25760: [SPARK-29054][SS] Invalidate Kafka consumer when new delegation token available

2019-09-26 Thread GitBox
HeartSaVioR commented on a change in pull request #25760: [SPARK-29054][SS] Invalidate Kafka consumer when new delegation token available URL: https://github.com/apache/spark/pull/25760#discussion_r328448641 ## File path:

[GitHub] [spark] HeartSaVioR commented on a change in pull request #25670: [SPARK-28869][CORE] Roll over event log files

2019-09-26 Thread GitBox
HeartSaVioR commented on a change in pull request #25670: [SPARK-28869][CORE] Roll over event log files URL: https://github.com/apache/spark/pull/25670#discussion_r328403300 ## File path: core/src/test/scala/org/apache/spark/deploy/history/EventLogFileWritersSuite.scala

[GitHub] [spark] AmplabJenkins removed a comment on issue #25771: [SPARK-28970][SQL] Implement USE CATALOG/NAMESPACE for Data Source V2

2019-09-26 Thread GitBox
AmplabJenkins removed a comment on issue #25771: [SPARK-28970][SQL] Implement USE CATALOG/NAMESPACE for Data Source V2 URL: https://github.com/apache/spark/pull/25771#issuecomment-535360058 Merged build finished. Test FAILed.

[GitHub] [spark] AmplabJenkins commented on issue #25771: [SPARK-28970][SQL] Implement USE CATALOG/NAMESPACE for Data Source V2

2019-09-26 Thread GitBox
AmplabJenkins commented on issue #25771: [SPARK-28970][SQL] Implement USE CATALOG/NAMESPACE for Data Source V2 URL: https://github.com/apache/spark/pull/25771#issuecomment-535360081 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #25935: [SPARK-27748][SS][FOLLOWUP] Correct the order of logging token as debug log

2019-09-26 Thread GitBox
AmplabJenkins commented on issue #25935: [SPARK-27748][SS][FOLLOWUP] Correct the order of logging token as debug log URL: https://github.com/apache/spark/pull/25935#issuecomment-535360079 Can one of the admins verify this patch?

[GitHub] [spark] AmplabJenkins commented on issue #25771: [SPARK-28970][SQL] Implement USE CATALOG/NAMESPACE for Data Source V2

2019-09-26 Thread GitBox
AmplabJenkins commented on issue #25771: [SPARK-28970][SQL] Implement USE CATALOG/NAMESPACE for Data Source V2 URL: https://github.com/apache/spark/pull/25771#issuecomment-535360058 Merged build finished. Test FAILed. This

[GitHub] [spark] beliefer commented on issue #25933: [SPARK-29252][BUILD] Upgrade zookeeper to 3.4.14 and fix vulnerabilities.

2019-09-26 Thread GitBox
beliefer commented on issue #25933: [SPARK-29252][BUILD] Upgrade zookeeper to 3.4.14 and fix vulnerabilities. URL: https://github.com/apache/spark/pull/25933#issuecomment-535360392 Retest this please. This is an automated

[GitHub] [spark] SparkQA removed a comment on issue #25771: [SPARK-28970][SQL] Implement USE CATALOG/NAMESPACE for Data Source V2

2019-09-26 Thread GitBox
SparkQA removed a comment on issue #25771: [SPARK-28970][SQL] Implement USE CATALOG/NAMESPACE for Data Source V2 URL: https://github.com/apache/spark/pull/25771#issuecomment-535331136 **[Test build #111386 has

[GitHub] [spark] AmplabJenkins commented on issue #25937: [SPARK-29256][DOCS][MINOR] Fix typo in building document

2019-09-26 Thread GitBox
AmplabJenkins commented on issue #25937: [SPARK-29256][DOCS][MINOR] Fix typo in building document URL: https://github.com/apache/spark/pull/25937#issuecomment-535366344 Can one of the admins verify this patch? This is an

[GitHub] [spark] AmplabJenkins commented on issue #25937: [SPARK-29256][DOCS][MINOR] Fix typo in building document

2019-09-26 Thread GitBox
AmplabJenkins commented on issue #25937: [SPARK-29256][DOCS][MINOR] Fix typo in building document URL: https://github.com/apache/spark/pull/25937#issuecomment-535365924 Can one of the admins verify this patch? This is an

[GitHub] [spark] SparkQA commented on issue #25888: [SPARK-21492] [SQL] Fix memory leak issue in SMJ

2019-09-26 Thread GitBox
SparkQA commented on issue #25888: [SPARK-21492] [SQL] Fix memory leak issue in SMJ URL: https://github.com/apache/spark/pull/25888#issuecomment-535366057 **[Test build #111398 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/111398/testReport)** for PR

[GitHub] [spark] beliefer commented on issue #25933: [SPARK-29252][BUILD] Upgrade zookeeper to 3.4.14 and fix vulnerabilities.

2019-09-26 Thread GitBox
beliefer commented on issue #25933: [SPARK-29252][BUILD] Upgrade zookeeper to 3.4.14 and fix vulnerabilities. URL: https://github.com/apache/spark/pull/25933#issuecomment-535370723 Retest this please. This is an automated

[GitHub] [spark] SparkQA commented on issue #25747: [SPARK-29039][SQL] centralize the catalog and table lookup logic

2019-09-26 Thread GitBox
SparkQA commented on issue #25747: [SPARK-29039][SQL] centralize the catalog and table lookup logic URL: https://github.com/apache/spark/pull/25747#issuecomment-535378073 **[Test build #111405 has

[GitHub] [spark] AmplabJenkins commented on issue #25747: [SPARK-29039][SQL] centralize the catalog and table lookup logic

2019-09-26 Thread GitBox
AmplabJenkins commented on issue #25747: [SPARK-29039][SQL] centralize the catalog and table lookup logic URL: https://github.com/apache/spark/pull/25747#issuecomment-535378458 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #25747: [SPARK-29039][SQL] centralize the catalog and table lookup logic

2019-09-26 Thread GitBox
AmplabJenkins commented on issue #25747: [SPARK-29039][SQL] centralize the catalog and table lookup logic URL: https://github.com/apache/spark/pull/25747#issuecomment-535378453 Merged build finished. Test PASSed. This is an

[GitHub] [spark] AmplabJenkins commented on issue #25932: [SPARK-29250][BUILD][test-hadoop3.2][test-java11][test-maven] Upgrade to Hadoop 3.2.1

2019-09-26 Thread GitBox
AmplabJenkins commented on issue #25932: [SPARK-29250][BUILD][test-hadoop3.2][test-java11][test-maven] Upgrade to Hadoop 3.2.1 URL: https://github.com/apache/spark/pull/25932#issuecomment-535378473 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins commented on issue #25932: [SPARK-29250][BUILD][test-hadoop3.2][test-java11][test-maven] Upgrade to Hadoop 3.2.1

2019-09-26 Thread GitBox
AmplabJenkins commented on issue #25932: [SPARK-29250][BUILD][test-hadoop3.2][test-java11][test-maven] Upgrade to Hadoop 3.2.1 URL: https://github.com/apache/spark/pull/25932#issuecomment-535378481 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #25863: [SPARK-28945][SPARK-29037][CORE][SQL] Fix the issue that spark gives duplicate result and support concurrent file source write operations writ

2019-09-26 Thread GitBox
AmplabJenkins commented on issue #25863: [SPARK-28945][SPARK-29037][CORE][SQL] Fix the issue that spark gives duplicate result and support concurrent file source write operations write to different partitions in the same table. URL:

[GitHub] [spark] AmplabJenkins commented on issue #25863: [SPARK-28945][SPARK-29037][CORE][SQL] Fix the issue that spark gives duplicate result and support concurrent file source write operations writ

2019-09-26 Thread GitBox
AmplabJenkins commented on issue #25863: [SPARK-28945][SPARK-29037][CORE][SQL] Fix the issue that spark gives duplicate result and support concurrent file source write operations write to different partitions in the same table. URL:

[GitHub] [spark] AmplabJenkins removed a comment on issue #25863: [SPARK-28945][SPARK-29037][CORE][SQL] Fix the issue that spark gives duplicate result and support concurrent file source write operati

2019-09-26 Thread GitBox
AmplabJenkins removed a comment on issue #25863: [SPARK-28945][SPARK-29037][CORE][SQL] Fix the issue that spark gives duplicate result and support concurrent file source write operations write to different partitions in the same table. URL:

[GitHub] [spark] AmplabJenkins removed a comment on issue #25863: [SPARK-28945][SPARK-29037][CORE][SQL] Fix the issue that spark gives duplicate result and support concurrent file source write operati

2019-09-26 Thread GitBox
AmplabJenkins removed a comment on issue #25863: [SPARK-28945][SPARK-29037][CORE][SQL] Fix the issue that spark gives duplicate result and support concurrent file source write operations write to different partitions in the same table. URL:

[GitHub] [spark] HyukjinKwon commented on a change in pull request #25923: [DO-NOT-MERGE][WIP][MINOR][SQL][TESTS] show tests in SQLQuerySuite correctly in Jenkins

2019-09-26 Thread GitBox
HyukjinKwon commented on a change in pull request #25923: [DO-NOT-MERGE][WIP][MINOR][SQL][TESTS] show tests in SQLQuerySuite correctly in Jenkins URL: https://github.com/apache/spark/pull/25923#discussion_r328481434 ## File path:

[GitHub] [spark] wangyum closed pull request #25877: [NO-NOT-MERGE][test-maven] Verify timeout for maven SparkPullRequestBuilder

2019-09-26 Thread GitBox
wangyum closed pull request #25877: [NO-NOT-MERGE][test-maven] Verify timeout for maven SparkPullRequestBuilder URL: https://github.com/apache/spark/pull/25877 This is an automated message from the Apache Git Service. To

[GitHub] [spark] SparkQA commented on issue #25938: [SPARK-29203][SQL][TESTS][2.4] Reduce shuffle partitions in SQLQueryTestSuite

2019-09-26 Thread GitBox
SparkQA commented on issue #25938: [SPARK-29203][SQL][TESTS][2.4] Reduce shuffle partitions in SQLQueryTestSuite URL: https://github.com/apache/spark/pull/25938#issuecomment-535391656 **[Test build #111409 has

[GitHub] [spark] SparkQA commented on issue #25940: [SPARK-29258][ML][PYSPARK] parity between ml.evaluator and mllib.metrics

2019-09-26 Thread GitBox
SparkQA commented on issue #25940: [SPARK-29258][ML][PYSPARK] parity between ml.evaluator and mllib.metrics URL: https://github.com/apache/spark/pull/25940#issuecomment-535403142 **[Test build #111411 has

[GitHub] [spark] yaooqinn commented on issue #25941: [SPARK-29257][Core][Shuffle] Use task attempt number as noop reduce id to handle disk failures during shuffle

2019-09-26 Thread GitBox
yaooqinn commented on issue #25941: [SPARK-29257][Core][Shuffle] Use task attempt number as noop reduce id to handle disk failures during shuffle URL: https://github.com/apache/spark/pull/25941#issuecomment-535430113 @cloud-fan you're right. this will break the dependency of the reader and

[GitHub] [spark] xuanyuanking commented on issue #25849: [SPARK-29175][SQL] Make additional remote maven repository in IsolatedClientLoader configurable

2019-09-26 Thread GitBox
xuanyuanking commented on issue #25849: [SPARK-29175][SQL] Make additional remote maven repository in IsolatedClientLoader configurable URL: https://github.com/apache/spark/pull/25849#issuecomment-535429996 retest this please.

[GitHub] [spark] turboFei commented on issue #25941: [WIP][SPARK-29257][Core][Shuffle] Use task attempt number as noop reduce id to handle disk failures during shuffle

2019-09-26 Thread GitBox
turboFei commented on issue #25941: [WIP][SPARK-29257][Core][Shuffle] Use task attempt number as noop reduce id to handle disk failures during shuffle URL: https://github.com/apache/spark/pull/25941#issuecomment-535443610 About this issue, I propose my thought. This

[GitHub] [spark] turboFei edited a comment on issue #25941: [WIP][SPARK-29257][Core][Shuffle] Use task attempt number as noop reduce id to handle disk failures during shuffle

2019-09-26 Thread GitBox
turboFei edited a comment on issue #25941: [WIP][SPARK-29257][Core][Shuffle] Use task attempt number as noop reduce id to handle disk failures during shuffle URL: https://github.com/apache/spark/pull/25941#issuecomment-535443610 About this issue, I propose my thought. This

[GitHub] [spark] cloud-fan commented on a change in pull request #25919: [SPARK-15616][SQL] Hive table supports partition pruning in JoinSelection

2019-09-26 Thread GitBox
cloud-fan commented on a change in pull request #25919: [SPARK-15616][SQL] Hive table supports partition pruning in JoinSelection URL: https://github.com/apache/spark/pull/25919#discussion_r328447497 ## File path:

[GitHub] [spark] SparkQA commented on issue #25889: [SPARK-29202][Deploy] Driver java options are not passed to driver process in Yarn client mode

2019-09-26 Thread GitBox
SparkQA commented on issue #25889: [SPARK-29202][Deploy] Driver java options are not passed to driver process in Yarn client mode URL: https://github.com/apache/spark/pull/25889#issuecomment-535353104 **[Test build #111394 has

[GitHub] [spark] SparkQA commented on issue #25697: [SPARK-28997][SQL] Add `spark.sql.dialect`

2019-09-26 Thread GitBox
SparkQA commented on issue #25697: [SPARK-28997][SQL] Add `spark.sql.dialect` URL: https://github.com/apache/spark/pull/25697#issuecomment-535358069 **[Test build #111381 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/111381/testReport)** for PR 25697 at

[GitHub] [spark] SparkQA commented on issue #25933: [SPARK-29252][BUILD] Upgrade zookeeper to 3.4.14 and fix vulnerabilities.

2019-09-26 Thread GitBox
SparkQA commented on issue #25933: [SPARK-29252][BUILD] Upgrade zookeeper to 3.4.14 and fix vulnerabilities. URL: https://github.com/apache/spark/pull/25933#issuecomment-535361882 **[Test build #111396 has

[GitHub] [spark] AmplabJenkins commented on issue #25771: [SPARK-28970][SQL] Implement USE CATALOG/NAMESPACE for Data Source V2

2019-09-26 Thread GitBox
AmplabJenkins commented on issue #25771: [SPARK-28970][SQL] Implement USE CATALOG/NAMESPACE for Data Source V2 URL: https://github.com/apache/spark/pull/25771#issuecomment-535361762 Merged build finished. Test FAILed. This

[GitHub] [spark] itsvikramagr commented on a change in pull request #24922: [SPARK-28120][SS] Rocksdb state storage implementation

2019-09-26 Thread GitBox
itsvikramagr commented on a change in pull request #24922: [SPARK-28120][SS] Rocksdb state storage implementation URL: https://github.com/apache/spark/pull/24922#discussion_r328455190 ## File path:

[GitHub] [spark] SparkQA commented on issue #25771: [SPARK-28970][SQL] Implement USE CATALOG/NAMESPACE for Data Source V2

2019-09-26 Thread GitBox
SparkQA commented on issue #25771: [SPARK-28970][SQL] Implement USE CATALOG/NAMESPACE for Data Source V2 URL: https://github.com/apache/spark/pull/25771#issuecomment-535361591 **[Test build #111387 has

[GitHub] [spark] AmplabJenkins commented on issue #25771: [SPARK-28970][SQL] Implement USE CATALOG/NAMESPACE for Data Source V2

2019-09-26 Thread GitBox
AmplabJenkins commented on issue #25771: [SPARK-28970][SQL] Implement USE CATALOG/NAMESPACE for Data Source V2 URL: https://github.com/apache/spark/pull/25771#issuecomment-535361767 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on issue #25771: [SPARK-28970][SQL] Implement USE CATALOG/NAMESPACE for Data Source V2

2019-09-26 Thread GitBox
AmplabJenkins removed a comment on issue #25771: [SPARK-28970][SQL] Implement USE CATALOG/NAMESPACE for Data Source V2 URL: https://github.com/apache/spark/pull/25771#issuecomment-535361762 Merged build finished. Test FAILed.

[GitHub] [spark] AmplabJenkins removed a comment on issue #25771: [SPARK-28970][SQL] Implement USE CATALOG/NAMESPACE for Data Source V2

2019-09-26 Thread GitBox
AmplabJenkins removed a comment on issue #25771: [SPARK-28970][SQL] Implement USE CATALOG/NAMESPACE for Data Source V2 URL: https://github.com/apache/spark/pull/25771#issuecomment-535361767 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #25670: [SPARK-28869][CORE] Roll over event log files

2019-09-26 Thread GitBox
AmplabJenkins commented on issue #25670: [SPARK-28869][CORE] Roll over event log files URL: https://github.com/apache/spark/pull/25670#issuecomment-535369684 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on issue #25888: [SPARK-21492] [SQL] Fix memory leak issue in SMJ

2019-09-26 Thread GitBox
AmplabJenkins removed a comment on issue #25888: [SPARK-21492] [SQL] Fix memory leak issue in SMJ URL: https://github.com/apache/spark/pull/25888#issuecomment-535369329 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on issue #25085: [SPARK-28313][SQL] Spark sql null type incompatible with hive void type

2019-09-26 Thread GitBox
AmplabJenkins removed a comment on issue #25085: [SPARK-28313][SQL] Spark sql null type incompatible with hive void type URL: https://github.com/apache/spark/pull/25085#issuecomment-535369493 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on issue #25902: [SPARK-29213][SQL] Make it consistent when get notnull output and generate null checks in FilterExec

2019-09-26 Thread GitBox
AmplabJenkins removed a comment on issue #25902: [SPARK-29213][SQL] Make it consistent when get notnull output and generate null checks in FilterExec URL: https://github.com/apache/spark/pull/25902#issuecomment-535369462 Test FAILed. Refer to this link for build results (access rights

[GitHub] [spark] AmplabJenkins removed a comment on issue #25670: [SPARK-28869][CORE] Roll over event log files

2019-09-26 Thread GitBox
AmplabJenkins removed a comment on issue #25670: [SPARK-28869][CORE] Roll over event log files URL: https://github.com/apache/spark/pull/25670#issuecomment-535369684 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] cloud-fan commented on issue #25925: [SPARK-29239][SPARK-29221][SQL] Subquery should not cause NPE when eliminating subexpression

2019-09-26 Thread GitBox
cloud-fan commented on issue #25925: [SPARK-29239][SPARK-29221][SQL] Subquery should not cause NPE when eliminating subexpression URL: https://github.com/apache/spark/pull/25925#issuecomment-535372343 do we have to trigger the bug via `CODEGEN_FACTORY_MODE=CODEGEN_ONLY`? This is a runtime

[GitHub] [spark] gengliangwang commented on issue #25936: [SPARK-29255][SQL][TESTS] Rename package pgSQL to postgreSQL

2019-09-26 Thread GitBox
gengliangwang commented on issue #25936: [SPARK-29255][SQL][TESTS] Rename package pgSQL to postgreSQL URL: https://github.com/apache/spark/pull/25936#issuecomment-535372472 retest this please. This is an automated message

[GitHub] [spark] gengliangwang commented on issue #25834: [WIP][SPARK-29155][SQL] Support special date/timestamp values in the PostgreSQL dialect only

2019-09-26 Thread GitBox
gengliangwang commented on issue #25834: [WIP][SPARK-29155][SQL] Support special date/timestamp values in the PostgreSQL dialect only URL: https://github.com/apache/spark/pull/25834#issuecomment-535372296 > the case 2 in #25697 is conflict with the existing behaivours? I think so.

[GitHub] [spark] cloud-fan commented on a change in pull request #25697: [SPARK-28997][SQL] Add `spark.sql.dialect`

2019-09-26 Thread GitBox
cloud-fan commented on a change in pull request #25697: [SPARK-28997][SQL] Add `spark.sql.dialect` URL: https://github.com/apache/spark/pull/25697#discussion_r328466804 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/util/postgreSQL/StringUtils.scala

[GitHub] [spark] SparkQA commented on issue #25932: [SPARK-29250][BUILD][test-hadoop3.2][test-java11][test-maven] Upgrade to Hadoop 3.2.1

2019-09-26 Thread GitBox
SparkQA commented on issue #25932: [SPARK-29250][BUILD][test-hadoop3.2][test-java11][test-maven] Upgrade to Hadoop 3.2.1 URL: https://github.com/apache/spark/pull/25932#issuecomment-535378003 **[Test build #111404 has

[GitHub] [spark] cloud-fan commented on issue #25747: [SPARK-29039][SQL] centralize the catalog and table lookup logic

2019-09-26 Thread GitBox
cloud-fan commented on issue #25747: [SPARK-29039][SQL] centralize the catalog and table lookup logic URL: https://github.com/apache/spark/pull/25747#issuecomment-535377543 retest this please This is an automated message

[GitHub] [spark] dongjoon-hyun commented on issue #25932: [SPARK-29250][BUILD][test-hadoop3.2][test-java11][test-maven] Upgrade to Hadoop 3.2.1

2019-09-26 Thread GitBox
dongjoon-hyun commented on issue #25932: [SPARK-29250][BUILD][test-hadoop3.2][test-java11][test-maven] Upgrade to Hadoop 3.2.1 URL: https://github.com/apache/spark/pull/25932#issuecomment-535377499 Retest this please. This

[GitHub] [spark] SparkQA commented on issue #25937: [SPARK-29256][DOCS] Fix typo in building document

2019-09-26 Thread GitBox
SparkQA commented on issue #25937: [SPARK-29256][DOCS] Fix typo in building document URL: https://github.com/apache/spark/pull/25937#issuecomment-535380660 **[Test build #111406 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/111406/testReport)** for PR

[GitHub] [spark] dongjoon-hyun commented on issue #25937: [SPARK-29256][DOCS][MINOR] Fix typo in building document

2019-09-26 Thread GitBox
dongjoon-hyun commented on issue #25937: [SPARK-29256][DOCS][MINOR] Fix typo in building document URL: https://github.com/apache/spark/pull/25937#issuecomment-535380464 Thanks. Looks correct, @TomokoKomiyama . Is this the last typo? Could you try to find more instance on that document?

[GitHub] [spark] dongjoon-hyun edited a comment on issue #25937: [SPARK-29256][DOCS] Fix typo in building document

2019-09-26 Thread GitBox
dongjoon-hyun edited a comment on issue #25937: [SPARK-29256][DOCS] Fix typo in building document URL: https://github.com/apache/spark/pull/25937#issuecomment-535380464 Thanks. Looks correct, @TomokoKomiyama . Is this the last typo? Could you try to find more instance on that document?

[GitHub] [spark] AmplabJenkins removed a comment on issue #25937: [SPARK-29256][DOCS] Fix typo in building document

2019-09-26 Thread GitBox
AmplabJenkins removed a comment on issue #25937: [SPARK-29256][DOCS] Fix typo in building document URL: https://github.com/apache/spark/pull/25937#issuecomment-535366344 Can one of the admins verify this patch? This is an

[GitHub] [spark] maropu commented on issue #25891: [SPARK-29203][SQL][TESTS] Reduce shuffle partitions in SQLQueryTestSuite

2019-09-26 Thread GitBox
maropu commented on issue #25891: [SPARK-29203][SQL][TESTS] Reduce shuffle partitions in SQLQueryTestSuite URL: https://github.com/apache/spark/pull/25891#issuecomment-535395757 Reducing the time looks super nice... This is

[GitHub] [spark] HyukjinKwon commented on issue #25939: [SPARK-27463][PYTHON] Tidy Up

2019-09-26 Thread GitBox
HyukjinKwon commented on issue #25939: [SPARK-27463][PYTHON] Tidy Up URL: https://github.com/apache/spark/pull/25939#issuecomment-535399252 add to whitelist This is an automated message from the Apache Git Service. To respond

[GitHub] [spark] TomokoKomiyama edited a comment on issue #25848: [SPARK-29172][SQL] Fix some exception issue of explain commands

2019-09-26 Thread GitBox
TomokoKomiyama edited a comment on issue #25848: [SPARK-29172][SQL] Fix some exception issue of explain commands URL: https://github.com/apache/spark/pull/25848#issuecomment-535397067 @srowen If we use 'extend', sql behave like as follows even if we have error ``` scala>

[GitHub] [spark] AmplabJenkins commented on issue #25939: [SPARK-27463][PYTHON][FOLLOW-UP] Miscellaneous documentation and code cleanup of cogroup pandas UDF

2019-09-26 Thread GitBox
AmplabJenkins commented on issue #25939: [SPARK-27463][PYTHON][FOLLOW-UP] Miscellaneous documentation and code cleanup of cogroup pandas UDF URL: https://github.com/apache/spark/pull/25939#issuecomment-535409738 Test PASSed. Refer to this link for build results (access rights to CI

[GitHub] [spark] AmplabJenkins removed a comment on issue #25941: [SPARK-29257][Core][Shuffle] Use task attempt number as noop reduce id to handle disk failures during shuffle

2019-09-26 Thread GitBox
AmplabJenkins removed a comment on issue #25941: [SPARK-29257][Core][Shuffle] Use task attempt number as noop reduce id to handle disk failures during shuffle URL: https://github.com/apache/spark/pull/25941#issuecomment-535409632 Test PASSed. Refer to this link for build results (access

[GitHub] [spark] AmplabJenkins commented on issue #25939: [SPARK-27463][PYTHON][FOLLOW-UP] Miscellaneous documentation and code cleanup of cogroup pandas UDF

2019-09-26 Thread GitBox
AmplabJenkins commented on issue #25939: [SPARK-27463][PYTHON][FOLLOW-UP] Miscellaneous documentation and code cleanup of cogroup pandas UDF URL: https://github.com/apache/spark/pull/25939#issuecomment-535409728 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins commented on issue #25941: [SPARK-29257][Core][Shuffle] Use task attempt number as noop reduce id to handle disk failures during shuffle

2019-09-26 Thread GitBox
AmplabJenkins commented on issue #25941: [SPARK-29257][Core][Shuffle] Use task attempt number as noop reduce id to handle disk failures during shuffle URL: https://github.com/apache/spark/pull/25941#issuecomment-535409632 Test PASSed. Refer to this link for build results (access rights

[GitHub] [spark] AmplabJenkins removed a comment on issue #25941: [SPARK-29257][Core][Shuffle] Use task attempt number as noop reduce id to handle disk failures during shuffle

2019-09-26 Thread GitBox
AmplabJenkins removed a comment on issue #25941: [SPARK-29257][Core][Shuffle] Use task attempt number as noop reduce id to handle disk failures during shuffle URL: https://github.com/apache/spark/pull/25941#issuecomment-535409621 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins removed a comment on issue #25939: [SPARK-27463][PYTHON][FOLLOW-UP] Miscellaneous documentation and code cleanup of cogroup pandas UDF

2019-09-26 Thread GitBox
AmplabJenkins removed a comment on issue #25939: [SPARK-27463][PYTHON][FOLLOW-UP] Miscellaneous documentation and code cleanup of cogroup pandas UDF URL: https://github.com/apache/spark/pull/25939#issuecomment-535409728 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins removed a comment on issue #25939: [SPARK-27463][PYTHON][FOLLOW-UP] Miscellaneous documentation and code cleanup of cogroup pandas UDF

2019-09-26 Thread GitBox
AmplabJenkins removed a comment on issue #25939: [SPARK-27463][PYTHON][FOLLOW-UP] Miscellaneous documentation and code cleanup of cogroup pandas UDF URL: https://github.com/apache/spark/pull/25939#issuecomment-535409738 Test PASSed. Refer to this link for build results (access rights

[GitHub] [spark] AmplabJenkins commented on issue #25941: [SPARK-29257][Core][Shuffle] Use task attempt number as noop reduce id to handle disk failures during shuffle

2019-09-26 Thread GitBox
AmplabJenkins commented on issue #25941: [SPARK-29257][Core][Shuffle] Use task attempt number as noop reduce id to handle disk failures during shuffle URL: https://github.com/apache/spark/pull/25941#issuecomment-535409621 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins removed a comment on issue #25928: [SPARK-29259][SQL] call fs.exists only when necessary

2019-09-26 Thread GitBox
AmplabJenkins removed a comment on issue #25928: [SPARK-29259][SQL] call fs.exists only when necessary URL: https://github.com/apache/spark/pull/25928#issuecomment-535415371 Merged build finished. Test PASSed. This is an

[GitHub] [spark] AmplabJenkins removed a comment on issue #25928: [SPARK-29259][SQL] call fs.exists only when necessary

2019-09-26 Thread GitBox
AmplabJenkins removed a comment on issue #25928: [SPARK-29259][SQL] call fs.exists only when necessary URL: https://github.com/apache/spark/pull/25928#issuecomment-535415379 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] SparkQA commented on issue #25933: [SPARK-29252][BUILD] Upgrade zookeeper to 3.4.14 and fix vulnerabilities.

2019-09-26 Thread GitBox
SparkQA commented on issue #25933: [SPARK-29252][BUILD] Upgrade zookeeper to 3.4.14 and fix vulnerabilities. URL: https://github.com/apache/spark/pull/25933#issuecomment-535423425 **[Test build #111418 has

[GitHub] [spark] SparkQA removed a comment on issue #25935: [SPARK-27748][SS][FOLLOWUP] Correct the order of logging token as debug log

2019-09-26 Thread GitBox
SparkQA removed a comment on issue #25935: [SPARK-27748][SS][FOLLOWUP] Correct the order of logging token as debug log URL: https://github.com/apache/spark/pull/25935#issuecomment-535375125 **[Test build #111402 has

[GitHub] [spark] AmplabJenkins removed a comment on issue #25942: [WIP][SPARK-29242][SQL][TEST] Check results of expression examples

2019-09-26 Thread GitBox
AmplabJenkins removed a comment on issue #25942: [WIP][SPARK-29242][SQL][TEST] Check results of expression examples URL: https://github.com/apache/spark/pull/25942#issuecomment-535442249 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #25942: [WIP][SPARK-29242][SQL][TEST] Check results of expression examples

2019-09-26 Thread GitBox
AmplabJenkins commented on issue #25942: [WIP][SPARK-29242][SQL][TEST] Check results of expression examples URL: https://github.com/apache/spark/pull/25942#issuecomment-535442249 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #25935: [SPARK-27748][SS][FOLLOWUP] Correct the order of logging token as debug log

2019-09-26 Thread GitBox
AmplabJenkins commented on issue #25935: [SPARK-27748][SS][FOLLOWUP] Correct the order of logging token as debug log URL: https://github.com/apache/spark/pull/25935#issuecomment-535442763 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins commented on issue #25935: [SPARK-27748][SS][FOLLOWUP] Correct the order of logging token as debug log

2019-09-26 Thread GitBox
AmplabJenkins commented on issue #25935: [SPARK-27748][SS][FOLLOWUP] Correct the order of logging token as debug log URL: https://github.com/apache/spark/pull/25935#issuecomment-535442770 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on issue #25942: [WIP][SPARK-29242][SQL][TEST] Check results of expression examples

2019-09-26 Thread GitBox
AmplabJenkins removed a comment on issue #25942: [WIP][SPARK-29242][SQL][TEST] Check results of expression examples URL: https://github.com/apache/spark/pull/25942#issuecomment-535442242 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins commented on issue #25942: [WIP][SPARK-29242][SQL][TEST] Check results of expression examples

2019-09-26 Thread GitBox
AmplabJenkins commented on issue #25942: [WIP][SPARK-29242][SQL][TEST] Check results of expression examples URL: https://github.com/apache/spark/pull/25942#issuecomment-535442242 Merged build finished. Test PASSed. This is

[GitHub] [spark] gengliangwang commented on issue #25797: [SPARK-29043][Core] Improve the concurrent performance of History Server

2019-09-26 Thread GitBox
gengliangwang commented on issue #25797: [SPARK-29043][Core] Improve the concurrent performance of History Server URL: https://github.com/apache/spark/pull/25797#issuecomment-535351079 Seems good to me. @turboFei Have you tested the changes manually?

[GitHub] [spark] SparkQA commented on issue #25902: [SPARK-29213][SQL] Make it consistent when get notnull output and generate null checks in FilterExec

2019-09-26 Thread GitBox
SparkQA commented on issue #25902: [SPARK-29213][SQL] Make it consistent when get notnull output and generate null checks in FilterExec URL: https://github.com/apache/spark/pull/25902#issuecomment-535351055 **[Test build #111393 has

[GitHub] [spark] AmplabJenkins removed a comment on issue #25771: [SPARK-28970][SQL] Implement USE CATALOG/NAMESPACE for Data Source V2

2019-09-26 Thread GitBox
AmplabJenkins removed a comment on issue #25771: [SPARK-28970][SQL] Implement USE CATALOG/NAMESPACE for Data Source V2 URL: https://github.com/apache/spark/pull/25771#issuecomment-535360081 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] TomokoKomiyama opened a new pull request #25937: [SPARK-29256][DOCS][MINOR] Fix typo in building document

2019-09-26 Thread GitBox
TomokoKomiyama opened a new pull request #25937: [SPARK-29256][DOCS][MINOR] Fix typo in building document URL: https://github.com/apache/spark/pull/25937 ### What changes were proposed in this pull request? Changed 'Phive-thriftserver' to ' -Phive-thriftserver'. ###

[GitHub] [spark] AmplabJenkins removed a comment on issue #25747: [SPARK-29039][SQL] centralize the catalog and table lookup logic

2019-09-26 Thread GitBox
AmplabJenkins removed a comment on issue #25747: [SPARK-29039][SQL] centralize the catalog and table lookup logic URL: https://github.com/apache/spark/pull/25747#issuecomment-535369526 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on issue #25889: [SPARK-29202][Deploy] Driver java options are not passed to driver process in Yarn client mode

2019-09-26 Thread GitBox
AmplabJenkins removed a comment on issue #25889: [SPARK-29202][Deploy] Driver java options are not passed to driver process in Yarn client mode URL: https://github.com/apache/spark/pull/25889#issuecomment-535369449 Test FAILed. Refer to this link for build results (access rights to CI

[GitHub] [spark] AmplabJenkins removed a comment on issue #25670: [SPARK-28869][CORE] Roll over event log files

2019-09-26 Thread GitBox
AmplabJenkins removed a comment on issue #25670: [SPARK-28869][CORE] Roll over event log files URL: https://github.com/apache/spark/pull/25670#issuecomment-535369681 Merged build finished. Test FAILed. This is an automated

[GitHub] [spark] AmplabJenkins removed a comment on issue #25849: [SPARK-29175][SQL] Make additional remote maven repository in IsolatedClientLoader configurable

2019-09-26 Thread GitBox
AmplabJenkins removed a comment on issue #25849: [SPARK-29175][SQL] Make additional remote maven repository in IsolatedClientLoader configurable URL: https://github.com/apache/spark/pull/25849#issuecomment-535369571 Test FAILed. Refer to this link for build results (access rights to CI

[GitHub] [spark] AmplabJenkins removed a comment on issue #25863: [SPARK-28945][SPARK-29037][CORE][SQL] Fix the issue that spark gives duplicate result and support concurrent file source write operati

2019-09-26 Thread GitBox
AmplabJenkins removed a comment on issue #25863: [SPARK-28945][SPARK-29037][CORE][SQL] Fix the issue that spark gives duplicate result and support concurrent file source write operations write to different partitions in the same table. URL:

[GitHub] [spark] AmplabJenkins removed a comment on issue #25935: [SPARK-27748][SS][FOLLOWUP] Correct the order of logging token as debug log

2019-09-26 Thread GitBox
AmplabJenkins removed a comment on issue #25935: [SPARK-27748][SS][FOLLOWUP] Correct the order of logging token as debug log URL: https://github.com/apache/spark/pull/25935#issuecomment-535369364 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on issue #25932: [SPARK-29250][BUILD][test-hadoop3.2][test-java11] Upgrade to Hadoop 3.2.1

2019-09-26 Thread GitBox
AmplabJenkins removed a comment on issue #25932: [SPARK-29250][BUILD][test-hadoop3.2][test-java11] Upgrade to Hadoop 3.2.1 URL: https://github.com/apache/spark/pull/25932#issuecomment-535369356 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on issue #25933: [SPARK-29252][BUILD] Upgrade zookeeper to 3.4.14 and fix vulnerabilities.

2019-09-26 Thread GitBox
AmplabJenkins removed a comment on issue #25933: [SPARK-29252][BUILD] Upgrade zookeeper to 3.4.14 and fix vulnerabilities. URL: https://github.com/apache/spark/pull/25933#issuecomment-535369362 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on issue #25697: [SPARK-28997][SQL] Add `spark.sql.dialect`

2019-09-26 Thread GitBox
AmplabJenkins removed a comment on issue #25697: [SPARK-28997][SQL] Add `spark.sql.dialect` URL: https://github.com/apache/spark/pull/25697#issuecomment-535369495 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on issue #25936: [SPARK-29255][SQL][TESTS] Rename package pgSQL to postgreSQL

2019-09-26 Thread GitBox
AmplabJenkins removed a comment on issue #25936: [SPARK-29255][SQL][TESTS] Rename package pgSQL to postgreSQL URL: https://github.com/apache/spark/pull/25936#issuecomment-535369336 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on issue #25932: [SPARK-29250][BUILD][test-hadoop3.2][test-java11] Upgrade to Hadoop 3.2.1

2019-09-26 Thread GitBox
AmplabJenkins removed a comment on issue #25932: [SPARK-29250][BUILD][test-hadoop3.2][test-java11] Upgrade to Hadoop 3.2.1 URL: https://github.com/apache/spark/pull/25932#issuecomment-535369351 Merged build finished. Test FAILed.

[GitHub] [spark] SparkQA removed a comment on issue #25670: [SPARK-28869][CORE] Roll over event log files

2019-09-26 Thread GitBox
SparkQA removed a comment on issue #25670: [SPARK-28869][CORE] Roll over event log files URL: https://github.com/apache/spark/pull/25670#issuecomment-535338400 **[Test build #111389 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/111389/testReport)** for

[GitHub] [spark] SparkQA removed a comment on issue #25747: [SPARK-29039][SQL] centralize the catalog and table lookup logic

2019-09-26 Thread GitBox
SparkQA removed a comment on issue #25747: [SPARK-29039][SQL] centralize the catalog and table lookup logic URL: https://github.com/apache/spark/pull/25747#issuecomment-535324696 **[Test build #111385 has

[GitHub] [spark] AmplabJenkins removed a comment on issue #25889: [SPARK-29202][Deploy] Driver java options are not passed to driver process in Yarn client mode

2019-09-26 Thread GitBox
AmplabJenkins removed a comment on issue #25889: [SPARK-29202][Deploy] Driver java options are not passed to driver process in Yarn client mode URL: https://github.com/apache/spark/pull/25889#issuecomment-535369444 Merged build finished. Test FAILed.

[GitHub] [spark] AmplabJenkins commented on issue #25849: [SPARK-29175][SQL] Make additional remote maven repository in IsolatedClientLoader configurable

2019-09-26 Thread GitBox
AmplabJenkins commented on issue #25849: [SPARK-29175][SQL] Make additional remote maven repository in IsolatedClientLoader configurable URL: https://github.com/apache/spark/pull/25849#issuecomment-535369562 Merged build finished. Test FAILed.

[GitHub] [spark] SparkQA removed a comment on issue #25849: [SPARK-29175][SQL] Make additional remote maven repository in IsolatedClientLoader configurable

2019-09-26 Thread GitBox
SparkQA removed a comment on issue #25849: [SPARK-29175][SQL] Make additional remote maven repository in IsolatedClientLoader configurable URL: https://github.com/apache/spark/pull/25849#issuecomment-535323202 **[Test build #111384 has

[GitHub] [spark] AmplabJenkins removed a comment on issue #25863: [SPARK-28945][SPARK-29037][CORE][SQL] Fix the issue that spark gives duplicate result and support concurrent file source write operati

2019-09-26 Thread GitBox
AmplabJenkins removed a comment on issue #25863: [SPARK-28945][SPARK-29037][CORE][SQL] Fix the issue that spark gives duplicate result and support concurrent file source write operations write to different partitions in the same table. URL:

[GitHub] [spark] AmplabJenkins removed a comment on issue #25935: [SPARK-27748][SS][FOLLOWUP] Correct the order of logging token as debug log

2019-09-26 Thread GitBox
AmplabJenkins removed a comment on issue #25935: [SPARK-27748][SS][FOLLOWUP] Correct the order of logging token as debug log URL: https://github.com/apache/spark/pull/25935#issuecomment-535360079 Can one of the admins verify this patch?

[GitHub] [spark] SparkQA removed a comment on issue #25697: [SPARK-28997][SQL] Add `spark.sql.dialect`

2019-09-26 Thread GitBox
SparkQA removed a comment on issue #25697: [SPARK-28997][SQL] Add `spark.sql.dialect` URL: https://github.com/apache/spark/pull/25697#issuecomment-535333103 **[Test build #111388 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/111388/testReport)** for PR

[GitHub] [spark] AmplabJenkins removed a comment on issue #25849: [SPARK-29175][SQL] Make additional remote maven repository in IsolatedClientLoader configurable

2019-09-26 Thread GitBox
AmplabJenkins removed a comment on issue #25849: [SPARK-29175][SQL] Make additional remote maven repository in IsolatedClientLoader configurable URL: https://github.com/apache/spark/pull/25849#issuecomment-535369562 Merged build finished. Test FAILed.

  1   2   3   4   5   6   7   8   9   10   >