[GitHub] [spark] SparkQA removed a comment on issue #25542: [SPARK-28840][SQL][test-hadoop3.2] conf.getClassLoader in SparkSQLCLIDriver should be avoided as it returns the UDFClassLoader which is crea

2019-09-10 Thread GitBox
SparkQA removed a comment on issue #25542: [SPARK-28840][SQL][test-hadoop3.2] conf.getClassLoader in SparkSQLCLIDriver should be avoided as it returns the UDFClassLoader which is created by Hive URL: https://github.com/apache/spark/pull/25542#issuecomment-530201229 **[Test build #110455

[GitHub] [spark] AmplabJenkins removed a comment on issue #25542: [SPARK-28840][SQL][test-hadoop3.2] conf.getClassLoader in SparkSQLCLIDriver should be avoided as it returns the UDFClassLoader which i

2019-09-10 Thread GitBox
AmplabJenkins removed a comment on issue #25542: [SPARK-28840][SQL][test-hadoop3.2] conf.getClassLoader in SparkSQLCLIDriver should be avoided as it returns the UDFClassLoader which is created by Hive URL: https://github.com/apache/spark/pull/25542#issuecomment-530205984 Merged build

[GitHub] [spark] AmplabJenkins commented on issue #25626: [SPARK-28892][SQL] Add UPDATE support for DataSource V2

2019-09-10 Thread GitBox
AmplabJenkins commented on issue #25626: [SPARK-28892][SQL] Add UPDATE support for DataSource V2 URL: https://github.com/apache/spark/pull/25626#issuecomment-530212773 Merged build finished. Test PASSed. This is an automated

[GitHub] [spark] imback82 commented on a change in pull request #25747: [SPARK-29039][SQL] centralize the catalog and table lookup logic

2019-09-10 Thread GitBox
imback82 commented on a change in pull request #25747: [SPARK-29039][SQL] centralize the catalog and table lookup logic URL: https://github.com/apache/spark/pull/25747#discussion_r323056338 ## File path:

[GitHub] [spark] HyukjinKwon commented on issue #25728: [SPARK-29020][SQL] Improving array_sort behaviour

2019-09-10 Thread GitBox
HyukjinKwon commented on issue #25728: [SPARK-29020][SQL] Improving array_sort behaviour URL: https://github.com/apache/spark/pull/25728#issuecomment-530219674 Add a Lambda expression for comparator instead of another column `asc` in array_sort. See `array_sort(array(T), function(T, T,

[GitHub] [spark] SparkQA commented on issue #25404: [SPARK-28683][BUILD] Upgrade Scala to 2.12.10

2019-09-10 Thread GitBox
SparkQA commented on issue #25404: [SPARK-28683][BUILD] Upgrade Scala to 2.12.10 URL: https://github.com/apache/spark/pull/25404#issuecomment-530221036 **[Test build #110459 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/110459/testReport)** for PR 25404

[GitHub] [spark] AngersZhuuuu commented on issue #25746: [WIP][SPARK-28292][SQL] Enable Injection of User-defined Hint

2019-09-10 Thread GitBox
AngersZh commented on issue #25746: [WIP][SPARK-28292][SQL] Enable Injection of User-defined Hint URL: https://github.com/apache/spark/pull/25746#issuecomment-530221208 This way will be more flexible. Thanks . This is

[GitHub] [spark] gaborgsomogyi commented on issue #25618: [SPARK-28908][SS]Implement Kafka EOS sink for Structured Streaming

2019-09-10 Thread GitBox
gaborgsomogyi commented on issue #25618: [SPARK-28908][SS]Implement Kafka EOS sink for Structured Streaming URL: https://github.com/apache/spark/pull/25618#issuecomment-529839790 I would like to hear Kafka guys opinion before we say these are the only options.

[GitHub] [spark] gengliangwang commented on issue #25716: [SPARK-29012][SQL] Support special timestamp values

2019-09-10 Thread GitBox
gengliangwang commented on issue #25716: [SPARK-29012][SQL] Support special timestamp values URL: https://github.com/apache/spark/pull/25716#issuecomment-529839604 Well, for this feature it doesn't really conflict with the current Spark behavior. I think we can proceed it. I will

[GitHub] [spark] dongjoon-hyun commented on issue #25741: [SPARK-29032][CORE] Simplify Prometheus support by adding PrometheusServlet

2019-09-10 Thread GitBox
dongjoon-hyun commented on issue #25741: [SPARK-29032][CORE] Simplify Prometheus support by adding PrometheusServlet URL: https://github.com/apache/spark/pull/25741#issuecomment-529840219 Oops. I missed the task metrics. I'll update this PR later.

[GitHub] [spark] SparkQA commented on issue #25708: [SPARK-28141][SQL] Support special date values

2019-09-10 Thread GitBox
SparkQA commented on issue #25708: [SPARK-28141][SQL] Support special date values URL: https://github.com/apache/spark/pull/25708#issuecomment-529847733 **[Test build #110409 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/110409/testReport)** for PR

[GitHub] [spark] SparkQA removed a comment on issue #25708: [SPARK-28141][SQL] Support special date values

2019-09-10 Thread GitBox
SparkQA removed a comment on issue #25708: [SPARK-28141][SQL] Support special date values URL: https://github.com/apache/spark/pull/25708#issuecomment-529816925 **[Test build #110409 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/110409/testReport)** for

[GitHub] [spark] AmplabJenkins commented on issue #25708: [SPARK-28141][SQL] Support special date values

2019-09-10 Thread GitBox
AmplabJenkins commented on issue #25708: [SPARK-28141][SQL] Support special date values URL: https://github.com/apache/spark/pull/25708#issuecomment-529847918 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] SparkQA commented on issue #22282: [SPARK-23539][SS] Add support for Kafka headers in Structured Streaming

2019-09-10 Thread GitBox
SparkQA commented on issue #22282: [SPARK-23539][SS] Add support for Kafka headers in Structured Streaming URL: https://github.com/apache/spark/pull/22282#issuecomment-529847901 **[Test build #110410 has

[GitHub] [spark] AmplabJenkins commented on issue #25708: [SPARK-28141][SQL] Support special date values

2019-09-10 Thread GitBox
AmplabJenkins commented on issue #25708: [SPARK-28141][SQL] Support special date values URL: https://github.com/apache/spark/pull/25708#issuecomment-529847910 Merged build finished. Test FAILed. This is an automated message

[GitHub] [spark] SparkQA commented on issue #25741: [WIP][SPARK-29032][CORE] Simplify Prometheus support by adding PrometheusServlet

2019-09-10 Thread GitBox
SparkQA commented on issue #25741: [WIP][SPARK-29032][CORE] Simplify Prometheus support by adding PrometheusServlet URL: https://github.com/apache/spark/pull/25741#issuecomment-529847932 **[Test build #110406 has

[GitHub] [spark] AmplabJenkins removed a comment on issue #25741: [WIP][SPARK-29032][CORE] Simplify Prometheus support by adding PrometheusServlet

2019-09-10 Thread GitBox
AmplabJenkins removed a comment on issue #25741: [WIP][SPARK-29032][CORE] Simplify Prometheus support by adding PrometheusServlet URL: https://github.com/apache/spark/pull/25741#issuecomment-529848243 Merged build finished. Test FAILed.

[GitHub] [spark] AmplabJenkins removed a comment on issue #25708: [SPARK-28141][SQL] Support special date values

2019-09-10 Thread GitBox
AmplabJenkins removed a comment on issue #25708: [SPARK-28141][SQL] Support special date values URL: https://github.com/apache/spark/pull/25708#issuecomment-529847910 Merged build finished. Test FAILed. This is an automated

[GitHub] [spark] AmplabJenkins commented on issue #25741: [WIP][SPARK-29032][CORE] Simplify Prometheus support by adding PrometheusServlet

2019-09-10 Thread GitBox
AmplabJenkins commented on issue #25741: [WIP][SPARK-29032][CORE] Simplify Prometheus support by adding PrometheusServlet URL: https://github.com/apache/spark/pull/25741#issuecomment-529848243 Merged build finished. Test FAILed.

[GitHub] [spark] AmplabJenkins commented on issue #25741: [WIP][SPARK-29032][CORE] Simplify Prometheus support by adding PrometheusServlet

2019-09-10 Thread GitBox
AmplabJenkins commented on issue #25741: [WIP][SPARK-29032][CORE] Simplify Prometheus support by adding PrometheusServlet URL: https://github.com/apache/spark/pull/25741#issuecomment-529848249 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] cloud-fan commented on issue #25601: [SPARK-28856][SQL] Implement SHOW DATABASES for Data Source V2 Tables

2019-09-10 Thread GitBox
cloud-fan commented on issue #25601: [SPARK-28856][SQL] Implement SHOW DATABASES for Data Source V2 Tables URL: https://github.com/apache/spark/pull/25601#issuecomment-529848214 retest this please This is an automated

[GitHub] [spark] AmplabJenkins removed a comment on issue #22282: [SPARK-23539][SS] Add support for Kafka headers in Structured Streaming

2019-09-10 Thread GitBox
AmplabJenkins removed a comment on issue #22282: [SPARK-23539][SS] Add support for Kafka headers in Structured Streaming URL: https://github.com/apache/spark/pull/22282#issuecomment-529848073 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins removed a comment on issue #22282: [SPARK-23539][SS] Add support for Kafka headers in Structured Streaming

2019-09-10 Thread GitBox
AmplabJenkins removed a comment on issue #22282: [SPARK-23539][SS] Add support for Kafka headers in Structured Streaming URL: https://github.com/apache/spark/pull/22282#issuecomment-529848080 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] SparkQA removed a comment on issue #25741: [WIP][SPARK-29032][CORE] Simplify Prometheus support by adding PrometheusServlet

2019-09-10 Thread GitBox
SparkQA removed a comment on issue #25741: [WIP][SPARK-29032][CORE] Simplify Prometheus support by adding PrometheusServlet URL: https://github.com/apache/spark/pull/25741#issuecomment-529811591 **[Test build #110406 has

[GitHub] [spark] SparkQA removed a comment on issue #22282: [SPARK-23539][SS] Add support for Kafka headers in Structured Streaming

2019-09-10 Thread GitBox
SparkQA removed a comment on issue #22282: [SPARK-23539][SS] Add support for Kafka headers in Structured Streaming URL: https://github.com/apache/spark/pull/22282#issuecomment-529836855 **[Test build #110410 has

[GitHub] [spark] AmplabJenkins commented on issue #22282: [SPARK-23539][SS] Add support for Kafka headers in Structured Streaming

2019-09-10 Thread GitBox
AmplabJenkins commented on issue #22282: [SPARK-23539][SS] Add support for Kafka headers in Structured Streaming URL: https://github.com/apache/spark/pull/22282#issuecomment-529848073 Merged build finished. Test PASSed. This

[GitHub] [spark] AmplabJenkins commented on issue #22282: [SPARK-23539][SS] Add support for Kafka headers in Structured Streaming

2019-09-10 Thread GitBox
AmplabJenkins commented on issue #22282: [SPARK-23539][SS] Add support for Kafka headers in Structured Streaming URL: https://github.com/apache/spark/pull/22282#issuecomment-529848080 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on issue #25741: [WIP][SPARK-29032][CORE] Simplify Prometheus support by adding PrometheusServlet

2019-09-10 Thread GitBox
AmplabJenkins removed a comment on issue #25741: [WIP][SPARK-29032][CORE] Simplify Prometheus support by adding PrometheusServlet URL: https://github.com/apache/spark/pull/25741#issuecomment-529848249 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] SparkQA commented on issue #25601: [SPARK-28856][SQL] Implement SHOW DATABASES for Data Source V2 Tables

2019-09-10 Thread GitBox
SparkQA commented on issue #25601: [SPARK-28856][SQL] Implement SHOW DATABASES for Data Source V2 Tables URL: https://github.com/apache/spark/pull/25601#issuecomment-529848603 **[Test build #110411 has

[GitHub] [spark] AmplabJenkins removed a comment on issue #25708: [SPARK-28141][SQL] Support special date values

2019-09-10 Thread GitBox
AmplabJenkins removed a comment on issue #25708: [SPARK-28141][SQL] Support special date values URL: https://github.com/apache/spark/pull/25708#issuecomment-529847918 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on issue #25601: [SPARK-28856][SQL] Implement SHOW DATABASES for Data Source V2 Tables

2019-09-10 Thread GitBox
AmplabJenkins removed a comment on issue #25601: [SPARK-28856][SQL] Implement SHOW DATABASES for Data Source V2 Tables URL: https://github.com/apache/spark/pull/25601#issuecomment-529850759 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on issue #25601: [SPARK-28856][SQL] Implement SHOW DATABASES for Data Source V2 Tables

2019-09-10 Thread GitBox
AmplabJenkins removed a comment on issue #25601: [SPARK-28856][SQL] Implement SHOW DATABASES for Data Source V2 Tables URL: https://github.com/apache/spark/pull/25601#issuecomment-529850748 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins commented on issue #25601: [SPARK-28856][SQL] Implement SHOW DATABASES for Data Source V2 Tables

2019-09-10 Thread GitBox
AmplabJenkins commented on issue #25601: [SPARK-28856][SQL] Implement SHOW DATABASES for Data Source V2 Tables URL: https://github.com/apache/spark/pull/25601#issuecomment-529850759 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #25601: [SPARK-28856][SQL] Implement SHOW DATABASES for Data Source V2 Tables

2019-09-10 Thread GitBox
AmplabJenkins commented on issue #25601: [SPARK-28856][SQL] Implement SHOW DATABASES for Data Source V2 Tables URL: https://github.com/apache/spark/pull/25601#issuecomment-529850748 Merged build finished. Test PASSed. This

[GitHub] [spark] hddong commented on issue #23952: [SPARK-26929][SQL]fix table owner use user instead of principal when create table through spark-sql or beeline

2019-09-10 Thread GitBox
hddong commented on issue #23952: [SPARK-26929][SQL]fix table owner use user instead of principal when create table through spark-sql or beeline URL: https://github.com/apache/spark/pull/23952#issuecomment-529850941 Rebased.

[GitHub] [spark] hddong removed a comment on issue #23952: [SPARK-26929][SQL]fix table owner use user instead of principal when create table through spark-sql or beeline

2019-09-10 Thread GitBox
hddong removed a comment on issue #23952: [SPARK-26929][SQL]fix table owner use user instead of principal when create table through spark-sql or beeline URL: https://github.com/apache/spark/pull/23952#issuecomment-529850941 Rebased.

[GitHub] [spark] AmplabJenkins commented on issue #23952: [SPARK-26929][SQL]fix table owner use user instead of principal when create table through spark-sql or beeline

2019-09-10 Thread GitBox
AmplabJenkins commented on issue #23952: [SPARK-26929][SQL]fix table owner use user instead of principal when create table through spark-sql or beeline URL: https://github.com/apache/spark/pull/23952#issuecomment-529853627 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins commented on issue #23952: [SPARK-26929][SQL]fix table owner use user instead of principal when create table through spark-sql or beeline

2019-09-10 Thread GitBox
AmplabJenkins commented on issue #23952: [SPARK-26929][SQL]fix table owner use user instead of principal when create table through spark-sql or beeline URL: https://github.com/apache/spark/pull/23952#issuecomment-529853639 Test PASSed. Refer to this link for build results (access rights

[GitHub] [spark] SparkQA commented on issue #23952: [SPARK-26929][SQL]fix table owner use user instead of principal when create table through spark-sql or beeline

2019-09-10 Thread GitBox
SparkQA commented on issue #23952: [SPARK-26929][SQL]fix table owner use user instead of principal when create table through spark-sql or beeline URL: https://github.com/apache/spark/pull/23952#issuecomment-529854510 **[Test build #110412 has

[GitHub] [spark] beliefer commented on a change in pull request #25740: [SPARK-28412][SQL][TEST][FOLLOW-UP]Enable overlay binary function tests

2019-09-10 Thread GitBox
beliefer commented on a change in pull request #25740: [SPARK-28412][SQL][TEST][FOLLOW-UP]Enable overlay binary function tests URL: https://github.com/apache/spark/pull/25740#discussion_r322642579 ## File path: sql/core/src/test/resources/sql-tests/inputs/pgSQL/strings.sql

[GitHub] [spark] AmplabJenkins removed a comment on issue #23952: [SPARK-26929][SQL]fix table owner use user instead of principal when create table through spark-sql or beeline

2019-09-10 Thread GitBox
AmplabJenkins removed a comment on issue #23952: [SPARK-26929][SQL]fix table owner use user instead of principal when create table through spark-sql or beeline URL: https://github.com/apache/spark/pull/23952#issuecomment-529853639 Test PASSed. Refer to this link for build results

[GitHub] [spark] AmplabJenkins removed a comment on issue #23952: [SPARK-26929][SQL]fix table owner use user instead of principal when create table through spark-sql or beeline

2019-09-10 Thread GitBox
AmplabJenkins removed a comment on issue #23952: [SPARK-26929][SQL]fix table owner use user instead of principal when create table through spark-sql or beeline URL: https://github.com/apache/spark/pull/23952#issuecomment-529853627 Merged build finished. Test PASSed.

[GitHub] [spark] juliuszsompolski commented on a change in pull request #25694: [SPARK-28982][SQL] Implementation Spark's own GetTypeInfoOperation

2019-09-10 Thread GitBox
juliuszsompolski commented on a change in pull request #25694: [SPARK-28982][SQL] Implementation Spark's own GetTypeInfoOperation URL: https://github.com/apache/spark/pull/25694#discussion_r322643818 ## File path:

[GitHub] [spark] SparkQA commented on issue #25626: [SPARK-28892][SQL] Add UPDATE support for DataSource V2

2019-09-10 Thread GitBox
SparkQA commented on issue #25626: [SPARK-28892][SQL] Add UPDATE support for DataSource V2 URL: https://github.com/apache/spark/pull/25626#issuecomment-530206549 **[Test build #110457 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/110457/testReport)** for

[GitHub] [spark] AmplabJenkins removed a comment on issue #25542: [SPARK-28840][SQL][test-hadoop3.2] conf.getClassLoader in SparkSQLCLIDriver should be avoided as it returns the UDFClassLoader which i

2019-09-10 Thread GitBox
AmplabJenkins removed a comment on issue #25542: [SPARK-28840][SQL][test-hadoop3.2] conf.getClassLoader in SparkSQLCLIDriver should be avoided as it returns the UDFClassLoader which is created by Hive URL: https://github.com/apache/spark/pull/25542#issuecomment-530205987 Test PASSed.

[GitHub] [spark] SparkQA commented on issue #25626: [SPARK-28892][SQL] Add UPDATE support for DataSource V2

2019-09-10 Thread GitBox
SparkQA commented on issue #25626: [SPARK-28892][SQL] Add UPDATE support for DataSource V2 URL: https://github.com/apache/spark/pull/25626#issuecomment-530213098 **[Test build #110458 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/110458/testReport)** for

[GitHub] [spark] AmplabJenkins removed a comment on issue #25626: [SPARK-28892][SQL] Add UPDATE support for DataSource V2

2019-09-10 Thread GitBox
AmplabJenkins removed a comment on issue #25626: [SPARK-28892][SQL] Add UPDATE support for DataSource V2 URL: https://github.com/apache/spark/pull/25626#issuecomment-530212779 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on issue #25626: [SPARK-28892][SQL] Add UPDATE support for DataSource V2

2019-09-10 Thread GitBox
AmplabJenkins removed a comment on issue #25626: [SPARK-28892][SQL] Add UPDATE support for DataSource V2 URL: https://github.com/apache/spark/pull/25626#issuecomment-530212773 Merged build finished. Test PASSed. This is an

[GitHub] [spark] AmplabJenkins commented on issue #25626: [SPARK-28892][SQL] Add UPDATE support for DataSource V2

2019-09-10 Thread GitBox
AmplabJenkins commented on issue #25626: [SPARK-28892][SQL] Add UPDATE support for DataSource V2 URL: https://github.com/apache/spark/pull/25626#issuecomment-530212779 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] wangyum opened a new pull request #25404: [SPARK-28683][BUILD] Upgrade Scala to 2.12.10

2019-09-10 Thread GitBox
wangyum opened a new pull request #25404: [SPARK-28683][BUILD] Upgrade Scala to 2.12.10 URL: https://github.com/apache/spark/pull/25404 ## What changes were proposed in this pull request? This PR upgrade Scala to **2.12.9**. Release notes: - Faster compiler: 5–10%

[GitHub] [spark] SparkQA removed a comment on issue #25705: [SPARK-29003][CORE] Fix deadlock in startup of Spark History Server

2019-09-10 Thread GitBox
SparkQA removed a comment on issue #25705: [SPARK-29003][CORE] Fix deadlock in startup of Spark History Server URL: https://github.com/apache/spark/pull/25705#issuecomment-530195322 **[Test build #110452 has

[GitHub] [spark] SparkQA commented on issue #25705: [SPARK-29003][CORE] Fix deadlock in startup of Spark History Server

2019-09-10 Thread GitBox
SparkQA commented on issue #25705: [SPARK-29003][CORE] Fix deadlock in startup of Spark History Server URL: https://github.com/apache/spark/pull/25705#issuecomment-530220194 **[Test build #110452 has

[GitHub] [spark] HeartSaVioR commented on issue #25705: [SPARK-29003][CORE] Fix deadlock in startup of Spark History Server

2019-09-10 Thread GitBox
HeartSaVioR commented on issue #25705: [SPARK-29003][CORE] Fix deadlock in startup of Spark History Server URL: https://github.com/apache/spark/pull/25705#issuecomment-530223614 > start() just waits for safe mode exit and for this suite of tests it is irrelevant. No. There're some

[GitHub] [spark] AngersZhuuuu edited a comment on issue #25746: [WIP][SPARK-28292][SQL] Enable Injection of User-defined Hint

2019-09-10 Thread GitBox
AngersZh edited a comment on issue #25746: [WIP][SPARK-28292][SQL] Enable Injection of User-defined Hint URL: https://github.com/apache/spark/pull/25746#issuecomment-530221208 This way will be more flexible. Thanks . may be we still need to RemoveAllHint before Optimizer.

[GitHub] [spark] wangyum commented on issue #25404: [SPARK-28683][BUILD] Upgrade Scala to 2.12.10

2019-09-10 Thread GitBox
wangyum commented on issue #25404: [SPARK-28683][BUILD] Upgrade Scala to 2.12.10 URL: https://github.com/apache/spark/pull/25404#issuecomment-530223479 ``` sbt.ResolveException: unresolved dependency: com.typesafe.genjavadoc#genjavadoc-plugin_2.12.10;0.13: not found at

[GitHub] [spark] SparkQA commented on issue #25709: [SPARK-29007][STREAMING][MLLIB][TESTS] Enforce not leaking SparkContext in tests which creates new StreamingContext with new SparkContext

2019-09-10 Thread GitBox
SparkQA commented on issue #25709: [SPARK-29007][STREAMING][MLLIB][TESTS] Enforce not leaking SparkContext in tests which creates new StreamingContext with new SparkContext URL: https://github.com/apache/spark/pull/25709#issuecomment-530225717 **[Test build #110460 has

[GitHub] [spark] AmplabJenkins commented on issue #25542: [SPARK-28840][SQL][test-hadoop3.2] conf.getClassLoader in SparkSQLCLIDriver should be avoided as it returns the UDFClassLoader which is create

2019-09-10 Thread GitBox
AmplabJenkins commented on issue #25542: [SPARK-28840][SQL][test-hadoop3.2] conf.getClassLoader in SparkSQLCLIDriver should be avoided as it returns the UDFClassLoader which is created by Hive URL: https://github.com/apache/spark/pull/25542#issuecomment-530205984 Merged build finished.

[GitHub] [spark] AmplabJenkins commented on issue #25542: [SPARK-28840][SQL][test-hadoop3.2] conf.getClassLoader in SparkSQLCLIDriver should be avoided as it returns the UDFClassLoader which is create

2019-09-10 Thread GitBox
AmplabJenkins commented on issue #25542: [SPARK-28840][SQL][test-hadoop3.2] conf.getClassLoader in SparkSQLCLIDriver should be avoided as it returns the UDFClassLoader which is created by Hive URL: https://github.com/apache/spark/pull/25542#issuecomment-530205987 Test PASSed. Refer to

[GitHub] [spark] SparkQA commented on issue #25542: [SPARK-28840][SQL][test-hadoop3.2] conf.getClassLoader in SparkSQLCLIDriver should be avoided as it returns the UDFClassLoader which is created by H

2019-09-10 Thread GitBox
SparkQA commented on issue #25542: [SPARK-28840][SQL][test-hadoop3.2] conf.getClassLoader in SparkSQLCLIDriver should be avoided as it returns the UDFClassLoader which is created by Hive URL: https://github.com/apache/spark/pull/25542#issuecomment-530205919 **[Test build #110455 has

[GitHub] [spark] AmplabJenkins commented on issue #25705: [SPARK-29003][CORE] Fix deadlock in startup of Spark History Server

2019-09-10 Thread GitBox
AmplabJenkins commented on issue #25705: [SPARK-29003][CORE] Fix deadlock in startup of Spark History Server URL: https://github.com/apache/spark/pull/25705#issuecomment-530220526 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #25705: [SPARK-29003][CORE] Fix deadlock in startup of Spark History Server

2019-09-10 Thread GitBox
AmplabJenkins commented on issue #25705: [SPARK-29003][CORE] Fix deadlock in startup of Spark History Server URL: https://github.com/apache/spark/pull/25705#issuecomment-530220521 Merged build finished. Test PASSed. This is

[GitHub] [spark] AmplabJenkins removed a comment on issue #25705: [SPARK-29003][CORE] Fix deadlock in startup of Spark History Server

2019-09-10 Thread GitBox
AmplabJenkins removed a comment on issue #25705: [SPARK-29003][CORE] Fix deadlock in startup of Spark History Server URL: https://github.com/apache/spark/pull/25705#issuecomment-530220526 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #25404: [SPARK-28683][BUILD] Upgrade Scala to 2.12.10

2019-09-10 Thread GitBox
AmplabJenkins commented on issue #25404: [SPARK-28683][BUILD] Upgrade Scala to 2.12.10 URL: https://github.com/apache/spark/pull/25404#issuecomment-530220681 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #25404: [SPARK-28683][BUILD] Upgrade Scala to 2.12.10

2019-09-10 Thread GitBox
AmplabJenkins commented on issue #25404: [SPARK-28683][BUILD] Upgrade Scala to 2.12.10 URL: https://github.com/apache/spark/pull/25404#issuecomment-530220676 Merged build finished. Test PASSed. This is an automated message

[GitHub] [spark] AmplabJenkins removed a comment on issue #25705: [SPARK-29003][CORE] Fix deadlock in startup of Spark History Server

2019-09-10 Thread GitBox
AmplabJenkins removed a comment on issue #25705: [SPARK-29003][CORE] Fix deadlock in startup of Spark History Server URL: https://github.com/apache/spark/pull/25705#issuecomment-530220521 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins removed a comment on issue #25404: [SPARK-28683][BUILD] Upgrade Scala to 2.12.10

2019-09-10 Thread GitBox
AmplabJenkins removed a comment on issue #25404: [SPARK-28683][BUILD] Upgrade Scala to 2.12.10 URL: https://github.com/apache/spark/pull/25404#issuecomment-530220676 Merged build finished. Test PASSed. This is an automated

[GitHub] [spark] AmplabJenkins removed a comment on issue #25404: [SPARK-28683][BUILD] Upgrade Scala to 2.12.10

2019-09-10 Thread GitBox
AmplabJenkins removed a comment on issue #25404: [SPARK-28683][BUILD] Upgrade Scala to 2.12.10 URL: https://github.com/apache/spark/pull/25404#issuecomment-530220681 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] holdenk commented on a change in pull request #25748: [SPARK-28904][KUBERNETES] Create mount for PvTestSuire

2019-09-10 Thread GitBox
holdenk commented on a change in pull request #25748: [SPARK-28904][KUBERNETES] Create mount for PvTestSuire URL: https://github.com/apache/spark/pull/25748#discussion_r323062064 ## File path:

[GitHub] [spark] SparkQA removed a comment on issue #25751: [SPARK-29042][Core] Sampling-based RDD with unordered input should be INDETERMINATE

2019-09-10 Thread GitBox
SparkQA removed a comment on issue #25751: [SPARK-29042][Core] Sampling-based RDD with unordered input should be INDETERMINATE URL: https://github.com/apache/spark/pull/25751#issuecomment-530199730 **[Test build #110454 has

[GitHub] [spark] HeartSaVioR commented on issue #25709: [SPARK-29007][STREAMING][MLLIB][TESTS] Enforce not leaking SparkContext in tests which creates new StreamingContext with new SparkContext

2019-09-10 Thread GitBox
HeartSaVioR commented on issue #25709: [SPARK-29007][STREAMING][MLLIB][TESTS] Enforce not leaking SparkContext in tests which creates new StreamingContext with new SparkContext URL: https://github.com/apache/spark/pull/25709#issuecomment-530224431 Failed tests:

[GitHub] [spark] HeartSaVioR commented on issue #25709: [SPARK-29007][STREAMING][MLLIB][TESTS] Enforce not leaking SparkContext in tests which creates new StreamingContext with new SparkContext

2019-09-10 Thread GitBox
HeartSaVioR commented on issue #25709: [SPARK-29007][STREAMING][MLLIB][TESTS] Enforce not leaking SparkContext in tests which creates new StreamingContext with new SparkContext URL: https://github.com/apache/spark/pull/25709#issuecomment-530224460 retest this, please

[GitHub] [spark] AmplabJenkins commented on issue #25751: [SPARK-29042][Core] Sampling-based RDD with unordered input should be INDETERMINATE

2019-09-10 Thread GitBox
AmplabJenkins commented on issue #25751: [SPARK-29042][Core] Sampling-based RDD with unordered input should be INDETERMINATE URL: https://github.com/apache/spark/pull/25751#issuecomment-530224562 Merged build finished. Test PASSed.

[GitHub] [spark] HeartSaVioR edited a comment on issue #25709: [SPARK-29007][STREAMING][MLLIB][TESTS] Enforce not leaking SparkContext in tests which creates new StreamingContext with new SparkContext

2019-09-10 Thread GitBox
HeartSaVioR edited a comment on issue #25709: [SPARK-29007][STREAMING][MLLIB][TESTS] Enforce not leaking SparkContext in tests which creates new StreamingContext with new SparkContext URL: https://github.com/apache/spark/pull/25709#issuecomment-530224431 Failed tests:

[GitHub] [spark] AmplabJenkins commented on issue #25626: [SPARK-28892][SQL] Add UPDATE support for DataSource V2

2019-09-10 Thread GitBox
AmplabJenkins commented on issue #25626: [SPARK-28892][SQL] Add UPDATE support for DataSource V2 URL: https://github.com/apache/spark/pull/25626#issuecomment-530207511 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #25626: [SPARK-28892][SQL] Add UPDATE support for DataSource V2

2019-09-10 Thread GitBox
AmplabJenkins commented on issue #25626: [SPARK-28892][SQL] Add UPDATE support for DataSource V2 URL: https://github.com/apache/spark/pull/25626#issuecomment-530207509 Merged build finished. Test PASSed. This is an automated

[GitHub] [spark] AmplabJenkins removed a comment on issue #25626: [SPARK-28892][SQL] Add UPDATE support for DataSource V2

2019-09-10 Thread GitBox
AmplabJenkins removed a comment on issue #25626: [SPARK-28892][SQL] Add UPDATE support for DataSource V2 URL: https://github.com/apache/spark/pull/25626#issuecomment-530207511 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on issue #25626: [SPARK-28892][SQL] Add UPDATE support for DataSource V2

2019-09-10 Thread GitBox
AmplabJenkins removed a comment on issue #25626: [SPARK-28892][SQL] Add UPDATE support for DataSource V2 URL: https://github.com/apache/spark/pull/25626#issuecomment-530207509 Merged build finished. Test PASSed. This is an

[GitHub] [spark] SparkQA commented on issue #22282: [SPARK-23539][SS] Add support for Kafka headers in Structured Streaming

2019-09-10 Thread GitBox
SparkQA commented on issue #22282: [SPARK-23539][SS] Add support for Kafka headers in Structured Streaming URL: https://github.com/apache/spark/pull/22282#issuecomment-530209301 **[Test build #110456 has

[GitHub] [spark] AmplabJenkins commented on issue #22282: [SPARK-23539][SS] Add support for Kafka headers in Structured Streaming

2019-09-10 Thread GitBox
AmplabJenkins commented on issue #22282: [SPARK-23539][SS] Add support for Kafka headers in Structured Streaming URL: https://github.com/apache/spark/pull/22282#issuecomment-530209375 Merged build finished. Test PASSed. This

[GitHub] [spark] cloud-fan commented on issue #25295: [SPARK-28560][SQL] Optimize shuffle reader to local shuffle reader when smj converted to bhj in adaptive execution

2019-09-10 Thread GitBox
cloud-fan commented on issue #25295: [SPARK-28560][SQL] Optimize shuffle reader to local shuffle reader when smj converted to bhj in adaptive execution URL: https://github.com/apache/spark/pull/25295#issuecomment-530222762 Should this be a general optimization? When a reduce task needs to

[GitHub] [spark] AmplabJenkins commented on issue #25751: [SPARK-29042][Core] Sampling-based RDD with unordered input should be INDETERMINATE

2019-09-10 Thread GitBox
AmplabJenkins commented on issue #25751: [SPARK-29042][Core] Sampling-based RDD with unordered input should be INDETERMINATE URL: https://github.com/apache/spark/pull/25751#issuecomment-530224565 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on issue #25751: [SPARK-29042][Core] Sampling-based RDD with unordered input should be INDETERMINATE

2019-09-10 Thread GitBox
AmplabJenkins removed a comment on issue #25751: [SPARK-29042][Core] Sampling-based RDD with unordered input should be INDETERMINATE URL: https://github.com/apache/spark/pull/25751#issuecomment-530224562 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins removed a comment on issue #25751: [SPARK-29042][Core] Sampling-based RDD with unordered input should be INDETERMINATE

2019-09-10 Thread GitBox
AmplabJenkins removed a comment on issue #25751: [SPARK-29042][Core] Sampling-based RDD with unordered input should be INDETERMINATE URL: https://github.com/apache/spark/pull/25751#issuecomment-530224565 Test PASSed. Refer to this link for build results (access rights to CI server

[GitHub] [spark] Gschiavon commented on issue #25728: [SPARK-29020][SQL] Improving array_sort behaviour

2019-09-10 Thread GitBox
Gschiavon commented on issue #25728: [SPARK-29020][SQL] Improving array_sort behaviour URL: https://github.com/apache/spark/pull/25728#issuecomment-530207202 How does it translate for this PR @ueshin ? This is an automated

[GitHub] [spark] AmplabJenkins commented on issue #22282: [SPARK-23539][SS] Add support for Kafka headers in Structured Streaming

2019-09-10 Thread GitBox
AmplabJenkins commented on issue #22282: [SPARK-23539][SS] Add support for Kafka headers in Structured Streaming URL: https://github.com/apache/spark/pull/22282#issuecomment-530209376 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on issue #22282: [SPARK-23539][SS] Add support for Kafka headers in Structured Streaming

2019-09-10 Thread GitBox
AmplabJenkins removed a comment on issue #22282: [SPARK-23539][SS] Add support for Kafka headers in Structured Streaming URL: https://github.com/apache/spark/pull/22282#issuecomment-530209375 Merged build finished. Test PASSed.

[GitHub] [spark] SparkQA removed a comment on issue #22282: [SPARK-23539][SS] Add support for Kafka headers in Structured Streaming

2019-09-10 Thread GitBox
SparkQA removed a comment on issue #22282: [SPARK-23539][SS] Add support for Kafka headers in Structured Streaming URL: https://github.com/apache/spark/pull/22282#issuecomment-530203905 **[Test build #110456 has

[GitHub] [spark] AmplabJenkins removed a comment on issue #22282: [SPARK-23539][SS] Add support for Kafka headers in Structured Streaming

2019-09-10 Thread GitBox
AmplabJenkins removed a comment on issue #22282: [SPARK-23539][SS] Add support for Kafka headers in Structured Streaming URL: https://github.com/apache/spark/pull/22282#issuecomment-530209376 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] gengliangwang commented on a change in pull request #25723: [SPARK-29019][WebUI] Improve tooltip JDBC/ODBC Server tab

2019-09-10 Thread GitBox
gengliangwang commented on a change in pull request #25723: [SPARK-29019][WebUI] Improve tooltip JDBC/ODBC Server tab URL: https://github.com/apache/spark/pull/25723#discussion_r323057115 ## File path: core/src/main/scala/org/apache/spark/ui/UIUtils.scala ## @@ -311,7

[GitHub] [spark] shanyu edited a comment on issue #25705: [SPARK-29003][CORE] Fix deadlock in startup of Spark History Server

2019-09-10 Thread GitBox
shanyu edited a comment on issue #25705: [SPARK-29003][CORE] Fix deadlock in startup of Spark History Server URL: https://github.com/apache/spark/pull/25705#issuecomment-530219153 > What I'm concerned about is the change would also make tests skip initializing. If the test calls

[GitHub] [spark] shanyu commented on issue #25705: [SPARK-29003][CORE] Fix deadlock in startup of Spark History Server

2019-09-10 Thread GitBox
shanyu commented on issue #25705: [SPARK-29003][CORE] Fix deadlock in startup of Spark History Server URL: https://github.com/apache/spark/pull/25705#issuecomment-530219153 > What I'm concerned about is the change would also make tests skip initializing. If the test calls

[GitHub] [spark] SparkQA removed a comment on issue #25404: [SPARK-28683][BUILD] Upgrade Scala to 2.12.10

2019-09-10 Thread GitBox
SparkQA removed a comment on issue #25404: [SPARK-28683][BUILD] Upgrade Scala to 2.12.10 URL: https://github.com/apache/spark/pull/25404#issuecomment-530221036 **[Test build #110459 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/110459/testReport)** for

[GitHub] [spark] AmplabJenkins commented on issue #25404: [SPARK-28683][BUILD] Upgrade Scala to 2.12.10

2019-09-10 Thread GitBox
AmplabJenkins commented on issue #25404: [SPARK-28683][BUILD] Upgrade Scala to 2.12.10 URL: https://github.com/apache/spark/pull/25404#issuecomment-530221730 Merged build finished. Test FAILed. This is an automated message

[GitHub] [spark] AmplabJenkins commented on issue #25404: [SPARK-28683][BUILD] Upgrade Scala to 2.12.10

2019-09-10 Thread GitBox
AmplabJenkins commented on issue #25404: [SPARK-28683][BUILD] Upgrade Scala to 2.12.10 URL: https://github.com/apache/spark/pull/25404#issuecomment-530221733 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] SparkQA commented on issue #25404: [SPARK-28683][BUILD] Upgrade Scala to 2.12.10

2019-09-10 Thread GitBox
SparkQA commented on issue #25404: [SPARK-28683][BUILD] Upgrade Scala to 2.12.10 URL: https://github.com/apache/spark/pull/25404#issuecomment-530221725 **[Test build #110459 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/110459/testReport)** for PR 25404

[GitHub] [spark] AmplabJenkins removed a comment on issue #25404: [SPARK-28683][BUILD] Upgrade Scala to 2.12.10

2019-09-10 Thread GitBox
AmplabJenkins removed a comment on issue #25404: [SPARK-28683][BUILD] Upgrade Scala to 2.12.10 URL: https://github.com/apache/spark/pull/25404#issuecomment-530221730 Merged build finished. Test FAILed. This is an automated

[GitHub] [spark] AmplabJenkins removed a comment on issue #25404: [SPARK-28683][BUILD] Upgrade Scala to 2.12.10

2019-09-10 Thread GitBox
AmplabJenkins removed a comment on issue #25404: [SPARK-28683][BUILD] Upgrade Scala to 2.12.10 URL: https://github.com/apache/spark/pull/25404#issuecomment-530221733 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] HeartSaVioR edited a comment on issue #25705: [SPARK-29003][CORE] Fix deadlock in startup of Spark History Server

2019-09-10 Thread GitBox
HeartSaVioR edited a comment on issue #25705: [SPARK-29003][CORE] Fix deadlock in startup of Spark History Server URL: https://github.com/apache/spark/pull/25705#issuecomment-530223614 > start() just waits for safe mode exit and for this suite of tests it is irrelevant. No.

[GitHub] [spark] SparkQA commented on issue #25751: [SPARK-29042][Core] Sampling-based RDD with unordered input should be INDETERMINATE

2019-09-10 Thread GitBox
SparkQA commented on issue #25751: [SPARK-29042][Core] Sampling-based RDD with unordered input should be INDETERMINATE URL: https://github.com/apache/spark/pull/25751#issuecomment-530224099 **[Test build #110454 has

[GitHub] [spark] HeartSaVioR commented on a change in pull request #23952: [SPARK-26929][SQL]fix table owner use user instead of principal when create table through spark-sql or beeline

2019-09-10 Thread GitBox
HeartSaVioR commented on a change in pull request #23952: [SPARK-26929][SQL]fix table owner use user instead of principal when create table through spark-sql or beeline URL: https://github.com/apache/spark/pull/23952#discussion_r322649305 ## File path:

  1   2   3   4   5   6   7   8   9   10   >