[GitHub] [spark] HeartSaVioR edited a comment on issue #25709: [SPARK-29007][STREAMING][MLLIB][TESTS] Enforce not leaking SparkContext in tests which creates new StreamingContext with new SparkContext

2019-09-10 Thread GitBox
HeartSaVioR edited a comment on issue #25709: [SPARK-29007][STREAMING][MLLIB][TESTS] Enforce not leaking SparkContext in tests which creates new StreamingContext with new SparkContext URL: https://github.com/apache/spark/pull/25709#issuecomment-530224431 Failed tests:

[GitHub] [spark] SparkQA commented on issue #25709: [SPARK-29007][STREAMING][MLLIB][TESTS] Enforce not leaking SparkContext in tests which creates new StreamingContext with new SparkContext

2019-09-10 Thread GitBox
SparkQA commented on issue #25709: [SPARK-29007][STREAMING][MLLIB][TESTS] Enforce not leaking SparkContext in tests which creates new StreamingContext with new SparkContext URL: https://github.com/apache/spark/pull/25709#issuecomment-530225717 **[Test build #110460 has

[GitHub] [spark] AmplabJenkins removed a comment on issue #25751: [SPARK-29042][Core] Sampling-based RDD with unordered input should be INDETERMINATE

2019-09-10 Thread GitBox
AmplabJenkins removed a comment on issue #25751: [SPARK-29042][Core] Sampling-based RDD with unordered input should be INDETERMINATE URL: https://github.com/apache/spark/pull/25751#issuecomment-530224562 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins removed a comment on issue #25751: [SPARK-29042][Core] Sampling-based RDD with unordered input should be INDETERMINATE

2019-09-10 Thread GitBox
AmplabJenkins removed a comment on issue #25751: [SPARK-29042][Core] Sampling-based RDD with unordered input should be INDETERMINATE URL: https://github.com/apache/spark/pull/25751#issuecomment-530224565 Test PASSed. Refer to this link for build results (access rights to CI server

[GitHub] [spark] AmplabJenkins commented on issue #25751: [SPARK-29042][Core] Sampling-based RDD with unordered input should be INDETERMINATE

2019-09-10 Thread GitBox
AmplabJenkins commented on issue #25751: [SPARK-29042][Core] Sampling-based RDD with unordered input should be INDETERMINATE URL: https://github.com/apache/spark/pull/25751#issuecomment-530224562 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins commented on issue #25751: [SPARK-29042][Core] Sampling-based RDD with unordered input should be INDETERMINATE

2019-09-10 Thread GitBox
AmplabJenkins commented on issue #25751: [SPARK-29042][Core] Sampling-based RDD with unordered input should be INDETERMINATE URL: https://github.com/apache/spark/pull/25751#issuecomment-530224565 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] SparkQA removed a comment on issue #25751: [SPARK-29042][Core] Sampling-based RDD with unordered input should be INDETERMINATE

2019-09-10 Thread GitBox
SparkQA removed a comment on issue #25751: [SPARK-29042][Core] Sampling-based RDD with unordered input should be INDETERMINATE URL: https://github.com/apache/spark/pull/25751#issuecomment-530199730 **[Test build #110454 has

[GitHub] [spark] HeartSaVioR commented on issue #25709: [SPARK-29007][STREAMING][MLLIB][TESTS] Enforce not leaking SparkContext in tests which creates new StreamingContext with new SparkContext

2019-09-10 Thread GitBox
HeartSaVioR commented on issue #25709: [SPARK-29007][STREAMING][MLLIB][TESTS] Enforce not leaking SparkContext in tests which creates new StreamingContext with new SparkContext URL: https://github.com/apache/spark/pull/25709#issuecomment-530224431 Failed tests:

[GitHub] [spark] HeartSaVioR commented on issue #25709: [SPARK-29007][STREAMING][MLLIB][TESTS] Enforce not leaking SparkContext in tests which creates new StreamingContext with new SparkContext

2019-09-10 Thread GitBox
HeartSaVioR commented on issue #25709: [SPARK-29007][STREAMING][MLLIB][TESTS] Enforce not leaking SparkContext in tests which creates new StreamingContext with new SparkContext URL: https://github.com/apache/spark/pull/25709#issuecomment-530224460 retest this, please

[GitHub] [spark] SparkQA commented on issue #25751: [SPARK-29042][Core] Sampling-based RDD with unordered input should be INDETERMINATE

2019-09-10 Thread GitBox
SparkQA commented on issue #25751: [SPARK-29042][Core] Sampling-based RDD with unordered input should be INDETERMINATE URL: https://github.com/apache/spark/pull/25751#issuecomment-530224099 **[Test build #110454 has

[GitHub] [spark] HeartSaVioR edited a comment on issue #25705: [SPARK-29003][CORE] Fix deadlock in startup of Spark History Server

2019-09-10 Thread GitBox
HeartSaVioR edited a comment on issue #25705: [SPARK-29003][CORE] Fix deadlock in startup of Spark History Server URL: https://github.com/apache/spark/pull/25705#issuecomment-530223614 > start() just waits for safe mode exit and for this suite of tests it is irrelevant. No.

[GitHub] [spark] HeartSaVioR commented on issue #25705: [SPARK-29003][CORE] Fix deadlock in startup of Spark History Server

2019-09-10 Thread GitBox
HeartSaVioR commented on issue #25705: [SPARK-29003][CORE] Fix deadlock in startup of Spark History Server URL: https://github.com/apache/spark/pull/25705#issuecomment-530223614 > start() just waits for safe mode exit and for this suite of tests it is irrelevant. No. There're some

[GitHub] [spark] AngersZhuuuu edited a comment on issue #25746: [WIP][SPARK-28292][SQL] Enable Injection of User-defined Hint

2019-09-10 Thread GitBox
AngersZh edited a comment on issue #25746: [WIP][SPARK-28292][SQL] Enable Injection of User-defined Hint URL: https://github.com/apache/spark/pull/25746#issuecomment-530221208 This way will be more flexible. Thanks . may be we still need to RemoveAllHint before Optimizer.

[GitHub] [spark] wangyum commented on issue #25404: [SPARK-28683][BUILD] Upgrade Scala to 2.12.10

2019-09-10 Thread GitBox
wangyum commented on issue #25404: [SPARK-28683][BUILD] Upgrade Scala to 2.12.10 URL: https://github.com/apache/spark/pull/25404#issuecomment-530223479 ``` sbt.ResolveException: unresolved dependency: com.typesafe.genjavadoc#genjavadoc-plugin_2.12.10;0.13: not found at

[GitHub] [spark] holdenk commented on a change in pull request #25748: [SPARK-28904][KUBERNETES] Create mount for PvTestSuire

2019-09-10 Thread GitBox
holdenk commented on a change in pull request #25748: [SPARK-28904][KUBERNETES] Create mount for PvTestSuire URL: https://github.com/apache/spark/pull/25748#discussion_r323062064 ## File path:

[GitHub] [spark] cloud-fan commented on issue #25295: [SPARK-28560][SQL] Optimize shuffle reader to local shuffle reader when smj converted to bhj in adaptive execution

2019-09-10 Thread GitBox
cloud-fan commented on issue #25295: [SPARK-28560][SQL] Optimize shuffle reader to local shuffle reader when smj converted to bhj in adaptive execution URL: https://github.com/apache/spark/pull/25295#issuecomment-530222762 Should this be a general optimization? When a reduce task needs to

[GitHub] [spark] AmplabJenkins removed a comment on issue #25404: [SPARK-28683][BUILD] Upgrade Scala to 2.12.10

2019-09-10 Thread GitBox
AmplabJenkins removed a comment on issue #25404: [SPARK-28683][BUILD] Upgrade Scala to 2.12.10 URL: https://github.com/apache/spark/pull/25404#issuecomment-530221733 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #25404: [SPARK-28683][BUILD] Upgrade Scala to 2.12.10

2019-09-10 Thread GitBox
AmplabJenkins commented on issue #25404: [SPARK-28683][BUILD] Upgrade Scala to 2.12.10 URL: https://github.com/apache/spark/pull/25404#issuecomment-530221730 Merged build finished. Test FAILed. This is an automated message

[GitHub] [spark] AmplabJenkins commented on issue #25404: [SPARK-28683][BUILD] Upgrade Scala to 2.12.10

2019-09-10 Thread GitBox
AmplabJenkins commented on issue #25404: [SPARK-28683][BUILD] Upgrade Scala to 2.12.10 URL: https://github.com/apache/spark/pull/25404#issuecomment-530221733 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] SparkQA commented on issue #25404: [SPARK-28683][BUILD] Upgrade Scala to 2.12.10

2019-09-10 Thread GitBox
SparkQA commented on issue #25404: [SPARK-28683][BUILD] Upgrade Scala to 2.12.10 URL: https://github.com/apache/spark/pull/25404#issuecomment-530221725 **[Test build #110459 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/110459/testReport)** for PR 25404

[GitHub] [spark] AmplabJenkins removed a comment on issue #25404: [SPARK-28683][BUILD] Upgrade Scala to 2.12.10

2019-09-10 Thread GitBox
AmplabJenkins removed a comment on issue #25404: [SPARK-28683][BUILD] Upgrade Scala to 2.12.10 URL: https://github.com/apache/spark/pull/25404#issuecomment-530221730 Merged build finished. Test FAILed. This is an automated

[GitHub] [spark] SparkQA removed a comment on issue #25404: [SPARK-28683][BUILD] Upgrade Scala to 2.12.10

2019-09-10 Thread GitBox
SparkQA removed a comment on issue #25404: [SPARK-28683][BUILD] Upgrade Scala to 2.12.10 URL: https://github.com/apache/spark/pull/25404#issuecomment-530221036 **[Test build #110459 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/110459/testReport)** for

[GitHub] [spark] AngersZhuuuu commented on issue #25746: [WIP][SPARK-28292][SQL] Enable Injection of User-defined Hint

2019-09-10 Thread GitBox
AngersZh commented on issue #25746: [WIP][SPARK-28292][SQL] Enable Injection of User-defined Hint URL: https://github.com/apache/spark/pull/25746#issuecomment-530221208 This way will be more flexible. Thanks . This is

[GitHub] [spark] SparkQA commented on issue #25404: [SPARK-28683][BUILD] Upgrade Scala to 2.12.10

2019-09-10 Thread GitBox
SparkQA commented on issue #25404: [SPARK-28683][BUILD] Upgrade Scala to 2.12.10 URL: https://github.com/apache/spark/pull/25404#issuecomment-530221036 **[Test build #110459 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/110459/testReport)** for PR 25404

[GitHub] [spark] AmplabJenkins removed a comment on issue #25404: [SPARK-28683][BUILD] Upgrade Scala to 2.12.10

2019-09-10 Thread GitBox
AmplabJenkins removed a comment on issue #25404: [SPARK-28683][BUILD] Upgrade Scala to 2.12.10 URL: https://github.com/apache/spark/pull/25404#issuecomment-530220676 Merged build finished. Test PASSed. This is an automated

[GitHub] [spark] AmplabJenkins removed a comment on issue #25404: [SPARK-28683][BUILD] Upgrade Scala to 2.12.10

2019-09-10 Thread GitBox
AmplabJenkins removed a comment on issue #25404: [SPARK-28683][BUILD] Upgrade Scala to 2.12.10 URL: https://github.com/apache/spark/pull/25404#issuecomment-530220681 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on issue #25705: [SPARK-29003][CORE] Fix deadlock in startup of Spark History Server

2019-09-10 Thread GitBox
AmplabJenkins removed a comment on issue #25705: [SPARK-29003][CORE] Fix deadlock in startup of Spark History Server URL: https://github.com/apache/spark/pull/25705#issuecomment-530220526 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #25404: [SPARK-28683][BUILD] Upgrade Scala to 2.12.10

2019-09-10 Thread GitBox
AmplabJenkins commented on issue #25404: [SPARK-28683][BUILD] Upgrade Scala to 2.12.10 URL: https://github.com/apache/spark/pull/25404#issuecomment-530220681 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #25404: [SPARK-28683][BUILD] Upgrade Scala to 2.12.10

2019-09-10 Thread GitBox
AmplabJenkins commented on issue #25404: [SPARK-28683][BUILD] Upgrade Scala to 2.12.10 URL: https://github.com/apache/spark/pull/25404#issuecomment-530220676 Merged build finished. Test PASSed. This is an automated message

[GitHub] [spark] AmplabJenkins removed a comment on issue #25705: [SPARK-29003][CORE] Fix deadlock in startup of Spark History Server

2019-09-10 Thread GitBox
AmplabJenkins removed a comment on issue #25705: [SPARK-29003][CORE] Fix deadlock in startup of Spark History Server URL: https://github.com/apache/spark/pull/25705#issuecomment-530220521 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins commented on issue #25705: [SPARK-29003][CORE] Fix deadlock in startup of Spark History Server

2019-09-10 Thread GitBox
AmplabJenkins commented on issue #25705: [SPARK-29003][CORE] Fix deadlock in startup of Spark History Server URL: https://github.com/apache/spark/pull/25705#issuecomment-530220526 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #25705: [SPARK-29003][CORE] Fix deadlock in startup of Spark History Server

2019-09-10 Thread GitBox
AmplabJenkins commented on issue #25705: [SPARK-29003][CORE] Fix deadlock in startup of Spark History Server URL: https://github.com/apache/spark/pull/25705#issuecomment-530220521 Merged build finished. Test PASSed. This is

[GitHub] [spark] SparkQA removed a comment on issue #25705: [SPARK-29003][CORE] Fix deadlock in startup of Spark History Server

2019-09-10 Thread GitBox
SparkQA removed a comment on issue #25705: [SPARK-29003][CORE] Fix deadlock in startup of Spark History Server URL: https://github.com/apache/spark/pull/25705#issuecomment-530195322 **[Test build #110452 has

[GitHub] [spark] SparkQA commented on issue #25705: [SPARK-29003][CORE] Fix deadlock in startup of Spark History Server

2019-09-10 Thread GitBox
SparkQA commented on issue #25705: [SPARK-29003][CORE] Fix deadlock in startup of Spark History Server URL: https://github.com/apache/spark/pull/25705#issuecomment-530220194 **[Test build #110452 has

[GitHub] [spark] wangyum opened a new pull request #25404: [SPARK-28683][BUILD] Upgrade Scala to 2.12.10

2019-09-10 Thread GitBox
wangyum opened a new pull request #25404: [SPARK-28683][BUILD] Upgrade Scala to 2.12.10 URL: https://github.com/apache/spark/pull/25404 ## What changes were proposed in this pull request? This PR upgrade Scala to **2.12.9**. Release notes: - Faster compiler: 5–10%

[GitHub] [spark] HyukjinKwon commented on issue #25728: [SPARK-29020][SQL] Improving array_sort behaviour

2019-09-10 Thread GitBox
HyukjinKwon commented on issue #25728: [SPARK-29020][SQL] Improving array_sort behaviour URL: https://github.com/apache/spark/pull/25728#issuecomment-530219674 Add a Lambda expression for comparator instead of another column `asc` in array_sort. See `array_sort(array(T), function(T, T,

[GitHub] [spark] shanyu commented on issue #25705: [SPARK-29003][CORE] Fix deadlock in startup of Spark History Server

2019-09-10 Thread GitBox
shanyu commented on issue #25705: [SPARK-29003][CORE] Fix deadlock in startup of Spark History Server URL: https://github.com/apache/spark/pull/25705#issuecomment-530219153 > What I'm concerned about is the change would also make tests skip initializing. If the test calls

[GitHub] [spark] shanyu edited a comment on issue #25705: [SPARK-29003][CORE] Fix deadlock in startup of Spark History Server

2019-09-10 Thread GitBox
shanyu edited a comment on issue #25705: [SPARK-29003][CORE] Fix deadlock in startup of Spark History Server URL: https://github.com/apache/spark/pull/25705#issuecomment-530219153 > What I'm concerned about is the change would also make tests skip initializing. If the test calls

[GitHub] [spark] gengliangwang commented on a change in pull request #25723: [SPARK-29019][WebUI] Improve tooltip JDBC/ODBC Server tab

2019-09-10 Thread GitBox
gengliangwang commented on a change in pull request #25723: [SPARK-29019][WebUI] Improve tooltip JDBC/ODBC Server tab URL: https://github.com/apache/spark/pull/25723#discussion_r323057115 ## File path: core/src/main/scala/org/apache/spark/ui/UIUtils.scala ## @@ -311,7

[GitHub] [spark] imback82 commented on a change in pull request #25747: [SPARK-29039][SQL] centralize the catalog and table lookup logic

2019-09-10 Thread GitBox
imback82 commented on a change in pull request #25747: [SPARK-29039][SQL] centralize the catalog and table lookup logic URL: https://github.com/apache/spark/pull/25747#discussion_r323056338 ## File path:

[GitHub] [spark] SparkQA commented on issue #25626: [SPARK-28892][SQL] Add UPDATE support for DataSource V2

2019-09-10 Thread GitBox
SparkQA commented on issue #25626: [SPARK-28892][SQL] Add UPDATE support for DataSource V2 URL: https://github.com/apache/spark/pull/25626#issuecomment-530213098 **[Test build #110458 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/110458/testReport)** for

[GitHub] [spark] AmplabJenkins removed a comment on issue #25626: [SPARK-28892][SQL] Add UPDATE support for DataSource V2

2019-09-10 Thread GitBox
AmplabJenkins removed a comment on issue #25626: [SPARK-28892][SQL] Add UPDATE support for DataSource V2 URL: https://github.com/apache/spark/pull/25626#issuecomment-530212779 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on issue #25626: [SPARK-28892][SQL] Add UPDATE support for DataSource V2

2019-09-10 Thread GitBox
AmplabJenkins removed a comment on issue #25626: [SPARK-28892][SQL] Add UPDATE support for DataSource V2 URL: https://github.com/apache/spark/pull/25626#issuecomment-530212773 Merged build finished. Test PASSed. This is an

[GitHub] [spark] AmplabJenkins commented on issue #25626: [SPARK-28892][SQL] Add UPDATE support for DataSource V2

2019-09-10 Thread GitBox
AmplabJenkins commented on issue #25626: [SPARK-28892][SQL] Add UPDATE support for DataSource V2 URL: https://github.com/apache/spark/pull/25626#issuecomment-530212779 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #25626: [SPARK-28892][SQL] Add UPDATE support for DataSource V2

2019-09-10 Thread GitBox
AmplabJenkins commented on issue #25626: [SPARK-28892][SQL] Add UPDATE support for DataSource V2 URL: https://github.com/apache/spark/pull/25626#issuecomment-530212773 Merged build finished. Test PASSed. This is an automated

[GitHub] [spark] AmplabJenkins removed a comment on issue #22282: [SPARK-23539][SS] Add support for Kafka headers in Structured Streaming

2019-09-10 Thread GitBox
AmplabJenkins removed a comment on issue #22282: [SPARK-23539][SS] Add support for Kafka headers in Structured Streaming URL: https://github.com/apache/spark/pull/22282#issuecomment-530209376 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #22282: [SPARK-23539][SS] Add support for Kafka headers in Structured Streaming

2019-09-10 Thread GitBox
AmplabJenkins commented on issue #22282: [SPARK-23539][SS] Add support for Kafka headers in Structured Streaming URL: https://github.com/apache/spark/pull/22282#issuecomment-530209376 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on issue #22282: [SPARK-23539][SS] Add support for Kafka headers in Structured Streaming

2019-09-10 Thread GitBox
AmplabJenkins removed a comment on issue #22282: [SPARK-23539][SS] Add support for Kafka headers in Structured Streaming URL: https://github.com/apache/spark/pull/22282#issuecomment-530209375 Merged build finished. Test PASSed.

[GitHub] [spark] SparkQA removed a comment on issue #22282: [SPARK-23539][SS] Add support for Kafka headers in Structured Streaming

2019-09-10 Thread GitBox
SparkQA removed a comment on issue #22282: [SPARK-23539][SS] Add support for Kafka headers in Structured Streaming URL: https://github.com/apache/spark/pull/22282#issuecomment-530203905 **[Test build #110456 has

[GitHub] [spark] AmplabJenkins commented on issue #22282: [SPARK-23539][SS] Add support for Kafka headers in Structured Streaming

2019-09-10 Thread GitBox
AmplabJenkins commented on issue #22282: [SPARK-23539][SS] Add support for Kafka headers in Structured Streaming URL: https://github.com/apache/spark/pull/22282#issuecomment-530209375 Merged build finished. Test PASSed. This

[GitHub] [spark] SparkQA commented on issue #22282: [SPARK-23539][SS] Add support for Kafka headers in Structured Streaming

2019-09-10 Thread GitBox
SparkQA commented on issue #22282: [SPARK-23539][SS] Add support for Kafka headers in Structured Streaming URL: https://github.com/apache/spark/pull/22282#issuecomment-530209301 **[Test build #110456 has

[GitHub] [spark] AmplabJenkins removed a comment on issue #25626: [SPARK-28892][SQL] Add UPDATE support for DataSource V2

2019-09-10 Thread GitBox
AmplabJenkins removed a comment on issue #25626: [SPARK-28892][SQL] Add UPDATE support for DataSource V2 URL: https://github.com/apache/spark/pull/25626#issuecomment-530207511 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on issue #25626: [SPARK-28892][SQL] Add UPDATE support for DataSource V2

2019-09-10 Thread GitBox
AmplabJenkins removed a comment on issue #25626: [SPARK-28892][SQL] Add UPDATE support for DataSource V2 URL: https://github.com/apache/spark/pull/25626#issuecomment-530207509 Merged build finished. Test PASSed. This is an

[GitHub] [spark] AmplabJenkins commented on issue #25626: [SPARK-28892][SQL] Add UPDATE support for DataSource V2

2019-09-10 Thread GitBox
AmplabJenkins commented on issue #25626: [SPARK-28892][SQL] Add UPDATE support for DataSource V2 URL: https://github.com/apache/spark/pull/25626#issuecomment-530207509 Merged build finished. Test PASSed. This is an automated

[GitHub] [spark] AmplabJenkins commented on issue #25626: [SPARK-28892][SQL] Add UPDATE support for DataSource V2

2019-09-10 Thread GitBox
AmplabJenkins commented on issue #25626: [SPARK-28892][SQL] Add UPDATE support for DataSource V2 URL: https://github.com/apache/spark/pull/25626#issuecomment-530207511 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] Gschiavon commented on issue #25728: [SPARK-29020][SQL] Improving array_sort behaviour

2019-09-10 Thread GitBox
Gschiavon commented on issue #25728: [SPARK-29020][SQL] Improving array_sort behaviour URL: https://github.com/apache/spark/pull/25728#issuecomment-530207202 How does it translate for this PR @ueshin ? This is an automated

[GitHub] [spark] SparkQA commented on issue #25626: [SPARK-28892][SQL] Add UPDATE support for DataSource V2

2019-09-10 Thread GitBox
SparkQA commented on issue #25626: [SPARK-28892][SQL] Add UPDATE support for DataSource V2 URL: https://github.com/apache/spark/pull/25626#issuecomment-530206549 **[Test build #110457 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/110457/testReport)** for

[GitHub] [spark] AmplabJenkins removed a comment on issue #25542: [SPARK-28840][SQL][test-hadoop3.2] conf.getClassLoader in SparkSQLCLIDriver should be avoided as it returns the UDFClassLoader which i

2019-09-10 Thread GitBox
AmplabJenkins removed a comment on issue #25542: [SPARK-28840][SQL][test-hadoop3.2] conf.getClassLoader in SparkSQLCLIDriver should be avoided as it returns the UDFClassLoader which is created by Hive URL: https://github.com/apache/spark/pull/25542#issuecomment-530205987 Test PASSed.

[GitHub] [spark] SparkQA removed a comment on issue #25542: [SPARK-28840][SQL][test-hadoop3.2] conf.getClassLoader in SparkSQLCLIDriver should be avoided as it returns the UDFClassLoader which is crea

2019-09-10 Thread GitBox
SparkQA removed a comment on issue #25542: [SPARK-28840][SQL][test-hadoop3.2] conf.getClassLoader in SparkSQLCLIDriver should be avoided as it returns the UDFClassLoader which is created by Hive URL: https://github.com/apache/spark/pull/25542#issuecomment-530201229 **[Test build #110455

[GitHub] [spark] AmplabJenkins removed a comment on issue #25542: [SPARK-28840][SQL][test-hadoop3.2] conf.getClassLoader in SparkSQLCLIDriver should be avoided as it returns the UDFClassLoader which i

2019-09-10 Thread GitBox
AmplabJenkins removed a comment on issue #25542: [SPARK-28840][SQL][test-hadoop3.2] conf.getClassLoader in SparkSQLCLIDriver should be avoided as it returns the UDFClassLoader which is created by Hive URL: https://github.com/apache/spark/pull/25542#issuecomment-530205984 Merged build

[GitHub] [spark] AmplabJenkins commented on issue #25542: [SPARK-28840][SQL][test-hadoop3.2] conf.getClassLoader in SparkSQLCLIDriver should be avoided as it returns the UDFClassLoader which is create

2019-09-10 Thread GitBox
AmplabJenkins commented on issue #25542: [SPARK-28840][SQL][test-hadoop3.2] conf.getClassLoader in SparkSQLCLIDriver should be avoided as it returns the UDFClassLoader which is created by Hive URL: https://github.com/apache/spark/pull/25542#issuecomment-530205984 Merged build finished.

[GitHub] [spark] AmplabJenkins commented on issue #25542: [SPARK-28840][SQL][test-hadoop3.2] conf.getClassLoader in SparkSQLCLIDriver should be avoided as it returns the UDFClassLoader which is create

2019-09-10 Thread GitBox
AmplabJenkins commented on issue #25542: [SPARK-28840][SQL][test-hadoop3.2] conf.getClassLoader in SparkSQLCLIDriver should be avoided as it returns the UDFClassLoader which is created by Hive URL: https://github.com/apache/spark/pull/25542#issuecomment-530205987 Test PASSed. Refer to

[GitHub] [spark] SparkQA commented on issue #25542: [SPARK-28840][SQL][test-hadoop3.2] conf.getClassLoader in SparkSQLCLIDriver should be avoided as it returns the UDFClassLoader which is created by H

2019-09-10 Thread GitBox
SparkQA commented on issue #25542: [SPARK-28840][SQL][test-hadoop3.2] conf.getClassLoader in SparkSQLCLIDriver should be avoided as it returns the UDFClassLoader which is created by Hive URL: https://github.com/apache/spark/pull/25542#issuecomment-530205919 **[Test build #110455 has

[GitHub] [spark] cloud-fan commented on a change in pull request #25747: [SPARK-29039][SQL] centralize the catalog and table lookup logic

2019-09-10 Thread GitBox
cloud-fan commented on a change in pull request #25747: [SPARK-29039][SQL] centralize the catalog and table lookup logic URL: https://github.com/apache/spark/pull/25747#discussion_r323046755 ## File path:

[GitHub] [spark] SparkQA commented on issue #22282: [SPARK-23539][SS] Add support for Kafka headers in Structured Streaming

2019-09-10 Thread GitBox
SparkQA commented on issue #22282: [SPARK-23539][SS] Add support for Kafka headers in Structured Streaming URL: https://github.com/apache/spark/pull/22282#issuecomment-530203905 **[Test build #110456 has

[GitHub] [spark] dongjinleekr commented on issue #22282: [SPARK-23539][SS] Add support for Kafka headers in Structured Streaming

2019-09-10 Thread GitBox
dongjinleekr commented on issue #22282: [SPARK-23539][SS] Add support for Kafka headers in Structured Streaming URL: https://github.com/apache/spark/pull/22282#issuecomment-530203918 @srowen Fixed, with removing redundant `new` in `KafkaDataConsumerSuite`.

[GitHub] [spark] dongjinleekr commented on a change in pull request #22282: [SPARK-23539][SS] Add support for Kafka headers in Structured Streaming

2019-09-10 Thread GitBox
dongjinleekr commented on a change in pull request #22282: [SPARK-23539][SS] Add support for Kafka headers in Structured Streaming URL: https://github.com/apache/spark/pull/22282#discussion_r323045234 ## File path:

[GitHub] [spark] dongjinleekr commented on a change in pull request #22282: [SPARK-23539][SS] Add support for Kafka headers in Structured Streaming

2019-09-10 Thread GitBox
dongjinleekr commented on a change in pull request #22282: [SPARK-23539][SS] Add support for Kafka headers in Structured Streaming URL: https://github.com/apache/spark/pull/22282#discussion_r323045178 ## File path:

[GitHub] [spark] AmplabJenkins removed a comment on issue #25709: [SPARK-29007][STREAMING][MLLIB][TESTS] Enforce not leaking SparkContext in tests which creates new StreamingContext with new SparkCont

2019-09-10 Thread GitBox
AmplabJenkins removed a comment on issue #25709: [SPARK-29007][STREAMING][MLLIB][TESTS] Enforce not leaking SparkContext in tests which creates new StreamingContext with new SparkContext URL: https://github.com/apache/spark/pull/25709#issuecomment-530202414 Test FAILed. Refer to this

[GitHub] [spark] JkSelf commented on issue #25295: [SPARK-28560][SQL] Optimize shuffle reader to local shuffle reader when smj converted to bhj in adaptive execution

2019-09-10 Thread GitBox
JkSelf commented on issue #25295: [SPARK-28560][SQL] Optimize shuffle reader to local shuffle reader when smj converted to bhj in adaptive execution URL: https://github.com/apache/spark/pull/25295#issuecomment-530202694 @cloud-fan Can you help review if you have available time? Thanks for

[GitHub] [spark] AmplabJenkins removed a comment on issue #25709: [SPARK-29007][STREAMING][MLLIB][TESTS] Enforce not leaking SparkContext in tests which creates new StreamingContext with new SparkCont

2019-09-10 Thread GitBox
AmplabJenkins removed a comment on issue #25709: [SPARK-29007][STREAMING][MLLIB][TESTS] Enforce not leaking SparkContext in tests which creates new StreamingContext with new SparkContext URL: https://github.com/apache/spark/pull/25709#issuecomment-530202412 Merged build finished. Test

[GitHub] [spark] AmplabJenkins removed a comment on issue #23952: [SPARK-26929][SQL]fix table owner use user instead of principal when create table through spark-sql or beeline

2019-09-10 Thread GitBox
AmplabJenkins removed a comment on issue #23952: [SPARK-26929][SQL]fix table owner use user instead of principal when create table through spark-sql or beeline URL: https://github.com/apache/spark/pull/23952#issuecomment-530202233 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins removed a comment on issue #23952: [SPARK-26929][SQL]fix table owner use user instead of principal when create table through spark-sql or beeline

2019-09-10 Thread GitBox
AmplabJenkins removed a comment on issue #23952: [SPARK-26929][SQL]fix table owner use user instead of principal when create table through spark-sql or beeline URL: https://github.com/apache/spark/pull/23952#issuecomment-530202235 Test PASSed. Refer to this link for build results

[GitHub] [spark] AmplabJenkins commented on issue #25709: [SPARK-29007][STREAMING][MLLIB][TESTS] Enforce not leaking SparkContext in tests which creates new StreamingContext with new SparkContext

2019-09-10 Thread GitBox
AmplabJenkins commented on issue #25709: [SPARK-29007][STREAMING][MLLIB][TESTS] Enforce not leaking SparkContext in tests which creates new StreamingContext with new SparkContext URL: https://github.com/apache/spark/pull/25709#issuecomment-530202412 Merged build finished. Test FAILed.

[GitHub] [spark] SparkQA removed a comment on issue #25709: [SPARK-29007][STREAMING][MLLIB][TESTS] Enforce not leaking SparkContext in tests which creates new StreamingContext with new SparkContext

2019-09-10 Thread GitBox
SparkQA removed a comment on issue #25709: [SPARK-29007][STREAMING][MLLIB][TESTS] Enforce not leaking SparkContext in tests which creates new StreamingContext with new SparkContext URL: https://github.com/apache/spark/pull/25709#issuecomment-530181546 **[Test build #110450 has

[GitHub] [spark] AmplabJenkins commented on issue #25709: [SPARK-29007][STREAMING][MLLIB][TESTS] Enforce not leaking SparkContext in tests which creates new StreamingContext with new SparkContext

2019-09-10 Thread GitBox
AmplabJenkins commented on issue #25709: [SPARK-29007][STREAMING][MLLIB][TESTS] Enforce not leaking SparkContext in tests which creates new StreamingContext with new SparkContext URL: https://github.com/apache/spark/pull/25709#issuecomment-530202414 Test FAILed. Refer to this link for

[GitHub] [spark] AmplabJenkins commented on issue #23952: [SPARK-26929][SQL]fix table owner use user instead of principal when create table through spark-sql or beeline

2019-09-10 Thread GitBox
AmplabJenkins commented on issue #23952: [SPARK-26929][SQL]fix table owner use user instead of principal when create table through spark-sql or beeline URL: https://github.com/apache/spark/pull/23952#issuecomment-530202235 Test PASSed. Refer to this link for build results (access rights

[GitHub] [spark] SparkQA commented on issue #25709: [SPARK-29007][STREAMING][MLLIB][TESTS] Enforce not leaking SparkContext in tests which creates new StreamingContext with new SparkContext

2019-09-10 Thread GitBox
SparkQA commented on issue #25709: [SPARK-29007][STREAMING][MLLIB][TESTS] Enforce not leaking SparkContext in tests which creates new StreamingContext with new SparkContext URL: https://github.com/apache/spark/pull/25709#issuecomment-530202262 **[Test build #110450 has

[GitHub] [spark] JkSelf commented on issue #25295: [SPARK-28560][SQL] Optimize shuffle reader to local shuffle reader when smj converted to bhj in adaptive execution

2019-09-10 Thread GitBox
JkSelf commented on issue #25295: [SPARK-28560][SQL] Optimize shuffle reader to local shuffle reader when smj converted to bhj in adaptive execution URL: https://github.com/apache/spark/pull/25295#issuecomment-530202124 fixed the conflicts.

[GitHub] [spark] AmplabJenkins commented on issue #23952: [SPARK-26929][SQL]fix table owner use user instead of principal when create table through spark-sql or beeline

2019-09-10 Thread GitBox
AmplabJenkins commented on issue #23952: [SPARK-26929][SQL]fix table owner use user instead of principal when create table through spark-sql or beeline URL: https://github.com/apache/spark/pull/23952#issuecomment-530202233 Merged build finished. Test PASSed.

[GitHub] [spark] SparkQA commented on issue #23952: [SPARK-26929][SQL]fix table owner use user instead of principal when create table through spark-sql or beeline

2019-09-10 Thread GitBox
SparkQA commented on issue #23952: [SPARK-26929][SQL]fix table owner use user instead of principal when create table through spark-sql or beeline URL: https://github.com/apache/spark/pull/23952#issuecomment-530202017 **[Test build #110451 has

[GitHub] [spark] SparkQA removed a comment on issue #23952: [SPARK-26929][SQL]fix table owner use user instead of principal when create table through spark-sql or beeline

2019-09-10 Thread GitBox
SparkQA removed a comment on issue #23952: [SPARK-26929][SQL]fix table owner use user instead of principal when create table through spark-sql or beeline URL: https://github.com/apache/spark/pull/23952#issuecomment-530181565 **[Test build #110451 has

[GitHub] [spark] SparkQA commented on issue #25542: [SPARK-28840][SQL][test-hadoop3.2] conf.getClassLoader in SparkSQLCLIDriver should be avoided as it returns the UDFClassLoader which is created by H

2019-09-10 Thread GitBox
SparkQA commented on issue #25542: [SPARK-28840][SQL][test-hadoop3.2] conf.getClassLoader in SparkSQLCLIDriver should be avoided as it returns the UDFClassLoader which is created by Hive URL: https://github.com/apache/spark/pull/25542#issuecomment-530201229 **[Test build #110455 has

[GitHub] [spark] AmplabJenkins removed a comment on issue #25542: [SPARK-28840][SQL][test-hadoop3.2] conf.getClassLoader in SparkSQLCLIDriver should be avoided as it returns the UDFClassLoader which i

2019-09-10 Thread GitBox
AmplabJenkins removed a comment on issue #25542: [SPARK-28840][SQL][test-hadoop3.2] conf.getClassLoader in SparkSQLCLIDriver should be avoided as it returns the UDFClassLoader which is created by Hive URL: https://github.com/apache/spark/pull/25542#issuecomment-530200809 Merged build

[GitHub] [spark] AmplabJenkins removed a comment on issue #25542: [SPARK-28840][SQL][test-hadoop3.2] conf.getClassLoader in SparkSQLCLIDriver should be avoided as it returns the UDFClassLoader which i

2019-09-10 Thread GitBox
AmplabJenkins removed a comment on issue #25542: [SPARK-28840][SQL][test-hadoop3.2] conf.getClassLoader in SparkSQLCLIDriver should be avoided as it returns the UDFClassLoader which is created by Hive URL: https://github.com/apache/spark/pull/25542#issuecomment-530200816 Test PASSed.

[GitHub] [spark] AmplabJenkins commented on issue #25542: [SPARK-28840][SQL][test-hadoop3.2] conf.getClassLoader in SparkSQLCLIDriver should be avoided as it returns the UDFClassLoader which is create

2019-09-10 Thread GitBox
AmplabJenkins commented on issue #25542: [SPARK-28840][SQL][test-hadoop3.2] conf.getClassLoader in SparkSQLCLIDriver should be avoided as it returns the UDFClassLoader which is created by Hive URL: https://github.com/apache/spark/pull/25542#issuecomment-530200816 Test PASSed. Refer to

[GitHub] [spark] AmplabJenkins commented on issue #25542: [SPARK-28840][SQL][test-hadoop3.2] conf.getClassLoader in SparkSQLCLIDriver should be avoided as it returns the UDFClassLoader which is create

2019-09-10 Thread GitBox
AmplabJenkins commented on issue #25542: [SPARK-28840][SQL][test-hadoop3.2] conf.getClassLoader in SparkSQLCLIDriver should be avoided as it returns the UDFClassLoader which is created by Hive URL: https://github.com/apache/spark/pull/25542#issuecomment-530200809 Merged build finished.

[GitHub] [spark] SparkQA commented on issue #25751: [SPARK-29042][Core] Sampling-based RDD with unordered input should be INDETERMINATE

2019-09-10 Thread GitBox
SparkQA commented on issue #25751: [SPARK-29042][Core] Sampling-based RDD with unordered input should be INDETERMINATE URL: https://github.com/apache/spark/pull/25751#issuecomment-530199730 **[Test build #110454 has

[GitHub] [spark] AmplabJenkins removed a comment on issue #25751: [SPARK-29042][Core] Sampling-based RDD with unordered input should be INDETERMINATE

2019-09-10 Thread GitBox
AmplabJenkins removed a comment on issue #25751: [SPARK-29042][Core] Sampling-based RDD with unordered input should be INDETERMINATE URL: https://github.com/apache/spark/pull/25751#issuecomment-530199352 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins removed a comment on issue #25751: [SPARK-29042][Core] Sampling-based RDD with unordered input should be INDETERMINATE

2019-09-10 Thread GitBox
AmplabJenkins removed a comment on issue #25751: [SPARK-29042][Core] Sampling-based RDD with unordered input should be INDETERMINATE URL: https://github.com/apache/spark/pull/25751#issuecomment-530199355 Test PASSed. Refer to this link for build results (access rights to CI server

[GitHub] [spark] AmplabJenkins commented on issue #25751: [SPARK-29042][Core] Sampling-based RDD with unordered input should be INDETERMINATE

2019-09-10 Thread GitBox
AmplabJenkins commented on issue #25751: [SPARK-29042][Core] Sampling-based RDD with unordered input should be INDETERMINATE URL: https://github.com/apache/spark/pull/25751#issuecomment-530199352 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins commented on issue #25751: [SPARK-29042][Core] Sampling-based RDD with unordered input should be INDETERMINATE

2019-09-10 Thread GitBox
AmplabJenkins commented on issue #25751: [SPARK-29042][Core] Sampling-based RDD with unordered input should be INDETERMINATE URL: https://github.com/apache/spark/pull/25751#issuecomment-530199355 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on issue #25706: [SPARK-26989][CORE][TEST] DAGSchedulerSuite: ensure listeners are fully processed before checking recorded values

2019-09-10 Thread GitBox
AmplabJenkins removed a comment on issue #25706: [SPARK-26989][CORE][TEST] DAGSchedulerSuite: ensure listeners are fully processed before checking recorded values URL: https://github.com/apache/spark/pull/25706#issuecomment-530199080 Test PASSed. Refer to this link for build results

[GitHub] [spark] AmplabJenkins removed a comment on issue #25706: [SPARK-26989][CORE][TEST] DAGSchedulerSuite: ensure listeners are fully processed before checking recorded values

2019-09-10 Thread GitBox
AmplabJenkins removed a comment on issue #25706: [SPARK-26989][CORE][TEST] DAGSchedulerSuite: ensure listeners are fully processed before checking recorded values URL: https://github.com/apache/spark/pull/25706#issuecomment-530199076 Merged build finished. Test PASSed.

[GitHub] [spark] viirya commented on issue #25751: [SPARK-29042][Core] Sampling-based RDD with unordered input should be INDETERMINATE

2019-09-10 Thread GitBox
viirya commented on issue #25751: [SPARK-29042][Core] Sampling-based RDD with unordered input should be INDETERMINATE URL: https://github.com/apache/spark/pull/25751#issuecomment-530199164 @HyukjinKwon Thanks! I updated the PR description.

[GitHub] [spark] AmplabJenkins commented on issue #25706: [SPARK-26989][CORE][TEST] DAGSchedulerSuite: ensure listeners are fully processed before checking recorded values

2019-09-10 Thread GitBox
AmplabJenkins commented on issue #25706: [SPARK-26989][CORE][TEST] DAGSchedulerSuite: ensure listeners are fully processed before checking recorded values URL: https://github.com/apache/spark/pull/25706#issuecomment-530199076 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins commented on issue #25706: [SPARK-26989][CORE][TEST] DAGSchedulerSuite: ensure listeners are fully processed before checking recorded values

2019-09-10 Thread GitBox
AmplabJenkins commented on issue #25706: [SPARK-26989][CORE][TEST] DAGSchedulerSuite: ensure listeners are fully processed before checking recorded values URL: https://github.com/apache/spark/pull/25706#issuecomment-530199080 Test PASSed. Refer to this link for build results (access

[GitHub] [spark] SparkQA removed a comment on issue #25706: [SPARK-26989][CORE][TEST] DAGSchedulerSuite: ensure listeners are fully processed before checking recorded values

2019-09-10 Thread GitBox
SparkQA removed a comment on issue #25706: [SPARK-26989][CORE][TEST] DAGSchedulerSuite: ensure listeners are fully processed before checking recorded values URL: https://github.com/apache/spark/pull/25706#issuecomment-530172922 **[Test build #110447 has

[GitHub] [spark] SparkQA commented on issue #25706: [SPARK-26989][CORE][TEST] DAGSchedulerSuite: ensure listeners are fully processed before checking recorded values

2019-09-10 Thread GitBox
SparkQA commented on issue #25706: [SPARK-26989][CORE][TEST] DAGSchedulerSuite: ensure listeners are fully processed before checking recorded values URL: https://github.com/apache/spark/pull/25706#issuecomment-530198712 **[Test build #110447 has

[GitHub] [spark] SparkQA commented on issue #25752: [SPARK-29045][SQL][TESTS] Drop table to avoid test failure in SQLMetricsSuite

2019-09-10 Thread GitBox
SparkQA commented on issue #25752: [SPARK-29045][SQL][TESTS] Drop table to avoid test failure in SQLMetricsSuite URL: https://github.com/apache/spark/pull/25752#issuecomment-530198211 **[Test build #110453 has

  1   2   3   4   5   6   7   8   9   10   >