[GitHub] [spark] AmplabJenkins removed a comment on pull request #29299: [SPARK-32490][BUILD] Upgrade netty-all to 4.1.51.Final

2020-07-30 Thread GitBox
AmplabJenkins removed a comment on pull request #29299: URL: https://github.com/apache/spark/pull/29299#issuecomment-55453 Can one of the admins verify this patch? This is an automated message from the Apache Git

[GitHub] [spark] HyukjinKwon commented on pull request #29272: [SPARK-32468][SS][TESTS] Fix timeout config issue in Kafka connector tests

2020-07-30 Thread GitBox
HyukjinKwon commented on pull request #29272: URL: https://github.com/apache/spark/pull/29272#issuecomment-666870399 retest this please This is an automated message from the Apache Git Service. To respond to the message,

[GitHub] [spark] HyukjinKwon commented on pull request #29299: [SPARK-32490][BUILD] Upgrade netty-all to 4.1.51.Final

2020-07-30 Thread GitBox
HyukjinKwon commented on pull request #29299: URL: https://github.com/apache/spark/pull/29299#issuecomment-666870098 ok to test This is an automated message from the Apache Git Service. To respond to the message, please log

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29278: [SPARK-32160][CORE][PYSPARK] Add a config to switch allow/disallow to create SparkContext in executors.

2020-07-30 Thread GitBox
AmplabJenkins removed a comment on pull request #29278: URL: https://github.com/apache/spark/pull/29278#issuecomment-666869337 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins commented on pull request #29278: [SPARK-32160][CORE][PYSPARK] Add a config to switch allow/disallow to create SparkContext in executors.

2020-07-30 Thread GitBox
AmplabJenkins commented on pull request #29278: URL: https://github.com/apache/spark/pull/29278#issuecomment-666869337 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29272: [SPARK-32468][SS][TESTS] Fix timeout config issue in Kafka connector tests

2020-07-30 Thread GitBox
AmplabJenkins removed a comment on pull request #29272: URL: https://github.com/apache/spark/pull/29272#issuecomment-666866554 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] HyukjinKwon commented on pull request #29314: [FOLLOWUP][SPARK-32175] Remove flaky test added in SPARK-32175

2020-07-30 Thread GitBox
HyukjinKwon commented on pull request #29314: URL: https://github.com/apache/spark/pull/29314#issuecomment-666866935 LGTM, thanks! This is an automated message from the Apache Git Service. To respond to the message, please

[GitHub] [spark] AmplabJenkins commented on pull request #29272: [SPARK-32468][SS][TESTS] Fix timeout config issue in Kafka connector tests

2020-07-30 Thread GitBox
AmplabJenkins commented on pull request #29272: URL: https://github.com/apache/spark/pull/29272#issuecomment-666866554 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] HeartSaVioR commented on pull request #29272: [SPARK-32468][SS][TESTS] Fix timeout config issue in Kafka connector tests

2020-07-30 Thread GitBox
HeartSaVioR commented on pull request #29272: URL: https://github.com/apache/spark/pull/29272#issuecomment-666865884 retest this, please This is an automated message from the Apache Git Service. To respond to the message,

[GitHub] [spark] AngersZhuuuu commented on pull request #29199: [SPARK-32403][SQL] Refactor current ScriptTransformationExec

2020-07-30 Thread GitBox
AngersZh commented on pull request #29199: URL: https://github.com/apache/spark/pull/29199#issuecomment-666865196 > > add default no serde IO schemas ScriptTransformationIOSchema.defaultIOSchema > > I think we will have a default native serde. So for now we just need a fake one

[GitHub] [spark] yaooqinn commented on pull request #29303: [SPARK-32492][SQL] Fulfill missing column meta information for thriftserver client tools

2020-07-30 Thread GitBox
yaooqinn commented on pull request #29303: URL: https://github.com/apache/spark/pull/29303#issuecomment-666864487 cc @cloud-fan @gatorsmile @maropu @wangyum thanks very much This is an automated message from the Apache Git

[GitHub] [spark] sarutak closed pull request #29313: [DO-NOT-MERGE] Debug the flaky test added in SPARK-32175

2020-07-30 Thread GitBox
sarutak closed pull request #29313: URL: https://github.com/apache/spark/pull/29313 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to

[GitHub] [spark] sarutak commented on pull request #29313: [DO-NOT-MERGE] Debug the flaky test added in SPARK-32175

2020-07-30 Thread GitBox
sarutak commented on pull request #29313: URL: https://github.com/apache/spark/pull/29313#issuecomment-666864103 #29314 removed the flaky test so I'll close this PR. This is an automated message from the Apache Git Service.

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29308: [SPARK-32499][SQL] Use `{}` in conversions maps and structs to strings

2020-07-30 Thread GitBox
AmplabJenkins removed a comment on pull request #29308: URL: https://github.com/apache/spark/pull/29308#issuecomment-666863645 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] SparkQA commented on pull request #29294: [SPARK-32160][CORE][PYSPARK][3.0] Add a config to switch allow/disallow to create SparkContext in executors.

2020-07-30 Thread GitBox
SparkQA commented on pull request #29294: URL: https://github.com/apache/spark/pull/29294#issuecomment-666863818 **[Test build #126833 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/126833/testReport)** for PR 29294 at commit

[GitHub] [spark] AmplabJenkins commented on pull request #29308: [SPARK-32499][SQL] Use `{}` in conversions maps and structs to strings

2020-07-30 Thread GitBox
AmplabJenkins commented on pull request #29308: URL: https://github.com/apache/spark/pull/29308#issuecomment-666863645 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] asfgit closed pull request #29314: [FOLLOWUP][SPARK-32175] Remove flaky test added in SPARK-32175

2020-07-30 Thread GitBox
asfgit closed pull request #29314: URL: https://github.com/apache/spark/pull/29314 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to

[GitHub] [spark] SparkQA commented on pull request #29308: [SPARK-32499][SQL] Use `{}` in conversions maps and structs to strings

2020-07-30 Thread GitBox
SparkQA commented on pull request #29308: URL: https://github.com/apache/spark/pull/29308#issuecomment-666862651 **[Test build #126805 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/126805/testReport)** for PR 29308 at commit

[GitHub] [spark] SparkQA removed a comment on pull request #29308: [SPARK-32499][SQL] Use `{}` in conversions maps and structs to strings

2020-07-30 Thread GitBox
SparkQA removed a comment on pull request #29308: URL: https://github.com/apache/spark/pull/29308#issuecomment-56132 **[Test build #126805 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/126805/testReport)** for PR 29308 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29272: [SPARK-32468][SS][TESTS] Fix timeout config issue in Kafka connector tests

2020-07-30 Thread GitBox
AmplabJenkins removed a comment on pull request #29272: URL: https://github.com/apache/spark/pull/29272#issuecomment-666860522 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AngersZhuuuu commented on pull request #29199: [SPARK-32403][SQL] Refactor current ScriptTransformationExec

2020-07-30 Thread GitBox
AngersZh commented on pull request #29199: URL: https://github.com/apache/spark/pull/29199#issuecomment-666862180 > > add default no serde IO schemas ScriptTransformationIOSchema.defaultIOSchema > > I think we will have a default native serde. So for now we just need a fake one

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29304: [SPARK-32494][SQL] Null Aware Anti Join Optimize Support Multi-Column

2020-07-30 Thread GitBox
AmplabJenkins removed a comment on pull request #29304: URL: https://github.com/apache/spark/pull/29304#issuecomment-666861288 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] SparkQA removed a comment on pull request #29272: [SPARK-32468][SS][TESTS] Fix timeout config issue in Kafka connector tests

2020-07-30 Thread GitBox
SparkQA removed a comment on pull request #29272: URL: https://github.com/apache/spark/pull/29272#issuecomment-666846618 **[Test build #126827 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/126827/testReport)** for PR 29272 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29272: [SPARK-32468][SS][TESTS] Fix timeout config issue in Kafka connector tests

2020-07-30 Thread GitBox
AmplabJenkins removed a comment on pull request #29272: URL: https://github.com/apache/spark/pull/29272#issuecomment-666860518 Merged build finished. Test FAILed. This is an automated message from the Apache Git Service. To

[GitHub] [spark] SparkQA removed a comment on pull request #29311: [SPARK-32501][SQL] Convert null to "null" in structs, maps and arrays while casting to strings

2020-07-30 Thread GitBox
SparkQA removed a comment on pull request #29311: URL: https://github.com/apache/spark/pull/29311#issuecomment-55682 **[Test build #126804 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/126804/testReport)** for PR 29311 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29311: [SPARK-32501][SQL] Convert null to "null" in structs, maps and arrays while casting to strings

2020-07-30 Thread GitBox
AmplabJenkins removed a comment on pull request #29311: URL: https://github.com/apache/spark/pull/29311#issuecomment-666861154 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] SparkQA commented on pull request #28902: [SPARK-31801][API][SHUFFLE][TESTS] Tests for registering map output metadata

2020-07-30 Thread GitBox
SparkQA commented on pull request #28902: URL: https://github.com/apache/spark/pull/28902#issuecomment-666861319 **[Test build #126832 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/126832/testReport)** for PR 28902 at commit

[GitHub] [spark] AmplabJenkins commented on pull request #29311: [SPARK-32501][SQL] Convert null to "null" in structs, maps and arrays while casting to strings

2020-07-30 Thread GitBox
AmplabJenkins commented on pull request #29311: URL: https://github.com/apache/spark/pull/29311#issuecomment-666861154 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins commented on pull request #29304: [SPARK-32494][SQL] Null Aware Anti Join Optimize Support Multi-Column

2020-07-30 Thread GitBox
AmplabJenkins commented on pull request #29304: URL: https://github.com/apache/spark/pull/29304#issuecomment-666861288 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] stczwd commented on a change in pull request #28617: [SPARK-31694][SQL] Add SupportsPartitions Catalog APIs on DataSourceV2

2020-07-30 Thread GitBox
stczwd commented on a change in pull request #28617: URL: https://github.com/apache/spark/pull/28617#discussion_r463351749 ## File path: sql/catalyst/src/main/java/org/apache/spark/sql/connector/catalog/SupportsPartitions.java ## @@ -0,0 +1,96 @@ +/* + * Licensed to the

[GitHub] [spark] SparkQA commented on pull request #28618: [SPARK-31801][API][SHUFFLE] Register map output metadata

2020-07-30 Thread GitBox
SparkQA commented on pull request #28618: URL: https://github.com/apache/spark/pull/28618#issuecomment-666860636 **[Test build #126831 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/126831/testReport)** for PR 28618 at commit

[GitHub] [spark] SparkQA commented on pull request #29272: [SPARK-32468][SS][TESTS] Fix timeout config issue in Kafka connector tests

2020-07-30 Thread GitBox
SparkQA commented on pull request #29272: URL: https://github.com/apache/spark/pull/29272#issuecomment-666860464 **[Test build #126827 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/126827/testReport)** for PR 29272 at commit

[GitHub] [spark] AmplabJenkins commented on pull request #29272: [SPARK-32468][SS][TESTS] Fix timeout config issue in Kafka connector tests

2020-07-30 Thread GitBox
AmplabJenkins commented on pull request #29272: URL: https://github.com/apache/spark/pull/29272#issuecomment-666860518 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] SparkQA commented on pull request #29311: [SPARK-32501][SQL] Convert null to "null" in structs, maps and arrays while casting to strings

2020-07-30 Thread GitBox
SparkQA commented on pull request #29311: URL: https://github.com/apache/spark/pull/29311#issuecomment-666860040 **[Test build #126804 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/126804/testReport)** for PR 29311 at commit

[GitHub] [spark] sarutak edited a comment on pull request #29314: [FOLLOWUP][SPARK-32175] Remove flaky test added in SPARK-32175

2020-07-30 Thread GitBox
sarutak edited a comment on pull request #29314: URL: https://github.com/apache/spark/pull/29314#issuecomment-666856942 This PR just removes existing test, so I'll merge this, not waiting for the CI result. This is an

[GitHub] [spark] leanken commented on pull request #29304: [SPARK-32494][SQL] Null Aware Anti Join Optimize Support Multi-Column

2020-07-30 Thread GitBox
leanken commented on pull request #29304: URL: https://github.com/apache/spark/pull/29304#issuecomment-666858566 @viirya thanks for your reviewing, code updated. This is an automated message from the Apache Git Service. To

[GitHub] [spark] leanken commented on a change in pull request #29304: [SPARK-32494][SQL] Null Aware Anti Join Optimize Support Multi-Column

2020-07-30 Thread GitBox
leanken commented on a change in pull request #29304: URL: https://github.com/apache/spark/pull/29304#discussion_r463356956 ## File path: sql/catalyst/src/main/java/org/apache/spark/sql/catalyst/expressions/UnsafeRow.java ## @@ -591,6 +591,15 @@ public boolean anyNull() {

[GitHub] [spark] sarutak commented on pull request #29314: [FOLLOWUP][SPARK-32175] Remove flaky test added in SPARK-32175

2020-07-30 Thread GitBox
sarutak commented on pull request #29314: URL: https://github.com/apache/spark/pull/29314#issuecomment-666856942 This PR just removes existing test, so I'll merge this, not waiting the CI result. This is an automated

[GitHub] [spark] AmplabJenkins commented on pull request #29314: [FOLLOWUP][SPARK-32175] Remove flaky test added in SPARK-32175

2020-07-30 Thread GitBox
AmplabJenkins commented on pull request #29314: URL: https://github.com/apache/spark/pull/29314#issuecomment-666855992 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] srowen commented on a change in pull request #29312: [SPARK-32503][CORE][TESTS] Add Scala 2.13 `core` and related module test in GitHub Action

2020-07-30 Thread GitBox
srowen commented on a change in pull request #29312: URL: https://github.com/apache/spark/pull/29312#discussion_r463354636 ## File path: .github/workflows/master.yml ## @@ -271,3 +271,29 @@ jobs: mkdir -p ~/.m2 ./build/mvn $MAVEN_CLI_OPTS -DskipTests -Pyarn

[GitHub] [spark] sarutak commented on pull request #29314: [FOLLOWUP][SPARK-32175] Remove flaky test added in SPARK-32175

2020-07-30 Thread GitBox
sarutak commented on pull request #29314: URL: https://github.com/apache/spark/pull/29314#issuecomment-666854785 cc: @tgravescs, @HyukjinKwon This is an automated message from the Apache Git Service. To respond to the

[GitHub] [spark] sarutak opened a new pull request #29314: [FOLLOWUP][SPARK-32175] Remove flaky test added in SPARK-32175

2020-07-30 Thread GitBox
sarutak opened a new pull request #29314: URL: https://github.com/apache/spark/pull/29314 ### What changes were proposed in this pull request? This PR removes a test added in SPARK-32175(#29002). ### Why are the changes needed? That test is flaky. It can be mitigated by

[GitHub] [spark] dougtherug commented on pull request #23369: [SPARK-26429][SS]add jdbc sink for Structured Streaming.

2020-07-30 Thread GitBox
dougtherug commented on pull request #23369: URL: https://github.com/apache/spark/pull/23369#issuecomment-666851865 Hi @yanlin-Lynn is there a plan to support JDBC as a source type for the Structured Streaming API? This is

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29278: [SPARK-32160][CORE][PYSPARK] Add a config to switch allow/disallow to create SparkContext in executors.

2020-07-30 Thread GitBox
AmplabJenkins removed a comment on pull request #29278: URL: https://github.com/apache/spark/pull/29278#issuecomment-666850957 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29278: [SPARK-32160][CORE][PYSPARK] Add a config to switch allow/disallow to create SparkContext in executors.

2020-07-30 Thread GitBox
AmplabJenkins removed a comment on pull request #29278: URL: https://github.com/apache/spark/pull/29278#issuecomment-666850951 Merged build finished. Test FAILed. This is an automated message from the Apache Git Service. To

[GitHub] [spark] AmplabJenkins commented on pull request #29278: [SPARK-32160][CORE][PYSPARK] Add a config to switch allow/disallow to create SparkContext in executors.

2020-07-30 Thread GitBox
AmplabJenkins commented on pull request #29278: URL: https://github.com/apache/spark/pull/29278#issuecomment-666850951 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] SparkQA commented on pull request #28939: [SPARK-32119][CORE] ExecutorPlugin doesn't work with Standalone Cluster

2020-07-30 Thread GitBox
SparkQA commented on pull request #28939: URL: https://github.com/apache/spark/pull/28939#issuecomment-666851072 **[Test build #126830 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/126830/testReport)** for PR 28939 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29313: [DO-NOT-MERGE] Debug the flaky test added in SPARK-32175

2020-07-30 Thread GitBox
AmplabJenkins removed a comment on pull request #29313: URL: https://github.com/apache/spark/pull/29313#issuecomment-666736981 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] SparkQA commented on pull request #29313: [DO-NOT-MERGE] Debug the flaky test added in SPARK-32175

2020-07-30 Thread GitBox
SparkQA commented on pull request #29313: URL: https://github.com/apache/spark/pull/29313#issuecomment-666849944 **[Test build #126829 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/126829/testReport)** for PR 29313 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29270: [SPARK-32466][TEST][SQL] Add PlanStabilitySuite to detect SparkPlan regression

2020-07-30 Thread GitBox
AmplabJenkins removed a comment on pull request #29270: URL: https://github.com/apache/spark/pull/29270#issuecomment-666849196 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] SparkQA removed a comment on pull request #29278: [SPARK-32160][CORE][PYSPARK] Add a config to switch allow/disallow to create SparkContext in executors.

2020-07-30 Thread GitBox
SparkQA removed a comment on pull request #29278: URL: https://github.com/apache/spark/pull/29278#issuecomment-56234 **[Test build #126812 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/126812/testReport)** for PR 29278 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29211: [SPARK-31197][CORE] Shutdown executor once we are done decommissioning

2020-07-30 Thread GitBox
AmplabJenkins removed a comment on pull request #29211: URL: https://github.com/apache/spark/pull/29211#issuecomment-666849810 Merged build finished. Test FAILed. This is an automated message from the Apache Git Service. To

[GitHub] [spark] SparkQA commented on pull request #29278: [SPARK-32160][CORE][PYSPARK] Add a config to switch allow/disallow to create SparkContext in executors.

2020-07-30 Thread GitBox
SparkQA commented on pull request #29278: URL: https://github.com/apache/spark/pull/29278#issuecomment-666849737 **[Test build #126812 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/126812/testReport)** for PR 29278 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29270: [SPARK-32466][TEST][SQL] Add PlanStabilitySuite to detect SparkPlan regression

2020-07-30 Thread GitBox
AmplabJenkins removed a comment on pull request #29270: URL: https://github.com/apache/spark/pull/29270#issuecomment-666849192 Merged build finished. Test FAILed. This is an automated message from the Apache Git Service. To

[GitHub] [spark] AmplabJenkins commented on pull request #29211: [SPARK-31197][CORE] Shutdown executor once we are done decommissioning

2020-07-30 Thread GitBox
AmplabJenkins commented on pull request #29211: URL: https://github.com/apache/spark/pull/29211#issuecomment-666849810 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] SparkQA commented on pull request #29211: [SPARK-31197][CORE] Shutdown executor once we are done decommissioning

2020-07-30 Thread GitBox
SparkQA commented on pull request #29211: URL: https://github.com/apache/spark/pull/29211#issuecomment-666849351 **[Test build #126828 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/126828/testReport)** for PR 29211 at commit

[GitHub] [spark] AmplabJenkins commented on pull request #29270: [SPARK-32466][TEST][SQL] Add PlanStabilitySuite to detect SparkPlan regression

2020-07-30 Thread GitBox
AmplabJenkins commented on pull request #29270: URL: https://github.com/apache/spark/pull/29270#issuecomment-666849192 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] SparkQA commented on pull request #29270: [SPARK-32466][TEST][SQL] Add PlanStabilitySuite to detect SparkPlan regression

2020-07-30 Thread GitBox
SparkQA commented on pull request #29270: URL: https://github.com/apache/spark/pull/29270#issuecomment-666848427 **[Test build #126815 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/126815/testReport)** for PR 29270 at commit

[GitHub] [spark] SparkQA removed a comment on pull request #29270: [SPARK-32466][TEST][SQL] Add PlanStabilitySuite to detect SparkPlan regression

2020-07-30 Thread GitBox
SparkQA removed a comment on pull request #29270: URL: https://github.com/apache/spark/pull/29270#issuecomment-56522 **[Test build #126815 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/126815/testReport)** for PR 29270 at commit

[GitHub] [spark] SparkQA removed a comment on pull request #29211: [SPARK-31197][CORE] Shutdown executor once we are done decommissioning

2020-07-30 Thread GitBox
SparkQA removed a comment on pull request #29211: URL: https://github.com/apache/spark/pull/29211#issuecomment-56362 **[Test build #126816 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/126816/testReport)** for PR 29211 at commit

[GitHub] [spark] SparkQA commented on pull request #29211: [SPARK-31197][CORE] Shutdown executor once we are done decommissioning

2020-07-30 Thread GitBox
SparkQA commented on pull request #29211: URL: https://github.com/apache/spark/pull/29211#issuecomment-666848292 **[Test build #126816 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/126816/testReport)** for PR 29211 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28781: [SPARK-31953][SS] Add Spark Structured Streaming History Server Support

2020-07-30 Thread GitBox
AmplabJenkins removed a comment on pull request #28781: URL: https://github.com/apache/spark/pull/28781#issuecomment-666846473 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] sarutak commented on pull request #29002: [SPARK-32175][CORE] Fix the order between initialization for ExecutorPlugin and starting heartbeat thread

2020-07-30 Thread GitBox
sarutak commented on pull request #29002: URL: https://github.com/apache/spark/pull/29002#issuecomment-666846968 O.K, I'll make a PR for removing it. This is an automated message from the Apache Git Service. To respond to

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28781: [SPARK-31953][SS] Add Spark Structured Streaming History Server Support

2020-07-30 Thread GitBox
AmplabJenkins removed a comment on pull request #28781: URL: https://github.com/apache/spark/pull/28781#issuecomment-666846461 Merged build finished. Test FAILed. This is an automated message from the Apache Git Service. To

[GitHub] [spark] AmplabJenkins commented on pull request #28781: [SPARK-31953][SS] Add Spark Structured Streaming History Server Support

2020-07-30 Thread GitBox
AmplabJenkins commented on pull request #28781: URL: https://github.com/apache/spark/pull/28781#issuecomment-666846461 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] SparkQA commented on pull request #29272: [SPARK-32468][SS][TESTS] Fix timeout config issue in Kafka connector tests

2020-07-30 Thread GitBox
SparkQA commented on pull request #29272: URL: https://github.com/apache/spark/pull/29272#issuecomment-666846618 **[Test build #126827 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/126827/testReport)** for PR 29272 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29146: [SPARK-32257][SQL] Reports explicit errors for invalid usage of SET/RESET command

2020-07-30 Thread GitBox
AmplabJenkins removed a comment on pull request #29146: URL: https://github.com/apache/spark/pull/29146#issuecomment-666845348 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29304: [SPARK-32494][SQL] Null Aware Anti Join Optimize Support Multi-Column

2020-07-30 Thread GitBox
AmplabJenkins removed a comment on pull request #29304: URL: https://github.com/apache/spark/pull/29304#issuecomment-55366 Can one of the admins verify this patch? This is an automated message from the Apache Git

[GitHub] [spark] SparkQA removed a comment on pull request #28781: [SPARK-31953][SS] Add Spark Structured Streaming History Server Support

2020-07-30 Thread GitBox
SparkQA removed a comment on pull request #28781: URL: https://github.com/apache/spark/pull/28781#issuecomment-666708927 **[Test build #126820 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/126820/testReport)** for PR 28781 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29146: [SPARK-32257][SQL] Reports explicit errors for invalid usage of SET/RESET command

2020-07-30 Thread GitBox
AmplabJenkins removed a comment on pull request #29146: URL: https://github.com/apache/spark/pull/29146#issuecomment-666845339 Merged build finished. Test FAILed. This is an automated message from the Apache Git Service. To

[GitHub] [spark] HyukjinKwon commented on pull request #29002: [SPARK-32175][CORE] Fix the order between initialization for ExecutorPlugin and starting heartbeat thread

2020-07-30 Thread GitBox
HyukjinKwon commented on pull request #29002: URL: https://github.com/apache/spark/pull/29002#issuecomment-666845566 Sure, removing sounds fine and simpler to me. This is an automated message from the Apache Git Service. To

[GitHub] [spark] SparkQA commented on pull request #29304: [SPARK-32494][SQL] Null Aware Anti Join Optimize Support Multi-Column

2020-07-30 Thread GitBox
SparkQA commented on pull request #29304: URL: https://github.com/apache/spark/pull/29304#issuecomment-666845557 **[Test build #126826 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/126826/testReport)** for PR 29304 at commit

[GitHub] [spark] SparkQA commented on pull request #28781: [SPARK-31953][SS] Add Spark Structured Streaming History Server Support

2020-07-30 Thread GitBox
SparkQA commented on pull request #28781: URL: https://github.com/apache/spark/pull/28781#issuecomment-666845431 **[Test build #126820 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/126820/testReport)** for PR 28781 at commit

[GitHub] [spark] AmplabJenkins commented on pull request #29146: [SPARK-32257][SQL] Reports explicit errors for invalid usage of SET/RESET command

2020-07-30 Thread GitBox
AmplabJenkins commented on pull request #29146: URL: https://github.com/apache/spark/pull/29146#issuecomment-666845339 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] SparkQA removed a comment on pull request #29146: [SPARK-32257][SQL] Reports explicit errors for invalid usage of SET/RESET command

2020-07-30 Thread GitBox
SparkQA removed a comment on pull request #29146: URL: https://github.com/apache/spark/pull/29146#issuecomment-56415 **[Test build #126817 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/126817/testReport)** for PR 29146 at commit

[GitHub] [spark] SparkQA commented on pull request #29146: [SPARK-32257][SQL] Reports explicit errors for invalid usage of SET/RESET command

2020-07-30 Thread GitBox
SparkQA commented on pull request #29146: URL: https://github.com/apache/spark/pull/29146#issuecomment-666841271 **[Test build #126817 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/126817/testReport)** for PR 29146 at commit

[GitHub] [spark] github-actions[bot] commented on pull request #27345: [SPARK-28554][SQL] JDBC v2 with catalog functionalities

2020-07-30 Thread GitBox
github-actions[bot] commented on pull request #27345: URL: https://github.com/apache/spark/pull/27345#issuecomment-666828418 We're closing this PR because it hasn't been updated in a while. This isn't a judgement on the merit of the PR in any way. It's just a way of keeping the PR queue

[GitHub] [spark] viirya commented on a change in pull request #29067: [SPARK-32274][SQL] Make SQL cache serialization pluggable

2020-07-30 Thread GitBox
viirya commented on a change in pull request #29067: URL: https://github.com/apache/spark/pull/29067#discussion_r463343578 ## File path: sql/core/src/main/scala/org/apache/spark/sql/execution/columnar/InMemoryRelation.scala ## @@ -85,77 +241,96 @@ case class CachedRDDBuilder(

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28902: [SPARK-31801][API][SHUFFLE][TESTS] Tests for registering map output metadata

2020-07-30 Thread GitBox
AmplabJenkins removed a comment on pull request #28902: URL: https://github.com/apache/spark/pull/28902#issuecomment-666818283 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28618: [SPARK-31801][API][SHUFFLE] Register map output metadata

2020-07-30 Thread GitBox
AmplabJenkins removed a comment on pull request #28618: URL: https://github.com/apache/spark/pull/28618#issuecomment-666818215 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins commented on pull request #28902: [SPARK-31801][API][SHUFFLE][TESTS] Tests for registering map output metadata

2020-07-30 Thread GitBox
AmplabJenkins commented on pull request #28902: URL: https://github.com/apache/spark/pull/28902#issuecomment-666818283 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins commented on pull request #28618: [SPARK-31801][API][SHUFFLE] Register map output metadata

2020-07-30 Thread GitBox
AmplabJenkins commented on pull request #28618: URL: https://github.com/apache/spark/pull/28618#issuecomment-666818215 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] viirya commented on a change in pull request #29067: [SPARK-32274][SQL] Make SQL cache serialization pluggable

2020-07-30 Thread GitBox
viirya commented on a change in pull request #29067: URL: https://github.com/apache/spark/pull/29067#discussion_r463340106 ## File path: sql/core/src/main/scala/org/apache/spark/sql/columnar/CachedBatchSerializer.scala ## @@ -0,0 +1,343 @@ +/* + * Licensed to the Apache

[GitHub] [spark] dongjoon-hyun commented on pull request #29312: [SPARK-32503][CORE][TESTS] Add Scala 2.13 `core` and related module test in GitHub Action

2020-07-30 Thread GitBox
dongjoon-hyun commented on pull request #29312: URL: https://github.com/apache/spark/pull/29312#issuecomment-666813280 cc @srowen and @HyukjinKwon `GitHub Action - Scala 2.13` succeeded. This is an automated message from

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29279: [SPARK-31418][CORE][FOLLOW-UP][MINOR] Fix log messages to print stage id instead of the object name

2020-07-30 Thread GitBox
AmplabJenkins removed a comment on pull request #29279: URL: https://github.com/apache/spark/pull/29279#issuecomment-666809920 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] SparkQA commented on pull request #27429: [SPARK-28330][SQL] Support ANSI SQL: result offset clause in query expression

2020-07-30 Thread GitBox
SparkQA commented on pull request #27429: URL: https://github.com/apache/spark/pull/27429#issuecomment-666810499 **[Test build #126825 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/126825/testReport)** for PR 27429 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29279: [SPARK-31418][CORE][FOLLOW-UP][MINOR] Fix log messages to print stage id instead of the object name

2020-07-30 Thread GitBox
AmplabJenkins removed a comment on pull request #29279: URL: https://github.com/apache/spark/pull/29279#issuecomment-666809912 Merged build finished. Test FAILed. This is an automated message from the Apache Git Service. To

[GitHub] [spark] SparkQA removed a comment on pull request #29279: [SPARK-31418][CORE][FOLLOW-UP][MINOR] Fix log messages to print stage id instead of the object name

2020-07-30 Thread GitBox
SparkQA removed a comment on pull request #29279: URL: https://github.com/apache/spark/pull/29279#issuecomment-57480 **[Test build #126811 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/126811/testReport)** for PR 29279 at commit

[GitHub] [spark] AmplabJenkins commented on pull request #29279: [SPARK-31418][CORE][FOLLOW-UP][MINOR] Fix log messages to print stage id instead of the object name

2020-07-30 Thread GitBox
AmplabJenkins commented on pull request #29279: URL: https://github.com/apache/spark/pull/29279#issuecomment-666809912 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] SparkQA commented on pull request #29279: [SPARK-31418][CORE][FOLLOW-UP][MINOR] Fix log messages to print stage id instead of the object name

2020-07-30 Thread GitBox
SparkQA commented on pull request #29279: URL: https://github.com/apache/spark/pull/29279#issuecomment-666807231 **[Test build #126811 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/126811/testReport)** for PR 29279 at commit

[GitHub] [spark] HeartSaVioR edited a comment on pull request #28904: [SPARK-30462][SS] Streamline the logic on file stream source and sink metadata log to avoid memory issue

2020-07-30 Thread GitBox
HeartSaVioR edited a comment on pull request #28904: URL: https://github.com/apache/spark/pull/28904#issuecomment-666770668 > for exactly-once semantics, we can add make changes in ManifestFileCommitter to delete files in the abort function. Or we can come up with some other alternatives.

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28902: [SPARK-31801][API][SHUFFLE][TESTS] Tests for registering map output metadata

2020-07-30 Thread GitBox
AmplabJenkins removed a comment on pull request #28902: URL: https://github.com/apache/spark/pull/28902#issuecomment-666793502 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins commented on pull request #28902: [SPARK-31801][API][SHUFFLE][TESTS] Tests for registering map output metadata

2020-07-30 Thread GitBox
AmplabJenkins commented on pull request #28902: URL: https://github.com/apache/spark/pull/28902#issuecomment-666793502 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] HeartSaVioR edited a comment on pull request #28904: [SPARK-30462][SS] Streamline the logic on file stream source and sink metadata log to avoid memory issue

2020-07-30 Thread GitBox
HeartSaVioR edited a comment on pull request #28904: URL: https://github.com/apache/spark/pull/28904#issuecomment-666770668 > for exactly-once semantics, we can add make changes in ManifestFileCommitter to delete files in the abort function. Or we can come up with some other alternatives.

[GitHub] [spark] HeartSaVioR edited a comment on pull request #28904: [SPARK-30462][SS] Streamline the logic on file stream source and sink metadata log to avoid memory issue

2020-07-30 Thread GitBox
HeartSaVioR edited a comment on pull request #28904: URL: https://github.com/apache/spark/pull/28904#issuecomment-666770668 > for exactly-once semantics, we can add make changes in ManifestFileCommitter to delete files in the abort function. Or we can come up with some other alternatives.

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29291: [SPARK-30276][SQL] Support Filter expression allows simultaneous use of DISTINCT

2020-07-30 Thread GitBox
AmplabJenkins removed a comment on pull request #29291: URL: https://github.com/apache/spark/pull/29291#issuecomment-666775116 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29291: [SPARK-30276][SQL] Support Filter expression allows simultaneous use of DISTINCT

2020-07-30 Thread GitBox
AmplabJenkins removed a comment on pull request #29291: URL: https://github.com/apache/spark/pull/29291#issuecomment-666775108 Merged build finished. Test FAILed. This is an automated message from the Apache Git Service. To

[GitHub] [spark] AmplabJenkins commented on pull request #29291: [SPARK-30276][SQL] Support Filter expression allows simultaneous use of DISTINCT

2020-07-30 Thread GitBox
AmplabJenkins commented on pull request #29291: URL: https://github.com/apache/spark/pull/29291#issuecomment-666775108 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] SparkQA commented on pull request #27432: [SPARK-28325][SQL]Support ANSI SQL: SIMILAR TO ... ESCAPE syntax

2020-07-30 Thread GitBox
SparkQA commented on pull request #27432: URL: https://github.com/apache/spark/pull/27432#issuecomment-666775225 **[Test build #126824 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/126824/testReport)** for PR 27432 at commit

[GitHub] [spark] SparkQA removed a comment on pull request #29291: [SPARK-30276][SQL] Support Filter expression allows simultaneous use of DISTINCT

2020-07-30 Thread GitBox
SparkQA removed a comment on pull request #29291: URL: https://github.com/apache/spark/pull/29291#issuecomment-56318 **[Test build #126810 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/126810/testReport)** for PR 29291 at commit

<    1   2   3   4   5   6   7   8   >