[GitHub] [spark] AmplabJenkins removed a comment on pull request #30066: [SPARK-33239][INFRA] Use pre-built image at GitHub Action SparkR job

AmplabJenkins removed a comment on pull request #30066: URL: https://github.com/apache/spark/pull/30066#issuecomment-716321683 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins commented on pull request #30066: [SPARK-33239][INFRA] Use pre-built image at GitHub Action SparkR job

AmplabJenkins commented on pull request #30066: URL: https://github.com/apache/spark/pull/30066#issuecomment-716321683 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] SparkQA removed a comment on pull request #30066: [SPARK-33239][INFRA] Use pre-built image at GitHub Action SparkR job

SparkQA removed a comment on pull request #30066: URL: https://github.com/apache/spark/pull/30066#issuecomment-716280318 **[Test build #130254 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/130254/testReport)** for PR 30066 at commit

[GitHub] [spark] SparkQA commented on pull request #30066: [SPARK-33239][INFRA] Use pre-built image at GitHub Action SparkR job

SparkQA commented on pull request #30066: URL: https://github.com/apache/spark/pull/30066#issuecomment-716320910 **[Test build #130254 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/130254/testReport)** for PR 30066 at commit

[GitHub] [spark] SparkQA commented on pull request #29421: [SPARK-32388][SQL] TRANSFORM with schema-less mode should keep the same with hive

SparkQA commented on pull request #29421: URL: https://github.com/apache/spark/pull/29421#issuecomment-716316511 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/34857/

[GitHub] [spark] c21 commented on pull request #30076: [SPARK-32862][SS] Left semi stream-stream join

c21 commented on pull request #30076: URL: https://github.com/apache/spark/pull/30076#issuecomment-716315794 Thank you @HeartSaVioR , @xuanyuanking and @viirya for review! This is an automated message from the Apache Git

[GitHub] [spark] mridulm commented on pull request #30131: [SPARK-33220][CORE]Use `scheduleWithFixedDelay` to avoid repeated unnecessary scheduling for a short time

mridulm commented on pull request #30131: URL: https://github.com/apache/spark/pull/30131#issuecomment-716312657 > > If we want to take a look at the jdk implementation in case the documentation is unclear, please note that both `scheduleAtFixedRate` and `scheduleWithFixedDelay` rely on

[GitHub] [spark] AmplabJenkins removed a comment on pull request #30076: [SPARK-32862][SS] Left semi stream-stream join

AmplabJenkins removed a comment on pull request #30076: URL: https://github.com/apache/spark/pull/30076#issuecomment-716309131 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29414: [SPARK-32106][SQL] Implement script transform in sql/core

AmplabJenkins removed a comment on pull request #29414: URL: https://github.com/apache/spark/pull/29414#issuecomment-716309205 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins commented on pull request #30076: [SPARK-32862][SS] Left semi stream-stream join

AmplabJenkins commented on pull request #30076: URL: https://github.com/apache/spark/pull/30076#issuecomment-716309131 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] SparkQA commented on pull request #29414: [SPARK-32106][SQL] Implement script transform in sql/core

SparkQA commented on pull request #29414: URL: https://github.com/apache/spark/pull/29414#issuecomment-716309194 Kubernetes integration test status success URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/34856/

[GitHub] [spark] AmplabJenkins commented on pull request #29414: [SPARK-32106][SQL] Implement script transform in sql/core

AmplabJenkins commented on pull request #29414: URL: https://github.com/apache/spark/pull/29414#issuecomment-716309205 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] SparkQA removed a comment on pull request #30076: [SPARK-32862][SS] Left semi stream-stream join

SparkQA removed a comment on pull request #30076: URL: https://github.com/apache/spark/pull/30076#issuecomment-716242211 **[Test build #130248 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/130248/testReport)** for PR 30076 at commit

[GitHub] [spark] SparkQA commented on pull request #30076: [SPARK-32862][SS] Left semi stream-stream join

SparkQA commented on pull request #30076: URL: https://github.com/apache/spark/pull/30076#issuecomment-716308498 **[Test build #130248 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/130248/testReport)** for PR 30076 at commit

[GitHub] [spark] SparkQA commented on pull request #29421: [SPARK-32388][SQL] TRANSFORM with schema-less mode should keep the same with hive

SparkQA commented on pull request #29421: URL: https://github.com/apache/spark/pull/29421#issuecomment-716305927 **[Test build #130257 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/130257/testReport)** for PR 29421 at commit

[GitHub] [spark] AngersZhuuuu commented on pull request #29421: [SPARK-32388][SQL] TRANSFORM with schema-less mode should keep the same with hive

AngersZh commented on pull request #29421: URL: https://github.com/apache/spark/pull/29421#issuecomment-716303410 retest this please This is an automated message from the Apache Git Service. To respond to the message,

[GitHub] [spark] SparkQA commented on pull request #29414: [SPARK-32106][SQL] Implement script transform in sql/core

SparkQA commented on pull request #29414: URL: https://github.com/apache/spark/pull/29414#issuecomment-716302654 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/34856/

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29421: [SPARK-32388][SQL] TRANSFORM with schema-less mode should keep the same with hive

AmplabJenkins removed a comment on pull request #29421: URL: https://github.com/apache/spark/pull/29421#issuecomment-716301727 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29421: [SPARK-32388][SQL] TRANSFORM with schema-less mode should keep the same with hive

AmplabJenkins removed a comment on pull request #29421: URL: https://github.com/apache/spark/pull/29421#issuecomment-716301724 Merged build finished. Test FAILed. This is an automated message from the Apache Git Service. To

[GitHub] [spark] SparkQA removed a comment on pull request #29421: [SPARK-32388][SQL] TRANSFORM with schema-less mode should keep the same with hive

SparkQA removed a comment on pull request #29421: URL: https://github.com/apache/spark/pull/29421#issuecomment-716274757 **[Test build #130253 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/130253/testReport)** for PR 29421 at commit

[GitHub] [spark] AmplabJenkins commented on pull request #29421: [SPARK-32388][SQL] TRANSFORM with schema-less mode should keep the same with hive

AmplabJenkins commented on pull request #29421: URL: https://github.com/apache/spark/pull/29421#issuecomment-716301724 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] SparkQA commented on pull request #29421: [SPARK-32388][SQL] TRANSFORM with schema-less mode should keep the same with hive

SparkQA commented on pull request #29421: URL: https://github.com/apache/spark/pull/29421#issuecomment-716301628 **[Test build #130253 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/130253/testReport)** for PR 29421 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #30066: [SPARK-33239][INFRA] Use pre-built image at GitHub Action SparkR job

AmplabJenkins removed a comment on pull request #30066: URL: https://github.com/apache/spark/pull/30066#issuecomment-716298050 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] HyukjinKwon commented on a change in pull request #30066: [SPARK-33239][INFRA] Use pre-built image at GitHub Action SparkR job

HyukjinKwon commented on a change in pull request #30066: URL: https://github.com/apache/spark/pull/30066#discussion_r511717010 ## File path: .github/workflows/build_and_test.yml ## @@ -138,20 +136,6 @@ jobs: run: | python3.8 -m pip install numpy

[GitHub] [spark] AmplabJenkins commented on pull request #30066: [SPARK-33239][INFRA] Use pre-built image at GitHub Action SparkR job

AmplabJenkins commented on pull request #30066: URL: https://github.com/apache/spark/pull/30066#issuecomment-716298050 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] SparkQA commented on pull request #30066: [SPARK-33239][INFRA] Use pre-built image at GitHub Action SparkR job

SparkQA commented on pull request #30066: URL: https://github.com/apache/spark/pull/30066#issuecomment-716298037 Kubernetes integration test status success URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/34854/

[GitHub] [spark] HyukjinKwon commented on a change in pull request #30066: [SPARK-33239][INFRA] Use pre-built image at GitHub Action SparkR job

HyukjinKwon commented on a change in pull request #30066: URL: https://github.com/apache/spark/pull/30066#discussion_r511715720 ## File path: .github/workflows/build_and_test.yml ## @@ -260,6 +244,68 @@ jobs: name: unit-tests-log-${{ matrix.modules

[GitHub] [spark] HyukjinKwon commented on a change in pull request #30066: [SPARK-33239][INFRA] Use pre-built image at GitHub Action SparkR job

-hive2.3 path: "**/target/unit-tests.log" + sparkr: +name: Build modules - sparkr +runs-on: ubuntu-20.04 +container: + image: dongjoon/apache-spark-github-action-image:20201025 +env: + HADOOP_PROFILE: hadoop3.2 + HIVE_PROFILE: hive2.3 + GITHU

[GitHub] [spark] HeartSaVioR commented on pull request #30076: [SPARK-32862][SS] Left semi stream-stream join

HeartSaVioR commented on pull request #30076: URL: https://github.com/apache/spark/pull/30076#issuecomment-716297489 Thanks for your contribution! Merged into master. This is an automated message from the Apache Git Service.

[GitHub] [spark] HyukjinKwon commented on a change in pull request #30066: [SPARK-33239][INFRA] Use pre-built image at GitHub Action SparkR job

-hive2.3 path: "**/target/unit-tests.log" + sparkr: +name: Build modules - sparkr +runs-on: ubuntu-20.04 +container: + image: dongjoon/apache-spark-github-action-image:20201025 +env: + HADOOP_PROFILE: hadoop3.2 + HIVE_PROFILE: hive2.3 + GITHU

[GitHub] [spark] HeartSaVioR closed pull request #30076: [SPARK-32862][SS] Left semi stream-stream join

HeartSaVioR closed pull request #30076: URL: https://github.com/apache/spark/pull/30076 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to

[GitHub] [spark] HeartSaVioR commented on pull request #30076: [SPARK-32862][SS] Left semi stream-stream join

HeartSaVioR commented on pull request #30076: URL: https://github.com/apache/spark/pull/30076#issuecomment-716297080 Thanks, merging to master. This is an automated message from the Apache Git Service. To respond to the

[GitHub] [spark] dongjoon-hyun commented on pull request #30066: [SPARK-33239][INFRA] Use pre-built image at GitHub Action SparkR job

dongjoon-hyun commented on pull request #30066: URL: https://github.com/apache/spark/pull/30066#issuecomment-716293050 Also, could you review this PR, @maropu ? This is an automated message from the Apache Git Service. To

[GitHub] [spark] leanken commented on a change in pull request #30097: [SPARK-33140][SQL] remove SQLConf and SparkSession in all sub-class of Rule[QueryPlan]

leanken commented on a change in pull request #30097: URL: https://github.com/apache/spark/pull/30097#discussion_r511711363 ## File path: sql/hive/src/main/scala/org/apache/spark/sql/hive/execution/PruneHiveTablePartitions.scala ## @@ -29,22 +29,9 @@ import

[GitHub] [spark] SparkQA commented on pull request #30066: [SPARK-33239][INFRA] Use pre-built image at GitHub Action SparkR job

SparkQA commented on pull request #30066: URL: https://github.com/apache/spark/pull/30066#issuecomment-716292237 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/34854/

[GitHub] [spark] leanken commented on a change in pull request #30097: [SPARK-33140][SQL] remove SQLConf and SparkSession in all sub-class of Rule[QueryPlan]

leanken commented on a change in pull request #30097: URL: https://github.com/apache/spark/pull/30097#discussion_r511710832 ## File path: sql/hive/src/main/scala/org/apache/spark/sql/hive/execution/PruneHiveTablePartitions.scala ## @@ -29,22 +29,9 @@ import

[GitHub] [spark] leanken commented on a change in pull request #30097: [SPARK-33140][SQL] remove SQLConf and SparkSession in all sub-class of Rule[QueryPlan]

leanken commented on a change in pull request #30097: URL: https://github.com/apache/spark/pull/30097#discussion_r511710003 ## File path: sql/hive/src/main/scala/org/apache/spark/sql/hive/execution/PruneHiveTablePartitions.scala ## @@ -29,22 +29,9 @@ import

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29414: [SPARK-32106][SQL] Implement script transform in sql/core

AmplabJenkins removed a comment on pull request #29414: URL: https://github.com/apache/spark/pull/29414#issuecomment-716290318 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] SparkQA commented on pull request #29414: [SPARK-32106][SQL] Implement script transform in sql/core

SparkQA commented on pull request #29414: URL: https://github.com/apache/spark/pull/29414#issuecomment-716290703 **[Test build #130256 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/130256/testReport)** for PR 29414 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29414: [SPARK-32106][SQL] Implement script transform in sql/core

AmplabJenkins removed a comment on pull request #29414: URL: https://github.com/apache/spark/pull/29414#issuecomment-716290315 Merged build finished. Test FAILed. This is an automated message from the Apache Git Service. To

[GitHub] [spark] AmplabJenkins commented on pull request #29414: [SPARK-32106][SQL] Implement script transform in sql/core

AmplabJenkins commented on pull request #29414: URL: https://github.com/apache/spark/pull/29414#issuecomment-716290315 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29421: [SPARK-32388][SQL] TRANSFORM with schema-less mode should keep the same with hive

AmplabJenkins removed a comment on pull request #29421: URL: https://github.com/apache/spark/pull/29421#issuecomment-716289882 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] SparkQA commented on pull request #29421: [SPARK-32388][SQL] TRANSFORM with schema-less mode should keep the same with hive

SparkQA commented on pull request #29421: URL: https://github.com/apache/spark/pull/29421#issuecomment-716289872 Kubernetes integration test status success URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/34853/

[GitHub] [spark] AmplabJenkins commented on pull request #29421: [SPARK-32388][SQL] TRANSFORM with schema-less mode should keep the same with hive

AmplabJenkins commented on pull request #29421: URL: https://github.com/apache/spark/pull/29421#issuecomment-716289882 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] dongjoon-hyun commented on pull request #30066: [SPARK-33239][INFRA] Use pre-built image at GitHub Action SparkR job

dongjoon-hyun commented on pull request #30066: URL: https://github.com/apache/spark/pull/30066#issuecomment-716289583 This is ready for review. Could you review this please, @HyukjinKwon ? This is an automated message from

[GitHub] [spark] leanken commented on a change in pull request #30097: [SPARK-33140][SQL] remove SQLConf and SparkSession in all sub-class of Rule[QueryPlan]

leanken commented on a change in pull request #30097: URL: https://github.com/apache/spark/pull/30097#discussion_r511708600 ## File path: sql/hive/src/main/scala/org/apache/spark/sql/hive/execution/PruneHiveTablePartitions.scala ## @@ -29,22 +29,9 @@ import

[GitHub] [spark] leanken commented on a change in pull request #30097: [SPARK-33140][SQL] remove SQLConf and SparkSession in all sub-class of Rule[QueryPlan]

leanken commented on a change in pull request #30097: URL: https://github.com/apache/spark/pull/30097#discussion_r511708238 ## File path: sql/hive/src/main/scala/org/apache/spark/sql/hive/execution/PruneHiveTablePartitions.scala ## @@ -29,22 +29,9 @@ import

[GitHub] [spark] AmplabJenkins removed a comment on pull request #30076: [SPARK-32862][SS] Left semi stream-stream join

AmplabJenkins removed a comment on pull request #30076: URL: https://github.com/apache/spark/pull/30076#issuecomment-716287855 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins commented on pull request #30076: [SPARK-32862][SS] Left semi stream-stream join

AmplabJenkins commented on pull request #30076: URL: https://github.com/apache/spark/pull/30076#issuecomment-716287855 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] SparkQA removed a comment on pull request #30076: [SPARK-32862][SS] Left semi stream-stream join

SparkQA removed a comment on pull request #30076: URL: https://github.com/apache/spark/pull/30076#issuecomment-716228578 **[Test build #130246 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/130246/testReport)** for PR 30076 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29414: [SPARK-32106][SQL] Implement script transform in sql/core

AmplabJenkins removed a comment on pull request #29414: URL: https://github.com/apache/spark/pull/29414#issuecomment-716287272 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29414: [SPARK-32106][SQL] Implement script transform in sql/core

AmplabJenkins removed a comment on pull request #29414: URL: https://github.com/apache/spark/pull/29414#issuecomment-716287269 Merged build finished. Test FAILed. This is an automated message from the Apache Git Service. To

[GitHub] [spark] AmplabJenkins commented on pull request #29414: [SPARK-32106][SQL] Implement script transform in sql/core

AmplabJenkins commented on pull request #29414: URL: https://github.com/apache/spark/pull/29414#issuecomment-716287269 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] SparkQA commented on pull request #29414: [SPARK-32106][SQL] Implement script transform in sql/core

SparkQA commented on pull request #29414: URL: https://github.com/apache/spark/pull/29414#issuecomment-716287256 **[Test build #130255 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/130255/testReport)** for PR 29414 at commit

[GitHub] [spark] SparkQA commented on pull request #30076: [SPARK-32862][SS] Left semi stream-stream join

SparkQA commented on pull request #30076: URL: https://github.com/apache/spark/pull/30076#issuecomment-716287424 **[Test build #130246 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/130246/testReport)** for PR 30076 at commit

[GitHub] [spark] SparkQA removed a comment on pull request #29414: [SPARK-32106][SQL] Implement script transform in sql/core

SparkQA removed a comment on pull request #29414: URL: https://github.com/apache/spark/pull/29414#issuecomment-716285553 **[Test build #130255 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/130255/testReport)** for PR 29414 at commit

[GitHub] [spark] SparkQA removed a comment on pull request #30066: [SPARK-33239][INFRA] Use pre-built image at GitHub Action SparkR job

SparkQA removed a comment on pull request #30066: URL: https://github.com/apache/spark/pull/30066#issuecomment-716245284 **[Test build #130250 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/130250/testReport)** for PR 30066 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #30066: [SPARK-33239][INFRA] Use pre-built image at GitHub Action SparkR job

AmplabJenkins removed a comment on pull request #30066: URL: https://github.com/apache/spark/pull/30066#issuecomment-716282855 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29421: [SPARK-32388][SQL] TRANSFORM with schema-less mode should keep the same with hive

AmplabJenkins removed a comment on pull request #29421: URL: https://github.com/apache/spark/pull/29421#issuecomment-716275940 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] SparkQA commented on pull request #29414: [SPARK-32106][SQL] Implement script transform in sql/core

SparkQA commented on pull request #29414: URL: https://github.com/apache/spark/pull/29414#issuecomment-716285553 **[Test build #130255 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/130255/testReport)** for PR 29414 at commit

[GitHub] [spark] SparkQA commented on pull request #29421: [SPARK-32388][SQL] TRANSFORM with schema-less mode should keep the same with hive

SparkQA commented on pull request #29421: URL: https://github.com/apache/spark/pull/29421#issuecomment-716284975 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/34853/

[GitHub] [spark] AngersZhuuuu commented on pull request #29414: [SPARK-32106][SQL] Implement script transform in sql/core

AngersZh commented on pull request #29414: URL: https://github.com/apache/spark/pull/29414#issuecomment-716284549 retest this please This is an automated message from the Apache Git Service. To respond to the message,

[GitHub] [spark] huaxingao commented on a change in pull request #30089: [SPARK-33137][SQL] Support ALTER TABLE in JDBC v2 Table Catalog: update type and nullability of columns (Postgres dialect)

huaxingao commented on a change in pull request #30089: URL: https://github.com/apache/spark/pull/30089#discussion_r511704724 ## File path: external/docker-integration-tests/src/test/scala/org/apache/spark/sql/jdbc/v2/DB2IntegrationSuite.scala ## @@ -30,7 +30,7 @@ import

[GitHub] [spark] AmplabJenkins commented on pull request #30066: [SPARK-33239][INFRA] Use pre-built image at GitHub Action SparkR job

AmplabJenkins commented on pull request #30066: URL: https://github.com/apache/spark/pull/30066#issuecomment-716282855 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] SparkQA commented on pull request #30066: [SPARK-33239][INFRA] Use pre-built image at GitHub Action SparkR job

SparkQA commented on pull request #30066: URL: https://github.com/apache/spark/pull/30066#issuecomment-716282336 **[Test build #130250 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/130250/testReport)** for PR 30066 at commit

[GitHub] [spark] HyukjinKwon commented on a change in pull request #30089: [SPARK-33137][SQL] Support ALTER TABLE in JDBC v2 Table Catalog: update type and nullability of columns (Postgres dialect)

HyukjinKwon commented on a change in pull request #30089: URL: https://github.com/apache/spark/pull/30089#discussion_r511702557 ## File path: external/docker-integration-tests/src/test/scala/org/apache/spark/sql/jdbc/v2/DB2IntegrationSuite.scala ## @@ -30,7 +30,7 @@ import

[GitHub] [spark] dongjoon-hyun commented on pull request #30123: [SPARK-33234][INFRA] Generates SHA-512 using shasum

dongjoon-hyun commented on pull request #30123: URL: https://github.com/apache/spark/pull/30123#issuecomment-716281394 Your Apache JIRA ID, @emilianbold . As a recognition of your contribution, I want to assign SPARK-33234 to you as @HyukjinKwon explained.

[GitHub] [spark] huaxingao commented on a change in pull request #30089: [SPARK-33137][SQL] Support ALTER TABLE in JDBC v2 Table Catalog: update type and nullability of columns (Postgres dialect)

huaxingao commented on a change in pull request #30089: URL: https://github.com/apache/spark/pull/30089#discussion_r511702052 ## File path: external/docker-integration-tests/src/test/scala/org/apache/spark/sql/jdbc/v2/DB2IntegrationSuite.scala ## @@ -30,7 +30,7 @@ import

[GitHub] [spark] SparkQA commented on pull request #30066: [SPARK-33239][INFRA] Use pre-built image at GitHub Action SparkR job

SparkQA commented on pull request #30066: URL: https://github.com/apache/spark/pull/30066#issuecomment-716280318 **[Test build #130254 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/130254/testReport)** for PR 30066 at commit

[GitHub] [spark] SparkQA removed a comment on pull request #30066: [SPARK-33239][INFRA] Use pre-built image at GitHub Action SparkR job

SparkQA removed a comment on pull request #30066: URL: https://github.com/apache/spark/pull/30066#issuecomment-710692108 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] SparkQA removed a comment on pull request #30066: [SPARK-33239][INFRA] Use pre-built image at GitHub Action SparkR job

SparkQA removed a comment on pull request #30066: URL: https://github.com/apache/spark/pull/30066#issuecomment-710637015 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] SparkQA removed a comment on pull request #30066: [SPARK-33239][INFRA] Use pre-built image at GitHub Action SparkR job

SparkQA removed a comment on pull request #30066: URL: https://github.com/apache/spark/pull/30066#issuecomment-710573048 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] SparkQA removed a comment on pull request #30066: [SPARK-33239][INFRA] Use pre-built image at GitHub Action SparkR job

SparkQA removed a comment on pull request #30066: URL: https://github.com/apache/spark/pull/30066#issuecomment-710540563 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/34518/

[GitHub] [spark] AmplabJenkins removed a comment on pull request #30062: [SPARK-32916][SHUFFLE] Implementation of shuffle service that leverages push-based shuffle in YARN deployment mode

AmplabJenkins removed a comment on pull request #30062: URL: https://github.com/apache/spark/pull/30062#issuecomment-716277661 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins commented on pull request #30062: [SPARK-32916][SHUFFLE] Implementation of shuffle service that leverages push-based shuffle in YARN deployment mode

AmplabJenkins commented on pull request #30062: URL: https://github.com/apache/spark/pull/30062#issuecomment-716277661 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] SparkQA commented on pull request #30062: [SPARK-32916][SHUFFLE] Implementation of shuffle service that leverages push-based shuffle in YARN deployment mode

SparkQA commented on pull request #30062: URL: https://github.com/apache/spark/pull/30062#issuecomment-716276971 **[Test build #130247 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/130247/testReport)** for PR 30062 at commit

[GitHub] [spark] SparkQA removed a comment on pull request #30062: [SPARK-32916][SHUFFLE] Implementation of shuffle service that leverages push-based shuffle in YARN deployment mode

SparkQA removed a comment on pull request #30062: URL: https://github.com/apache/spark/pull/30062#issuecomment-716238477 **[Test build #130247 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/130247/testReport)** for PR 30062 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29421: [SPARK-32388][SQL] TRANSFORM with schema-less mode should keep the same with hive

AmplabJenkins removed a comment on pull request #29421: URL: https://github.com/apache/spark/pull/29421#issuecomment-716275937 Merged build finished. Test FAILed. This is an automated message from the Apache Git Service. To

[GitHub] [spark] AmplabJenkins commented on pull request #29421: [SPARK-32388][SQL] TRANSFORM with schema-less mode should keep the same with hive

AmplabJenkins commented on pull request #29421: URL: https://github.com/apache/spark/pull/29421#issuecomment-716275937 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] SparkQA commented on pull request #29421: [SPARK-32388][SQL] TRANSFORM with schema-less mode should keep the same with hive

SparkQA commented on pull request #29421: URL: https://github.com/apache/spark/pull/29421#issuecomment-716274757 **[Test build #130253 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/130253/testReport)** for PR 29421 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29421: [SPARK-32388][SQL] TRANSFORM with schema-less mode should keep the same with hive

AmplabJenkins removed a comment on pull request #29421: URL: https://github.com/apache/spark/pull/29421#issuecomment-716273345 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] SparkQA removed a comment on pull request #29421: [SPARK-32388][SQL] TRANSFORM with schema-less mode should keep the same with hive

SparkQA removed a comment on pull request #29421: URL: https://github.com/apache/spark/pull/29421#issuecomment-716271359 **[Test build #130252 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/130252/testReport)** for PR 29421 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29421: [SPARK-32388][SQL] TRANSFORM with schema-less mode should keep the same with hive

AmplabJenkins removed a comment on pull request #29421: URL: https://github.com/apache/spark/pull/29421#issuecomment-716273343 Merged build finished. Test FAILed. This is an automated message from the Apache Git Service. To

[GitHub] [spark] SparkQA commented on pull request #29421: [SPARK-32388][SQL] TRANSFORM with schema-less mode should keep the same with hive

SparkQA commented on pull request #29421: URL: https://github.com/apache/spark/pull/29421#issuecomment-716273330 **[Test build #130252 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/130252/testReport)** for PR 29421 at commit

[GitHub] [spark] AmplabJenkins commented on pull request #29421: [SPARK-32388][SQL] TRANSFORM with schema-less mode should keep the same with hive

AmplabJenkins commented on pull request #29421: URL: https://github.com/apache/spark/pull/29421#issuecomment-716273343 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] SparkQA commented on pull request #29421: [SPARK-32388][SQL] TRANSFORM with schema-less mode should keep the same with hive

SparkQA commented on pull request #29421: URL: https://github.com/apache/spark/pull/29421#issuecomment-716271359 **[Test build #130252 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/130252/testReport)** for PR 29421 at commit

[GitHub] [spark] HyukjinKwon edited a comment on pull request #29421: [SPARK-32388][SQL] TRANSFORM with schema-less mode should keep the same with hive

HyukjinKwon edited a comment on pull request #29421: URL: https://github.com/apache/spark/pull/29421#issuecomment-716270048 Ooops, @AngersZh, seems like it has a bit of conflicts with

[GitHub] [spark] AmplabJenkins removed a comment on pull request #30009: [SPARK-32907][ML] adaptively blockify instances - LinearSVC

AmplabJenkins removed a comment on pull request #30009: URL: https://github.com/apache/spark/pull/30009#issuecomment-716271105 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins commented on pull request #30009: [SPARK-32907][ML] adaptively blockify instances - LinearSVC

AmplabJenkins commented on pull request #30009: URL: https://github.com/apache/spark/pull/30009#issuecomment-716271105 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AngersZhuuuu commented on pull request #29421: [SPARK-32388][SQL] TRANSFORM with schema-less mode should keep the same with hive

AngersZh commented on pull request #29421: URL: https://github.com/apache/spark/pull/29421#issuecomment-716270907 > I reverted at [369cc61](https://github.com/apache/spark/commit/369cc614f369f9fd9be5b13a3f047a261c8e8d90). Mind fixing it to make the tests pass? Sure, I'll take

[GitHub] [spark] SparkQA removed a comment on pull request #30009: [SPARK-32907][ML] adaptively blockify instances - LinearSVC

SparkQA removed a comment on pull request #30009: URL: https://github.com/apache/spark/pull/30009#issuecomment-716253408 **[Test build #130251 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/130251/testReport)** for PR 30009 at commit

[GitHub] [spark] SparkQA commented on pull request #30009: [SPARK-32907][ML] adaptively blockify instances - LinearSVC

SparkQA commented on pull request #30009: URL: https://github.com/apache/spark/pull/30009#issuecomment-716270883 **[Test build #130251 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/130251/testReport)** for PR 30009 at commit

[GitHub] [spark] viirya commented on a change in pull request #30097: [SPARK-33140][SQL] remove SQLConf and SparkSession in all sub-class of Rule[QueryPlan]

viirya commented on a change in pull request #30097: URL: https://github.com/apache/spark/pull/30097#discussion_r511693300 ## File path: sql/hive/src/main/scala/org/apache/spark/sql/hive/execution/PruneHiveTablePartitions.scala ## @@ -29,22 +29,9 @@ import

[GitHub] [spark] AngersZhuuuu opened a new pull request #29421: [SPARK-32388][SQL] TRANSFORM with schema-less mode should keep the same with hive

AngersZh opened a new pull request #29421: URL: https://github.com/apache/spark/pull/29421 ### What changes were proposed in this pull request? In current Spark script transformation with hive serde mode, in case of schema less, result is different with hive. This pr to keep

[GitHub] [spark] HyukjinKwon commented on pull request #29421: [SPARK-32388][SQL] TRANSFORM with schema-less mode should keep the same with hive

HyukjinKwon commented on pull request #29421: URL: https://github.com/apache/spark/pull/29421#issuecomment-716270597 I reverted at https://github.com/apache/spark/commit/369cc614f369f9fd9be5b13a3f047a261c8e8d90. Mind fixing it to make the tests pass?

[GitHub] [spark] HyukjinKwon edited a comment on pull request #29421: [SPARK-32388][SQL] TRANSFORM with schema-less mode should keep the same with hive

HyukjinKwon edited a comment on pull request #29421: URL: https://github.com/apache/spark/pull/29421#issuecomment-716270048 Ooops, @AngersZh, seems like it has a bit of conflicts with

[GitHub] [spark] HyukjinKwon commented on pull request #29421: [SPARK-32388][SQL] TRANSFORM with schema-less mode should keep the same with hive

HyukjinKwon commented on pull request #29421: URL: https://github.com/apache/spark/pull/29421#issuecomment-716270048 Ooops, @AngersZh, seems like it has a bit of conflicts with

[GitHub] [spark] AngersZhuuuu edited a comment on pull request #30131: [SPARK-33220][CORE]Use `scheduleWithFixedDelay` to avoid repeated unnecessary scheduling for a short time

AngersZh edited a comment on pull request #30131: URL: https://github.com/apache/spark/pull/30131#issuecomment-716268687 > If we want to take a look at the jdk implementation in case the documentation is unclear, please note that both `scheduleAtFixedRate` and `scheduleWithFixedDelay`

[GitHub] [spark] AmplabJenkins removed a comment on pull request #30009: [SPARK-32907][ML] adaptively blockify instances - LinearSVC

AmplabJenkins removed a comment on pull request #30009: URL: https://github.com/apache/spark/pull/30009#issuecomment-716268740 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins commented on pull request #30009: [SPARK-32907][ML] adaptively blockify instances - LinearSVC

AmplabJenkins commented on pull request #30009: URL: https://github.com/apache/spark/pull/30009#issuecomment-716268740 This is an automated message from the Apache Git Service. To respond to the message, please log on to

  1   2   3   >