[GitHub] [spark] HyukjinKwon commented on a change in pull request #33379: [SPARK-35810][PYTHON] Deprecate ps.broadcast API

HyukjinKwon commented on a change in pull request #33379: URL: https://github.com/apache/spark/pull/33379#discussion_r671617277 ## File path: python/pyspark/pandas/generic.py ## @@ -860,6 +860,11 @@ def to_csv( ) if num_files is not None: +

[GitHub] [spark] HyukjinKwon commented on pull request #33370: [SPARK-36163][SQL] Propagate correct JDBC properties in JDBC connector provider and add "connectionProvider" option

HyukjinKwon commented on pull request #33370: URL: https://github.com/apache/spark/pull/33370#issuecomment-881834787 Yeah I think it should better be lazy val -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL

[GitHub] [spark] chiragsanghvi18 commented on pull request #24062: [SPARK-26594][SQL] DataSourceOptions.asMap should return CaseInsensitiveMap

chiragsanghvi18 commented on pull request #24062: URL: https://github.com/apache/spark/pull/24062#issuecomment-881833399 > Hi, @chiragsanghvi18 . It sounds like a git command question instead of Apache Spark question. > > > This File DataSourceOptions, what is it renamed as in

[GitHub] [spark] SparkQA commented on pull request #31522: [SPARK-34399][SQL] Add commit duration to SQL tab's graph node.

SparkQA commented on pull request #31522: URL: https://github.com/apache/spark/pull/31522#issuecomment-881833261 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/45710/ -- This is an automated message from the Apache

[GitHub] [spark] mridulm commented on pull request #33378: [SPARK-32922][SHUFFLE][CORE][FOLLOWUP] Fixes few issues when the executor tries to fetch push-merged blocks

mridulm commented on pull request #33378: URL: https://github.com/apache/spark/pull/33378#issuecomment-881833078 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To

[GitHub] [spark] asfgit closed pull request #33378: [SPARK-32922][SHUFFLE][CORE][FOLLOWUP] Fixes few issues when the executor tries to fetch push-merged blocks

asfgit closed pull request #33378: URL: https://github.com/apache/spark/pull/33378 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [spark] mridulm commented on pull request #32401: [SPARK-35276][CORE] Calculate checksum for shuffle data and write as checksum file

mridulm commented on pull request #32401: URL: https://github.com/apache/spark/pull/32401#issuecomment-881832639 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To

[GitHub] [spark] asfgit closed pull request #32401: [SPARK-35276][CORE] Calculate checksum for shuffle data and write as checksum file

asfgit closed pull request #32401: URL: https://github.com/apache/spark/pull/32401 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [spark] AmplabJenkins removed a comment on pull request #33379: [SPARK-35810][PYTHON] Deprecate ps.broadcast API

AmplabJenkins removed a comment on pull request #33379: URL: https://github.com/apache/spark/pull/33379#issuecomment-881828568 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/45708/

[GitHub] [spark] SparkQA commented on pull request #33379: [SPARK-35810][PYTHON] Deprecate ps.broadcast API

SparkQA commented on pull request #33379: URL: https://github.com/apache/spark/pull/33379#issuecomment-881828563 Kubernetes integration test status success URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/45708/ -- This is an automated message from the

[GitHub] [spark] AmplabJenkins commented on pull request #33379: [SPARK-35810][PYTHON] Deprecate ps.broadcast API

AmplabJenkins commented on pull request #33379: URL: https://github.com/apache/spark/pull/33379#issuecomment-881828568 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/45708/ --

[GitHub] [spark] SparkQA commented on pull request #31522: [SPARK-34399][SQL] Add commit duration to SQL tab's graph node.

SparkQA commented on pull request #31522: URL: https://github.com/apache/spark/pull/31522#issuecomment-881827705 **[Test build #141198 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/141198/testReport)** for PR 31522 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #33200: [SPARK-36006][SQL] Migrate ALTER TABLE ... ADD/REPLACE COLUMNS commands to use UnresolvedTable to resolve the identifier

AmplabJenkins removed a comment on pull request #33200: URL: https://github.com/apache/spark/pull/33200#issuecomment-881826397 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/141192/

[GitHub] [spark] AmplabJenkins removed a comment on pull request #31522: [SPARK-34399][SQL] Add commit duration to SQL tab's graph node.

AmplabJenkins removed a comment on pull request #31522: URL: https://github.com/apache/spark/pull/31522#issuecomment-881826398 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/141194/

[GitHub] [spark] AmplabJenkins removed a comment on pull request #33352: [SPARK-34952][SQL] DSv2 Aggregate push down APIs

AmplabJenkins removed a comment on pull request #33352: URL: https://github.com/apache/spark/pull/33352#issuecomment-881826396 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/45709/

[GitHub] [spark] AmplabJenkins removed a comment on pull request #33379: [SPARK-35810][PYTHON] Deprecate ps.broadcast API

AmplabJenkins removed a comment on pull request #33379: URL: https://github.com/apache/spark/pull/33379#issuecomment-881826399 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/141196/

[GitHub] [spark] AmplabJenkins commented on pull request #33200: [SPARK-36006][SQL] Migrate ALTER TABLE ... ADD/REPLACE COLUMNS commands to use UnresolvedTable to resolve the identifier

AmplabJenkins commented on pull request #33200: URL: https://github.com/apache/spark/pull/33200#issuecomment-881826397 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/141192/ -- This

[GitHub] [spark] AmplabJenkins commented on pull request #33379: [SPARK-35810][PYTHON] Deprecate ps.broadcast API

AmplabJenkins commented on pull request #33379: URL: https://github.com/apache/spark/pull/33379#issuecomment-881826399 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/141196/ -- This

[GitHub] [spark] AmplabJenkins commented on pull request #33352: [SPARK-34952][SQL] DSv2 Aggregate push down APIs

AmplabJenkins commented on pull request #33352: URL: https://github.com/apache/spark/pull/33352#issuecomment-881826396 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/45709/ --

[GitHub] [spark] AmplabJenkins commented on pull request #31522: [SPARK-34399][SQL] Add commit duration to SQL tab's graph node.

AmplabJenkins commented on pull request #31522: URL: https://github.com/apache/spark/pull/31522#issuecomment-881826398 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/141194/ -- This

[GitHub] [spark] SparkQA removed a comment on pull request #33200: [SPARK-36006][SQL] Migrate ALTER TABLE ... ADD/REPLACE COLUMNS commands to use UnresolvedTable to resolve the identifier

SparkQA removed a comment on pull request #33200: URL: https://github.com/apache/spark/pull/33200#issuecomment-881776808 **[Test build #141192 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/141192/testReport)** for PR 33200 at commit

[GitHub] [spark] SparkQA commented on pull request #33200: [SPARK-36006][SQL] Migrate ALTER TABLE ... ADD/REPLACE COLUMNS commands to use UnresolvedTable to resolve the identifier

SparkQA commented on pull request #33200: URL: https://github.com/apache/spark/pull/33200#issuecomment-881816727 **[Test build #141192 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/141192/testReport)** for PR 33200 at commit

[GitHub] [spark] SparkQA commented on pull request #33352: [SPARK-34952][SQL] DSv2 Aggregate push down APIs

SparkQA commented on pull request #33352: URL: https://github.com/apache/spark/pull/33352#issuecomment-881816628 Kubernetes integration test unable to build dist. exiting with code: 1 URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/45709/ --

[GitHub] [spark] SparkQA commented on pull request #33379: [SPARK-35810][PYTHON] Deprecate ps.broadcast API

SparkQA commented on pull request #33379: URL: https://github.com/apache/spark/pull/33379#issuecomment-881816619 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/45708/ -- This is an automated message from the Apache

[GitHub] [spark] SparkQA removed a comment on pull request #33379: [SPARK-35810][PYTHON] Deprecate ps.broadcast API

SparkQA removed a comment on pull request #33379: URL: https://github.com/apache/spark/pull/33379#issuecomment-881810960 **[Test build #141196 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/141196/testReport)** for PR 33379 at commit

[GitHub] [spark] SparkQA commented on pull request #33379: [SPARK-35810][PYTHON] Deprecate ps.broadcast API

SparkQA commented on pull request #33379: URL: https://github.com/apache/spark/pull/33379#issuecomment-881814370 **[Test build #141196 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/141196/testReport)** for PR 33379 at commit

[GitHub] [spark] SparkQA removed a comment on pull request #31522: [SPARK-34399][SQL] Add commit duration to SQL tab's graph node.

SparkQA removed a comment on pull request #31522: URL: https://github.com/apache/spark/pull/31522#issuecomment-881786424 **[Test build #141194 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/141194/testReport)** for PR 31522 at commit

[GitHub] [spark] SparkQA commented on pull request #31522: [SPARK-34399][SQL] Add commit duration to SQL tab's graph node.

SparkQA commented on pull request #31522: URL: https://github.com/apache/spark/pull/31522#issuecomment-881813626 **[Test build #141194 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/141194/testReport)** for PR 31522 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #33352: [SPARK-34952][SQL] DSv2 Aggregate push down APIs

AmplabJenkins removed a comment on pull request #33352: URL: https://github.com/apache/spark/pull/33352#issuecomment-881811214 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/141197/

[GitHub] [spark] SparkQA removed a comment on pull request #33352: [SPARK-34952][SQL] DSv2 Aggregate push down APIs

SparkQA removed a comment on pull request #33352: URL: https://github.com/apache/spark/pull/33352#issuecomment-881810965 **[Test build #141197 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/141197/testReport)** for PR 33352 at commit

[GitHub] [spark] AmplabJenkins commented on pull request #33352: [SPARK-34952][SQL] DSv2 Aggregate push down APIs

AmplabJenkins commented on pull request #33352: URL: https://github.com/apache/spark/pull/33352#issuecomment-881811214 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/141197/ -- This

[GitHub] [spark] SparkQA commented on pull request #33352: [SPARK-34952][SQL] DSv2 Aggregate push down APIs

SparkQA commented on pull request #33352: URL: https://github.com/apache/spark/pull/33352#issuecomment-881811207 **[Test build #141197 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/141197/testReport)** for PR 33352 at commit

[GitHub] [spark] SparkQA commented on pull request #33352: [SPARK-34952][SQL] DSv2 Aggregate push down APIs

SparkQA commented on pull request #33352: URL: https://github.com/apache/spark/pull/33352#issuecomment-881810965 **[Test build #141197 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/141197/testReport)** for PR 33352 at commit

[GitHub] [spark] SparkQA commented on pull request #33379: [SPARK-35810][PYTHON] Deprecate ps.broadcast API

SparkQA commented on pull request #33379: URL: https://github.com/apache/spark/pull/33379#issuecomment-881810960 **[Test build #141196 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/141196/testReport)** for PR 33379 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #33373: [SPARK-36127][PYTHON] Support comparison between a Categorical and a scalar

AmplabJenkins removed a comment on pull request #33373: URL: https://github.com/apache/spark/pull/33373#issuecomment-881810636 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/45707/

[GitHub] [spark] AmplabJenkins commented on pull request #33373: [SPARK-36127][PYTHON] Support comparison between a Categorical and a scalar

AmplabJenkins commented on pull request #33373: URL: https://github.com/apache/spark/pull/33373#issuecomment-881810636 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/45707/ --

[GitHub] [spark] itholic commented on a change in pull request #33379: [SPARK-35810][PYTHON] Deprecate ps.broadcast API

itholic commented on a change in pull request #33379: URL: https://github.com/apache/spark/pull/33379#discussion_r671599035 ## File path: python/pyspark/pandas/namespace.py ## @@ -2852,6 +2855,11 @@ def broadcast(obj: DataFrame) -> DataFrame: ...BroadcastHashJoin...

[GitHub] [spark] SparkQA commented on pull request #33373: [SPARK-36127][PYTHON] Support comparison between a Categorical and a scalar

SparkQA commented on pull request #33373: URL: https://github.com/apache/spark/pull/33373#issuecomment-881806654 Kubernetes integration test status success URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/45707/ -- This is an automated message from the

[GitHub] [spark] AmplabJenkins removed a comment on pull request #33078: [SPARK-35546][Shuffle] Enable push-based shuffle when multiple app attempts are enabled and manage concurrent access to the sta

AmplabJenkins removed a comment on pull request #33078: URL: https://github.com/apache/spark/pull/33078#issuecomment-881803665 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/141191/

[GitHub] [spark] AmplabJenkins removed a comment on pull request #33200: [SPARK-36006][SQL] Migrate ALTER TABLE ... ADD/REPLACE COLUMNS commands to use UnresolvedTable to resolve the identifier

AmplabJenkins removed a comment on pull request #33200: URL: https://github.com/apache/spark/pull/33200#issuecomment-881803660 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/45705/

[GitHub] [spark] AmplabJenkins removed a comment on pull request #33401: [SPARK-35785][SS][FOLLOWUP] Remove ignored test from RocksDBSuite

AmplabJenkins removed a comment on pull request #33401: URL: https://github.com/apache/spark/pull/33401#issuecomment-881803663 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/141184/

[GitHub] [spark] AmplabJenkins removed a comment on pull request #31522: [SPARK-34399][SQL] Add commit duration to SQL tab's graph node.

AmplabJenkins removed a comment on pull request #31522: URL: https://github.com/apache/spark/pull/31522#issuecomment-881803662 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/45706/

[GitHub] [spark] AmplabJenkins removed a comment on pull request #33373: [SPARK-36127][PYTHON] Support comparison between a Categorical and a scalar

AmplabJenkins removed a comment on pull request #33373: URL: https://github.com/apache/spark/pull/33373#issuecomment-881803667 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/141195/

[GitHub] [spark] AmplabJenkins removed a comment on pull request #33400: [SPARK-36186][PYTHON] Add as_ordered/as_unordered to CategoricalAccessor and CategoricalIndex

AmplabJenkins removed a comment on pull request #33400: URL: https://github.com/apache/spark/pull/33400#issuecomment-881803661 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/45704/

[GitHub] [spark] AmplabJenkins commented on pull request #33401: [SPARK-35785][SS][FOLLOWUP] Remove ignored test from RocksDBSuite

AmplabJenkins commented on pull request #33401: URL: https://github.com/apache/spark/pull/33401#issuecomment-881803663 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/141184/ -- This

[GitHub] [spark] AmplabJenkins commented on pull request #33373: [SPARK-36127][PYTHON] Support comparison between a Categorical and a scalar

AmplabJenkins commented on pull request #33373: URL: https://github.com/apache/spark/pull/33373#issuecomment-881803667 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/141195/ -- This

[GitHub] [spark] AmplabJenkins commented on pull request #33400: [SPARK-36186][PYTHON] Add as_ordered/as_unordered to CategoricalAccessor and CategoricalIndex

AmplabJenkins commented on pull request #33400: URL: https://github.com/apache/spark/pull/33400#issuecomment-881803661 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/45704/ --

[GitHub] [spark] AmplabJenkins commented on pull request #31522: [SPARK-34399][SQL] Add commit duration to SQL tab's graph node.

AmplabJenkins commented on pull request #31522: URL: https://github.com/apache/spark/pull/31522#issuecomment-881803662 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/45706/ --

[GitHub] [spark] AmplabJenkins commented on pull request #33078: [SPARK-35546][Shuffle] Enable push-based shuffle when multiple app attempts are enabled and manage concurrent access to the state in a

AmplabJenkins commented on pull request #33078: URL: https://github.com/apache/spark/pull/33078#issuecomment-881803665 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/141191/ -- This

[GitHub] [spark] AmplabJenkins commented on pull request #33200: [SPARK-36006][SQL] Migrate ALTER TABLE ... ADD/REPLACE COLUMNS commands to use UnresolvedTable to resolve the identifier

AmplabJenkins commented on pull request #33200: URL: https://github.com/apache/spark/pull/33200#issuecomment-881803660 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/45705/ --

[GitHub] [spark] SparkQA commented on pull request #33373: [SPARK-36127][PYTHON] Support comparison between a Categorical and a scalar

SparkQA commented on pull request #33373: URL: https://github.com/apache/spark/pull/33373#issuecomment-881802367 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/45707/ -- This is an automated message from the Apache

[GitHub] [spark] imback82 commented on a change in pull request #33200: [SPARK-36006][SQL] Migrate ALTER TABLE ... ADD/REPLACE COLUMNS commands to use UnresolvedTable to resolve the identifier

imback82 commented on a change in pull request #33200: URL: https://github.com/apache/spark/pull/33200#discussion_r671595283 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/plans/logical/statements.scala ## @@ -229,22 +228,13 @@ case class

[GitHub] [spark] SparkQA removed a comment on pull request #33078: [SPARK-35546][Shuffle] Enable push-based shuffle when multiple app attempts are enabled and manage concurrent access to the state in

SparkQA removed a comment on pull request #33078: URL: https://github.com/apache/spark/pull/33078#issuecomment-881773430 **[Test build #141191 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/141191/testReport)** for PR 33078 at commit

[GitHub] [spark] SparkQA commented on pull request #33078: [SPARK-35546][Shuffle] Enable push-based shuffle when multiple app attempts are enabled and manage concurrent access to the state in a better

SparkQA commented on pull request #33078: URL: https://github.com/apache/spark/pull/33078#issuecomment-881800626 **[Test build #141191 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/141191/testReport)** for PR 33078 at commit

[GitHub] [spark] SparkQA commented on pull request #33200: [SPARK-36006][SQL] Migrate ALTER TABLE ... ADD/REPLACE COLUMNS commands to use UnresolvedTable to resolve the identifier

SparkQA commented on pull request #33200: URL: https://github.com/apache/spark/pull/33200#issuecomment-881800035 Kubernetes integration test status success URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/45705/ -- This is an automated message from the

[GitHub] [spark] imback82 commented on a change in pull request #33200: [SPARK-36006][SQL] Migrate ALTER TABLE ... ADD/REPLACE COLUMNS commands to use UnresolvedTable to resolve the identifier

imback82 commented on a change in pull request #33200: URL: https://github.com/apache/spark/pull/33200#discussion_r671593276 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/plans/logical/v2Commands.scala ## @@ -1101,19 +1068,80 @@ case class

[GitHub] [spark] SparkQA removed a comment on pull request #33401: [SPARK-35785][SS][FOLLOWUP] Remove ignored test from RocksDBSuite

SparkQA removed a comment on pull request #33401: URL: https://github.com/apache/spark/pull/33401#issuecomment-881734097 **[Test build #141184 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/141184/testReport)** for PR 33401 at commit

[GitHub] [spark] SparkQA removed a comment on pull request #33373: [SPARK-36127][PYTHON] Support comparison between a Categorical and a scalar

SparkQA removed a comment on pull request #33373: URL: https://github.com/apache/spark/pull/33373#issuecomment-881795283 **[Test build #141195 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/141195/testReport)** for PR 33373 at commit

[GitHub] [spark] SparkQA commented on pull request #33401: [SPARK-35785][SS][FOLLOWUP] Remove ignored test from RocksDBSuite

SparkQA commented on pull request #33401: URL: https://github.com/apache/spark/pull/33401#issuecomment-881799643 **[Test build #141184 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/141184/testReport)** for PR 33401 at commit

[GitHub] [spark] SparkQA commented on pull request #33373: [SPARK-36127][PYTHON] Support comparison between a Categorical and a scalar

SparkQA commented on pull request #33373: URL: https://github.com/apache/spark/pull/33373#issuecomment-881799491 **[Test build #141195 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/141195/testReport)** for PR 33373 at commit

[GitHub] [spark] SparkQA commented on pull request #33400: [SPARK-36186][PYTHON] Add as_ordered/as_unordered to CategoricalAccessor and CategoricalIndex

SparkQA commented on pull request #33400: URL: https://github.com/apache/spark/pull/33400#issuecomment-881798842 Kubernetes integration test status success URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/45704/ -- This is an automated message from the

[GitHub] [spark] SparkQA commented on pull request #31522: [SPARK-34399][SQL] Add commit duration to SQL tab's graph node.

SparkQA commented on pull request #31522: URL: https://github.com/apache/spark/pull/31522#issuecomment-881798553 Kubernetes integration test status success URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/45706/ -- This is an automated message from the

[GitHub] [spark] AmplabJenkins removed a comment on pull request #33352: [SPARK-34952][SQL] DSv2 Aggregate push down APIs

AmplabJenkins removed a comment on pull request #33352: URL: https://github.com/apache/spark/pull/33352#issuecomment-881796135 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/141182/

[GitHub] [spark] AmplabJenkins commented on pull request #33352: [SPARK-34952][SQL] DSv2 Aggregate push down APIs

AmplabJenkins commented on pull request #33352: URL: https://github.com/apache/spark/pull/33352#issuecomment-881796135 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/141182/ -- This

[GitHub] [spark] xinrong-databricks commented on a change in pull request #33373: [SPARK-36127][PYTHON] Support comparison between a Categorical and a scalar

xinrong-databricks commented on a change in pull request #33373: URL: https://github.com/apache/spark/pull/33373#discussion_r671590077 ## File path: python/pyspark/pandas/tests/data_type_ops/test_categorical_ops.py ## @@ -46,24 +46,20 @@ def other_psser(self): @property

[GitHub] [spark] SparkQA removed a comment on pull request #33352: [SPARK-34952][SQL] DSv2 Aggregate push down APIs

SparkQA removed a comment on pull request #33352: URL: https://github.com/apache/spark/pull/33352#issuecomment-881706581 **[Test build #141182 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/141182/testReport)** for PR 33352 at commit

[GitHub] [spark] SparkQA commented on pull request #33352: [SPARK-34952][SQL] DSv2 Aggregate push down APIs

SparkQA commented on pull request #33352: URL: https://github.com/apache/spark/pull/33352#issuecomment-881795769 **[Test build #141182 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/141182/testReport)** for PR 33352 at commit

[GitHub] [spark] SparkQA commented on pull request #33373: [SPARK-36127][PYTHON] Support comparison between a Categorical and a scalar

SparkQA commented on pull request #33373: URL: https://github.com/apache/spark/pull/33373#issuecomment-881795283 **[Test build #141195 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/141195/testReport)** for PR 33373 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #33400: [SPARK-36186][PYTHON] Add as_ordered/as_unordered to CategoricalAccessor and CategoricalIndex

AmplabJenkins removed a comment on pull request #33400: URL: https://github.com/apache/spark/pull/33400#issuecomment-881794947 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/141193/

[GitHub] [spark] AmplabJenkins removed a comment on pull request #33078: [SPARK-35546][Shuffle] Enable push-based shuffle when multiple app attempts are enabled and manage concurrent access to the sta

AmplabJenkins removed a comment on pull request #33078: URL: https://github.com/apache/spark/pull/33078#issuecomment-881794948 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/45703/

[GitHub] [spark] AmplabJenkins commented on pull request #33078: [SPARK-35546][Shuffle] Enable push-based shuffle when multiple app attempts are enabled and manage concurrent access to the state in a

AmplabJenkins commented on pull request #33078: URL: https://github.com/apache/spark/pull/33078#issuecomment-881794948 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/45703/ --

[GitHub] [spark] AmplabJenkins commented on pull request #33400: [SPARK-36186][PYTHON] Add as_ordered/as_unordered to CategoricalAccessor and CategoricalIndex

AmplabJenkins commented on pull request #33400: URL: https://github.com/apache/spark/pull/33400#issuecomment-881794947 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/141193/ -- This

[GitHub] [spark] SparkQA commented on pull request #33200: [SPARK-36006][SQL] Migrate ALTER TABLE ... ADD/REPLACE COLUMNS commands to use UnresolvedTable to resolve the identifier

SparkQA commented on pull request #33200: URL: https://github.com/apache/spark/pull/33200#issuecomment-881794439 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/45705/ -- This is an automated message from the Apache

[GitHub] [spark] SparkQA commented on pull request #31522: [SPARK-34399][SQL] Add commit duration to SQL tab's graph node.

SparkQA commented on pull request #31522: URL: https://github.com/apache/spark/pull/31522#issuecomment-881793562 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/45706/ -- This is an automated message from the Apache

[GitHub] [spark] SparkQA commented on pull request #33400: [SPARK-36186][PYTHON] Add as_ordered/as_unordered to CategoricalAccessor and CategoricalIndex

SparkQA commented on pull request #33400: URL: https://github.com/apache/spark/pull/33400#issuecomment-881793506 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/45704/ -- This is an automated message from the Apache

[GitHub] [spark] SparkQA commented on pull request #33078: [SPARK-35546][Shuffle] Enable push-based shuffle when multiple app attempts are enabled and manage concurrent access to the state in a better

SparkQA commented on pull request #33078: URL: https://github.com/apache/spark/pull/33078#issuecomment-881790926 Kubernetes integration test status success URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/45703/ -- This is an automated message from the

[GitHub] [spark] SparkQA removed a comment on pull request #33400: [SPARK-36186][PYTHON] Add as_ordered/as_unordered to CategoricalAccessor and CategoricalIndex

SparkQA removed a comment on pull request #33400: URL: https://github.com/apache/spark/pull/33400#issuecomment-881786184 **[Test build #141193 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/141193/testReport)** for PR 33400 at commit

[GitHub] [spark] SparkQA commented on pull request #33400: [SPARK-36186][PYTHON] Add as_ordered/as_unordered to CategoricalAccessor and CategoricalIndex

SparkQA commented on pull request #33400: URL: https://github.com/apache/spark/pull/33400#issuecomment-881790744 **[Test build #141193 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/141193/testReport)** for PR 33400 at commit

[GitHub] [spark] xinrong-databricks commented on a change in pull request #33373: [SPARK-36127][PYTHON] Support comparison between a Categorical and a scalar

xinrong-databricks commented on a change in pull request #33373: URL: https://github.com/apache/spark/pull/33373#discussion_r671585151 ## File path: python/pyspark/pandas/tests/data_type_ops/test_categorical_ops.py ## @@ -46,24 +46,20 @@ def other_psser(self): @property

[GitHub] [spark] xinrong-databricks commented on a change in pull request #33373: [SPARK-36127][PYTHON] Support comparison between a Categorical and a scalar

xinrong-databricks commented on a change in pull request #33373: URL: https://github.com/apache/spark/pull/33373#discussion_r671584823 ## File path: python/pyspark/pandas/data_type_ops/categorical_ops.py ## @@ -71,28 +72,58 @@ def astype(self, index_ops: IndexOpsLike, dtype:

[GitHub] [spark] xinrong-databricks commented on a change in pull request #33373: [SPARK-36127][PYTHON] Support comparison between a Categorical and a scalar

xinrong-databricks commented on a change in pull request #33373: URL: https://github.com/apache/spark/pull/33373#discussion_r671584559 ## File path: python/pyspark/pandas/data_type_ops/categorical_ops.py ## @@ -71,28 +72,58 @@ def astype(self, index_ops: IndexOpsLike, dtype:

[GitHub] [spark] xinrong-databricks commented on a change in pull request #33373: [SPARK-36127][PYTHON] Support comparison between a Categorical and a scalar

xinrong-databricks commented on a change in pull request #33373: URL: https://github.com/apache/spark/pull/33373#discussion_r671584402 ## File path: python/pyspark/pandas/data_type_ops/categorical_ops.py ## @@ -71,28 +72,58 @@ def astype(self, index_ops: IndexOpsLike, dtype:

[GitHub] [spark] AmplabJenkins commented on pull request #33402: [SPARK-36189][PYTHON] Improve bool, string, numeric DataTypeOps tests by avoiding joins

AmplabJenkins commented on pull request #33402: URL: https://github.com/apache/spark/pull/33402#issuecomment-881788793 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/45702/ --

[GitHub] [spark] SparkQA commented on pull request #33402: [SPARK-36189][PYTHON] Improve bool, string, numeric DataTypeOps tests by avoiding joins

SparkQA commented on pull request #33402: URL: https://github.com/apache/spark/pull/33402#issuecomment-881788784 Kubernetes integration test status success URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/45702/ -- This is an automated message from the

[GitHub] [spark] AmplabJenkins removed a comment on pull request #33402: [SPARK-36189][PYTHON] Improve bool, string, numeric DataTypeOps tests by avoiding joins

AmplabJenkins removed a comment on pull request #33402: URL: https://github.com/apache/spark/pull/33402#issuecomment-881788793 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/45702/

[GitHub] [spark] AmplabJenkins removed a comment on pull request #33078: [SPARK-35546][Shuffle] Enable push-based shuffle when multiple app attempts are enabled and manage concurrent access to the sta

AmplabJenkins removed a comment on pull request #33078: URL: https://github.com/apache/spark/pull/33078#issuecomment-881787719 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/141187/

[GitHub] [spark] AmplabJenkins commented on pull request #33078: [SPARK-35546][Shuffle] Enable push-based shuffle when multiple app attempts are enabled and manage concurrent access to the state in a

AmplabJenkins commented on pull request #33078: URL: https://github.com/apache/spark/pull/33078#issuecomment-881787719 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/141187/ -- This

[GitHub] [spark] SparkQA removed a comment on pull request #33078: [SPARK-35546][Shuffle] Enable push-based shuffle when multiple app attempts are enabled and manage concurrent access to the state in

SparkQA removed a comment on pull request #33078: URL: https://github.com/apache/spark/pull/33078#issuecomment-881740357 **[Test build #141187 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/141187/testReport)** for PR 33078 at commit

[GitHub] [spark] SparkQA commented on pull request #33078: [SPARK-35546][Shuffle] Enable push-based shuffle when multiple app attempts are enabled and manage concurrent access to the state in a better

SparkQA commented on pull request #33078: URL: https://github.com/apache/spark/pull/33078#issuecomment-881787295 **[Test build #141187 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/141187/testReport)** for PR 33078 at commit

[GitHub] [spark] SparkQA commented on pull request #31522: [SPARK-34399][SQL] Add commit duration to SQL tab's graph node.

SparkQA commented on pull request #31522: URL: https://github.com/apache/spark/pull/31522#issuecomment-881786424 **[Test build #141194 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/141194/testReport)** for PR 31522 at commit

[GitHub] [spark] SparkQA commented on pull request #33400: [SPARK-36186][PYTHON] Add as_ordered/as_unordered to CategoricalAccessor and CategoricalIndex

SparkQA commented on pull request #33400: URL: https://github.com/apache/spark/pull/33400#issuecomment-881786184 **[Test build #141193 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/141193/testReport)** for PR 33400 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #33398: [SPARK-36167][PYTHON][FOLLOWUP] Fix test failures with older versions of pandas

AmplabJenkins removed a comment on pull request #33398: URL: https://github.com/apache/spark/pull/33398#issuecomment-881785735 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/45700/

[GitHub] [spark] AmplabJenkins commented on pull request #33398: [SPARK-36167][PYTHON][FOLLOWUP] Fix test failures with older versions of pandas

AmplabJenkins commented on pull request #33398: URL: https://github.com/apache/spark/pull/33398#issuecomment-881785735 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/45700/ --

[GitHub] [spark] SparkQA commented on pull request #33078: [SPARK-35546][Shuffle] Enable push-based shuffle when multiple app attempts are enabled and manage concurrent access to the state in a better

SparkQA commented on pull request #33078: URL: https://github.com/apache/spark/pull/33078#issuecomment-881785297 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/45703/ -- This is an automated message from the Apache

[GitHub] [spark] AngersZhuuuu commented on a change in pull request #31522: [SPARK-34399][SQL] Add commit duration to SQL tab's graph node.

AngersZh commented on a change in pull request #31522: URL: https://github.com/apache/spark/pull/31522#discussion_r671580787 ## File path: sql/core/src/test/scala/org/apache/spark/sql/execution/datasources/CustomWriteTaskStatsTrackerSuite.scala ## @@ -25,7 +25,7 @@ import

[GitHub] [spark] SparkQA commented on pull request #33402: [SPARK-36189][PYTHON] Improve bool, string, numeric DataTypeOps tests by avoiding joins

SparkQA commented on pull request #33402: URL: https://github.com/apache/spark/pull/33402#issuecomment-881783072 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/45702/ -- This is an automated message from the Apache

[GitHub] [spark] SparkQA commented on pull request #33398: [SPARK-36167][PYTHON][FOLLOWUP] Fix test failures with older versions of pandas

SparkQA commented on pull request #33398: URL: https://github.com/apache/spark/pull/33398#issuecomment-881779880 Kubernetes integration test status success URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/45700/ -- This is an automated message from the

[GitHub] [spark] github-actions[bot] closed pull request #31999: Add column names to column number mismatch runtimeerror

github-actions[bot] closed pull request #31999: URL: https://github.com/apache/spark/pull/31999 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [spark] github-actions[bot] commented on pull request #30930: [SPARK-33070][SQL] Optimize higher order functions

github-actions[bot] commented on pull request #30930: URL: https://github.com/apache/spark/pull/30930#issuecomment-881779618 We're closing this PR because it hasn't been updated in a while. This isn't a judgement on the merit of the PR in any way. It's just a way of keeping the PR queue

[GitHub] [spark] SparkQA commented on pull request #33200: [SPARK-36006][SQL] Migrate ALTER TABLE ... ADD/REPLACE COLUMNS commands to use UnresolvedTable to resolve the identifier

SparkQA commented on pull request #33200: URL: https://github.com/apache/spark/pull/33200#issuecomment-881776808 **[Test build #141192 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/141192/testReport)** for PR 33200 at commit

  1   2   3   4   5   6   7   8   9   >