[GitHub] [spark] beliefer commented on pull request #34554: [SPARK-37286][SQL] Move compileFilter and compileAggregates from JDBCRDD to JdbcDialect

beliefer commented on pull request #34554: URL: https://github.com/apache/spark/pull/34554#issuecomment-984376002 Based on discussion offline, reopen this PR. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL

[GitHub] [spark] beliefer opened a new pull request #34554: [SPARK-37286][SQL] Move compileFilter and compileAggregates from JDBCRDD to JdbcDialect

beliefer opened a new pull request #34554: URL: https://github.com/apache/spark/pull/34554 ### What changes were proposed in this pull request? Currently, the method `compileFilter` and `compileAggregates` is a member of `JDBCRDD`. But it is not reasonable, because the JDBC source

[GitHub] [spark] SparkQA commented on pull request #34701: [SPARK-37450][SQL] Prune unnecessary fields from Generate

SparkQA commented on pull request #34701: URL: https://github.com/apache/spark/pull/34701#issuecomment-984366546 **[Test build #145849 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/145849/testReport)** for PR 34701 at commit

[GitHub] [spark] viirya commented on a change in pull request #34701: [SPARK-37450][SQL] Prune unnecessary fields from Generate

viirya commented on a change in pull request #34701: URL: https://github.com/apache/spark/pull/34701#discussion_r760827034 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/optimizer/Optimizer.scala ## @@ -2162,6 +2163,48 @@ object

[GitHub] [spark] viirya commented on a change in pull request #34701: [SPARK-37450][SQL] Prune unnecessary fields from Generate

viirya commented on a change in pull request #34701: URL: https://github.com/apache/spark/pull/34701#discussion_r760826896 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/optimizer/Optimizer.scala ## @@ -2162,6 +2163,48 @@ object

[GitHub] [spark] SparkQA commented on pull request #34764: [SPARK-37330][SQL] Migrate ReplaceTableStatement to v2 command

SparkQA commented on pull request #34764: URL: https://github.com/apache/spark/pull/34764#issuecomment-984361799 **[Test build #145848 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/145848/testReport)** for PR 34764 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #34701: [SPARK-37450][SQL] Prune unnecessary fields from Generate

AmplabJenkins removed a comment on pull request #34701: URL: https://github.com/apache/spark/pull/34701#issuecomment-984360337 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/50320/

[GitHub] [spark] AmplabJenkins removed a comment on pull request #34757: [SPARK-37504][PYTHON] Pyspark create SparkSession with existed session should not pass static conf

AmplabJenkins removed a comment on pull request #34757: URL: https://github.com/apache/spark/pull/34757#issuecomment-984360338 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/50319/

[GitHub] [spark] AmplabJenkins removed a comment on pull request #34775: [SPARK-37511][DOCS][FOLLOW-UP] Fix documentation build warning from TimedeltaIndex

AmplabJenkins removed a comment on pull request #34775: URL: https://github.com/apache/spark/pull/34775#issuecomment-984360344 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/50317/

[GitHub] [spark] AmplabJenkins removed a comment on pull request #34777: [SPARK-37326][SQL][FOLLOW-UP] Update code and tests for TimestampNTZ support in CSV data source

AmplabJenkins removed a comment on pull request #34777: URL: https://github.com/apache/spark/pull/34777#issuecomment-984360339 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/50315/

[GitHub] [spark] AmplabJenkins removed a comment on pull request #34774: [SPARK-37516][PYTHON][SQL] Uses Python's standard string formatter for SQL API in PySpark

AmplabJenkins removed a comment on pull request #34774: URL: https://github.com/apache/spark/pull/34774#issuecomment-984360335 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/50318/

[GitHub] [spark] AmplabJenkins removed a comment on pull request #34776: [SPARK-37512][PYTHON] Support TimedeltaIndex creation (from Series/Index) and TimedeltaIndex.astype

AmplabJenkins removed a comment on pull request #34776: URL: https://github.com/apache/spark/pull/34776#issuecomment-984360334 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

[GitHub] [spark] AmplabJenkins removed a comment on pull request #34778: [SPARK-36396][PYTHON][FOLLOWUP] Fix test with extensions dtype when pandas version < 1.2

AmplabJenkins removed a comment on pull request #34778: URL: https://github.com/apache/spark/pull/34778#issuecomment-984360340 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/145846/

[GitHub] [spark] AmplabJenkins commented on pull request #34778: [SPARK-36396][PYTHON][FOLLOWUP] Fix test with extensions dtype when pandas version < 1.2

AmplabJenkins commented on pull request #34778: URL: https://github.com/apache/spark/pull/34778#issuecomment-984360340 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/145846/ -- This

[GitHub] [spark] AmplabJenkins commented on pull request #34776: [SPARK-37512][PYTHON] Support TimedeltaIndex creation (from Series/Index) and TimedeltaIndex.astype

AmplabJenkins commented on pull request #34776: URL: https://github.com/apache/spark/pull/34776#issuecomment-984360336 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To

[GitHub] [spark] AmplabJenkins commented on pull request #34775: [SPARK-37511][DOCS][FOLLOW-UP] Fix documentation build warning from TimedeltaIndex

AmplabJenkins commented on pull request #34775: URL: https://github.com/apache/spark/pull/34775#issuecomment-984360344 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/50317/ --

[GitHub] [spark] AmplabJenkins commented on pull request #34701: [SPARK-37450][SQL] Prune unnecessary fields from Generate

AmplabJenkins commented on pull request #34701: URL: https://github.com/apache/spark/pull/34701#issuecomment-984360337 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/50320/ --

[GitHub] [spark] AmplabJenkins commented on pull request #34757: [SPARK-37504][PYTHON] Pyspark create SparkSession with existed session should not pass static conf

AmplabJenkins commented on pull request #34757: URL: https://github.com/apache/spark/pull/34757#issuecomment-984360338 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/50319/ --

[GitHub] [spark] AmplabJenkins commented on pull request #34774: [SPARK-37516][PYTHON][SQL] Uses Python's standard string formatter for SQL API in PySpark

AmplabJenkins commented on pull request #34774: URL: https://github.com/apache/spark/pull/34774#issuecomment-984360335 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/50318/ --

[GitHub] [spark] AmplabJenkins commented on pull request #34777: [SPARK-37326][SQL][FOLLOW-UP] Update code and tests for TimestampNTZ support in CSV data source

AmplabJenkins commented on pull request #34777: URL: https://github.com/apache/spark/pull/34777#issuecomment-984360339 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/50315/ --

[GitHub] [spark] SparkQA commented on pull request #34777: [SPARK-37326][SQL][FOLLOW-UP] Update code and tests for TimestampNTZ support in CSV data source

SparkQA commented on pull request #34777: URL: https://github.com/apache/spark/pull/34777#issuecomment-984358043 Kubernetes integration test status failure URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/50315/ -- This is an automated message from the

[GitHub] [spark] SparkQA commented on pull request #34776: [SPARK-37512][PYTHON] Support TimedeltaIndex creation (from Series/Index) and TimedeltaIndex.astype

SparkQA commented on pull request #34776: URL: https://github.com/apache/spark/pull/34776#issuecomment-984354840 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/50322/ -- This is an automated message from the Apache

[GitHub] [spark] SparkQA commented on pull request #34778: [SPARK-36396][PYTHON][FOLLOWUP] Fix test with extensions dtype when pandas version < 1.2

SparkQA commented on pull request #34778: URL: https://github.com/apache/spark/pull/34778#issuecomment-984353579 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/50321/ -- This is an automated message from the Apache

[GitHub] [spark] SparkQA commented on pull request #34776: [SPARK-37512][PYTHON] Support TimedeltaIndex creation (from Series/Index) and TimedeltaIndex.astype

SparkQA commented on pull request #34776: URL: https://github.com/apache/spark/pull/34776#issuecomment-984353353 Kubernetes integration test status failure URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/50316/ -- This is an automated message from the

[GitHub] [spark] SparkQA commented on pull request #34774: [SPARK-37516][PYTHON][SQL] Uses Python's standard string formatter for SQL API in PySpark

SparkQA commented on pull request #34774: URL: https://github.com/apache/spark/pull/34774#issuecomment-984351389 Kubernetes integration test status failure URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/50318/ -- This is an automated message from the

[GitHub] [spark] itholic commented on pull request #34772: [SPARK-37514][PYTHON] Remove workarounds due to older pandas

itholic commented on pull request #34772: URL: https://github.com/apache/spark/pull/34772#issuecomment-984350857 Clean! -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To

[GitHub] [spark] SparkQA commented on pull request #34775: [SPARK-37511][DOCS][FOLLOW-UP] Fix documentation build warning from TimedeltaIndex

SparkQA commented on pull request #34775: URL: https://github.com/apache/spark/pull/34775#issuecomment-984350247 Kubernetes integration test status failure URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/50317/ -- This is an automated message from the

[GitHub] [spark] SparkQA removed a comment on pull request #34776: [SPARK-37512][PYTHON] Support TimedeltaIndex creation (from Series/Index) and TimedeltaIndex.astype

SparkQA removed a comment on pull request #34776: URL: https://github.com/apache/spark/pull/34776#issuecomment-984332768 **[Test build #145847 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/145847/testReport)** for PR 34776 at commit

[GitHub] [spark] SparkQA removed a comment on pull request #34778: [SPARK-36396][PYTHON][FOLLOWUP] Fix test with extensions dtype when pandas version < 1.2

SparkQA removed a comment on pull request #34778: URL: https://github.com/apache/spark/pull/34778#issuecomment-984332719 **[Test build #145846 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/145846/testReport)** for PR 34778 at commit

[GitHub] [spark] SparkQA commented on pull request #34701: [SPARK-37450][SQL] Prune unnecessary fields from Generate

SparkQA commented on pull request #34701: URL: https://github.com/apache/spark/pull/34701#issuecomment-984348042 Kubernetes integration test status failure URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/50320/ -- This is an automated message from the

[GitHub] [spark] SparkQA commented on pull request #34757: [SPARK-37504][PYTHON] Pyspark create SparkSession with existed session should not pass static conf

SparkQA commented on pull request #34757: URL: https://github.com/apache/spark/pull/34757#issuecomment-984347565 Kubernetes integration test status failure URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/50319/ -- This is an automated message from the

[GitHub] [spark] SparkQA commented on pull request #34776: [SPARK-37512][PYTHON] Support TimedeltaIndex creation (from Series/Index) and TimedeltaIndex.astype

SparkQA commented on pull request #34776: URL: https://github.com/apache/spark/pull/34776#issuecomment-984345366 **[Test build #145847 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/145847/testReport)** for PR 34776 at commit

[GitHub] [spark] SparkQA commented on pull request #34778: [SPARK-36396][PYTHON][FOLLOWUP] Fix test with extensions dtype when pandas version < 1.2

SparkQA commented on pull request #34778: URL: https://github.com/apache/spark/pull/34778#issuecomment-984345256 **[Test build #145846 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/145846/testReport)** for PR 34778 at commit

[GitHub] [spark] dchvn commented on a change in pull request #34667: [SPARK-36902][SQL] Migrate CreateTableAsSelectStatement to v2 command

dchvn commented on a change in pull request #34667: URL: https://github.com/apache/spark/pull/34667#discussion_r760805798 ## File path: sql/core/src/main/scala/org/apache/spark/sql/DataFrameWriter.scala ## @@ -323,18 +323,25 @@ final class DataFrameWriter[T] private[sql](ds:

[GitHub] [spark] dchvn commented on a change in pull request #34667: [SPARK-36902][SQL] Migrate CreateTableAsSelectStatement to v2 command

dchvn commented on a change in pull request #34667: URL: https://github.com/apache/spark/pull/34667#discussion_r760805798 ## File path: sql/core/src/main/scala/org/apache/spark/sql/DataFrameWriter.scala ## @@ -323,18 +323,25 @@ final class DataFrameWriter[T] private[sql](ds:

[GitHub] [spark] dchvn commented on a change in pull request #34667: [SPARK-36902][SQL] Migrate CreateTableAsSelectStatement to v2 command

dchvn commented on a change in pull request #34667: URL: https://github.com/apache/spark/pull/34667#discussion_r760805798 ## File path: sql/core/src/main/scala/org/apache/spark/sql/DataFrameWriter.scala ## @@ -323,18 +323,25 @@ final class DataFrameWriter[T] private[sql](ds:

[GitHub] [spark] dchvn commented on a change in pull request #34667: [SPARK-36902][SQL] Migrate CreateTableAsSelectStatement to v2 command

dchvn commented on a change in pull request #34667: URL: https://github.com/apache/spark/pull/34667#discussion_r760805798 ## File path: sql/core/src/main/scala/org/apache/spark/sql/DataFrameWriter.scala ## @@ -323,18 +323,25 @@ final class DataFrameWriter[T] private[sql](ds:

[GitHub] [spark] dchvn commented on a change in pull request #34667: [SPARK-36902][SQL] Migrate CreateTableAsSelectStatement to v2 command

dchvn commented on a change in pull request #34667: URL: https://github.com/apache/spark/pull/34667#discussion_r760805798 ## File path: sql/core/src/main/scala/org/apache/spark/sql/DataFrameWriter.scala ## @@ -323,18 +323,25 @@ final class DataFrameWriter[T] private[sql](ds:

[GitHub] [spark] HyukjinKwon commented on pull request #34778: [SPARK-36396][PYTHON][FOLLOWUP] Fix test with extensions dtype when pandas version < 1.2

HyukjinKwon commented on pull request #34778: URL: https://github.com/apache/spark/pull/34778#issuecomment-984333910 Thanks @dchvn ! -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

[GitHub] [spark] dchvn commented on a change in pull request #34778: [SPARK-36396][PYTHON][FOLLOWUP] Fix test with extensions dtype when pandas version < 1.2

dchvn commented on a change in pull request #34778: URL: https://github.com/apache/spark/pull/34778#discussion_r760795723 ## File path: python/pyspark/pandas/tests/test_dataframe.py ## @@ -5870,8 +5870,12 @@ def test_cov(self): self.assert_eq(pdf.cov(min_periods=5),

[GitHub] [spark] SparkQA commented on pull request #34776: [SPARK-37512][PYTHON] Support TimedeltaIndex creation (from Series/Index) and TimedeltaIndex.astype

SparkQA commented on pull request #34776: URL: https://github.com/apache/spark/pull/34776#issuecomment-984332768 **[Test build #145847 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/145847/testReport)** for PR 34776 at commit

[GitHub] [spark] SparkQA commented on pull request #34778: [SPARK-36396][PYTHON][FOLLOWUP] Fix test with extensions dtype when pandas version < 1.2

SparkQA commented on pull request #34778: URL: https://github.com/apache/spark/pull/34778#issuecomment-984332719 **[Test build #145846 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/145846/testReport)** for PR 34778 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #34774: [SPARK-37516][PYTHON][SQL] Uses Python's standard string formatter for SQL API in PySpark

AmplabJenkins removed a comment on pull request #34774: URL: https://github.com/apache/spark/pull/34774#issuecomment-984331468 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/145843/

[GitHub] [spark] AmplabJenkins removed a comment on pull request #34673: [SPARK-37343][SQL] Implement createIndex, IndexExists and dropIndex in JDBC (Postgres dialect)

AmplabJenkins removed a comment on pull request #34673: URL: https://github.com/apache/spark/pull/34673#issuecomment-984331466 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/50314/

[GitHub] [spark] AmplabJenkins removed a comment on pull request #34753: [SPARK-37494][SQL] Unify v1 and v2 options output of `SHOW CREATE TABLE` command

AmplabJenkins removed a comment on pull request #34753: URL: https://github.com/apache/spark/pull/34753#issuecomment-984331465 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/145833/

[GitHub] [spark] AmplabJenkins removed a comment on pull request #34775: [SPARK-37511][DOCS][FOLLOW-UP] Fix documentation build warning from TimedeltaIndex

AmplabJenkins removed a comment on pull request #34775: URL: https://github.com/apache/spark/pull/34775#issuecomment-984331467 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/145842/

[GitHub] [spark] AmplabJenkins removed a comment on pull request #32875: [SPARK-35703][SQL] Relax constraint for bucket join and remove HashClusteredDistribution

AmplabJenkins removed a comment on pull request #32875: URL: https://github.com/apache/spark/pull/32875#issuecomment-984331423 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/145834/

[GitHub] [spark] AmplabJenkins commented on pull request #32875: [SPARK-35703][SQL] Relax constraint for bucket join and remove HashClusteredDistribution

AmplabJenkins commented on pull request #32875: URL: https://github.com/apache/spark/pull/32875#issuecomment-984331423 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/145834/ -- This

[GitHub] [spark] AmplabJenkins commented on pull request #34775: [SPARK-37511][DOCS][FOLLOW-UP] Fix documentation build warning from TimedeltaIndex

AmplabJenkins commented on pull request #34775: URL: https://github.com/apache/spark/pull/34775#issuecomment-984331467 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/145842/ -- This

[GitHub] [spark] AmplabJenkins commented on pull request #34774: [SPARK-37516][PYTHON][SQL] Uses Python's standard string formatter for SQL API in PySpark

AmplabJenkins commented on pull request #34774: URL: https://github.com/apache/spark/pull/34774#issuecomment-984331468 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/145843/ -- This

[GitHub] [spark] AmplabJenkins commented on pull request #34673: [SPARK-37343][SQL] Implement createIndex, IndexExists and dropIndex in JDBC (Postgres dialect)

AmplabJenkins commented on pull request #34673: URL: https://github.com/apache/spark/pull/34673#issuecomment-984331466 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/50314/ --

[GitHub] [spark] AmplabJenkins commented on pull request #34753: [SPARK-37494][SQL] Unify v1 and v2 options output of `SHOW CREATE TABLE` command

AmplabJenkins commented on pull request #34753: URL: https://github.com/apache/spark/pull/34753#issuecomment-984331465 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/145833/ -- This

[GitHub] [spark] SparkQA removed a comment on pull request #32875: [SPARK-35703][SQL] Relax constraint for bucket join and remove HashClusteredDistribution

SparkQA removed a comment on pull request #32875: URL: https://github.com/apache/spark/pull/32875#issuecomment-984210804 **[Test build #145834 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/145834/testReport)** for PR 32875 at commit

[GitHub] [spark] SparkQA commented on pull request #32875: [SPARK-35703][SQL] Relax constraint for bucket join and remove HashClusteredDistribution

SparkQA commented on pull request #32875: URL: https://github.com/apache/spark/pull/32875#issuecomment-984330466 **[Test build #145834 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/145834/testReport)** for PR 32875 at commit

[GitHub] [spark] SparkQA commented on pull request #34673: [SPARK-37343][SQL] Implement createIndex, IndexExists and dropIndex in JDBC (Postgres dialect)

SparkQA commented on pull request #34673: URL: https://github.com/apache/spark/pull/34673#issuecomment-984329538 Kubernetes integration test status failure URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/50314/ -- This is an automated message from the

[GitHub] [spark] SparkQA commented on pull request #34777: [SPARK-37326][SQL][FOLLOW-UP] Update code and tests for TimestampNTZ support in CSV data source

SparkQA commented on pull request #34777: URL: https://github.com/apache/spark/pull/34777#issuecomment-984329506 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/50315/ -- This is an automated message from the Apache

[GitHub] [spark] SparkQA commented on pull request #34757: [SPARK-37504][PYTHON] Pyspark create SparkSession with existed session should not pass static conf

SparkQA commented on pull request #34757: URL: https://github.com/apache/spark/pull/34757#issuecomment-984328332 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/50319/ -- This is an automated message from the Apache

[GitHub] [spark] SparkQA commented on pull request #34701: [SPARK-37450][SQL] Prune unnecessary fields from Generate

SparkQA commented on pull request #34701: URL: https://github.com/apache/spark/pull/34701#issuecomment-984328016 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/50320/ -- This is an automated message from the Apache

[GitHub] [spark] HyukjinKwon commented on a change in pull request #34778: [SPARK-36396][PYTHON][FOLLOWUP] Fix test with extensions dtype when pandas version < 1.2

HyukjinKwon commented on a change in pull request #34778: URL: https://github.com/apache/spark/pull/34778#discussion_r760789523 ## File path: python/pyspark/pandas/tests/test_dataframe.py ## @@ -5870,8 +5870,12 @@ def test_cov(self):

[GitHub] [spark] SparkQA commented on pull request #34775: [SPARK-37511][DOCS][FOLLOW-UP] Fix documentation build warning from TimedeltaIndex

SparkQA commented on pull request #34775: URL: https://github.com/apache/spark/pull/34775#issuecomment-984325655 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/50317/ -- This is an automated message from the Apache

[GitHub] [spark] SparkQA commented on pull request #34776: [SPARK-37512][PYTHON] Support TimedeltaIndex creation given a timedelta Series/Index

SparkQA commented on pull request #34776: URL: https://github.com/apache/spark/pull/34776#issuecomment-984325276 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/50316/ -- This is an automated message from the Apache

[GitHub] [spark] SparkQA commented on pull request #34774: [SPARK-37516][PYTHON][SQL] Uses Python's standard string formatter for SQL API in PySpark

SparkQA commented on pull request #34774: URL: https://github.com/apache/spark/pull/34774#issuecomment-984324189 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/50318/ -- This is an automated message from the Apache

[GitHub] [spark] SparkQA removed a comment on pull request #34774: [SPARK-37516][PYTHON][SQL] Uses Python's standard string formatter for SQL API in PySpark

SparkQA removed a comment on pull request #34774: URL: https://github.com/apache/spark/pull/34774#issuecomment-984307383 **[Test build #145843 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/145843/testReport)** for PR 34774 at commit

[GitHub] [spark] SparkQA removed a comment on pull request #34775: [SPARK-37511][DOCS][FOLLOW-UP] Fix documentation build warning from TimedeltaIndex

SparkQA removed a comment on pull request #34775: URL: https://github.com/apache/spark/pull/34775#issuecomment-984307321 **[Test build #145842 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/145842/testReport)** for PR 34775 at commit

[GitHub] [spark] SparkQA removed a comment on pull request #34753: [SPARK-37494][SQL] Unify v1 and v2 options output of `SHOW CREATE TABLE` command

SparkQA removed a comment on pull request #34753: URL: https://github.com/apache/spark/pull/34753#issuecomment-984210101 **[Test build #145833 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/145833/testReport)** for PR 34753 at commit

[GitHub] [spark] SparkQA commented on pull request #34753: [SPARK-37494][SQL] Unify v1 and v2 options output of `SHOW CREATE TABLE` command

SparkQA commented on pull request #34753: URL: https://github.com/apache/spark/pull/34753#issuecomment-984321198 **[Test build #145833 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/145833/testReport)** for PR 34753 at commit

[GitHub] [spark] SparkQA commented on pull request #34774: [SPARK-37516][PYTHON][SQL] Uses Python's standard string formatter for SQL API in PySpark

SparkQA commented on pull request #34774: URL: https://github.com/apache/spark/pull/34774#issuecomment-984320572 **[Test build #145843 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/145843/testReport)** for PR 34774 at commit

[GitHub] [spark] dchvn opened a new pull request #34778: [SPARK-36396][PYTHON][FOLLOWUP] Fix test with extensions dtype when pandas version < 1.2

dchvn opened a new pull request #34778: URL: https://github.com/apache/spark/pull/34778 ### What changes were proposed in this pull request? Fix test of `pd.Dataframe.cov` with extensions dtype when pandas version < 1.2 ### Why are the changes needed? Pass test of

[GitHub] [spark] SparkQA commented on pull request #34775: [SPARK-37511][DOCS][FOLLOW-UP] Fix documentation build warning from TimedeltaIndex

SparkQA commented on pull request #34775: URL: https://github.com/apache/spark/pull/34775#issuecomment-984320063 **[Test build #145842 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/145842/testReport)** for PR 34775 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #34667: [SPARK-36902][SQL] Migrate CreateTableAsSelectStatement to v2 command

AmplabJenkins removed a comment on pull request #34667: URL: https://github.com/apache/spark/pull/34667#issuecomment-984312341 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/145837/

[GitHub] [spark] SparkQA removed a comment on pull request #34667: [SPARK-36902][SQL] Migrate CreateTableAsSelectStatement to v2 command

SparkQA removed a comment on pull request #34667: URL: https://github.com/apache/spark/pull/34667#issuecomment-984260258 **[Test build #145837 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/145837/testReport)** for PR 34667 at commit

[GitHub] [spark] AmplabJenkins commented on pull request #34667: [SPARK-36902][SQL] Migrate CreateTableAsSelectStatement to v2 command

AmplabJenkins commented on pull request #34667: URL: https://github.com/apache/spark/pull/34667#issuecomment-984312341 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/145837/ -- This

[GitHub] [spark] SparkQA commented on pull request #34667: [SPARK-36902][SQL] Migrate CreateTableAsSelectStatement to v2 command

SparkQA commented on pull request #34667: URL: https://github.com/apache/spark/pull/34667#issuecomment-984312176 **[Test build #145837 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/145837/testReport)** for PR 34667 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #34760: [SPARK-37506][CORE][SQL][DSTREAM][GRAPHX][ML][MLLIB][SS][EXAMPLES] Change the never changed 'var' to 'val'

AmplabJenkins removed a comment on pull request #34760: URL: https://github.com/apache/spark/pull/34760#issuecomment-984310479 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/145835/

[GitHub] [spark] AmplabJenkins commented on pull request #34760: [SPARK-37506][CORE][SQL][DSTREAM][GRAPHX][ML][MLLIB][SS][EXAMPLES] Change the never changed 'var' to 'val'

AmplabJenkins commented on pull request #34760: URL: https://github.com/apache/spark/pull/34760#issuecomment-984310479 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/145835/ -- This

[GitHub] [spark] cloud-fan commented on a change in pull request #34701: [SPARK-37450][SQL] Prune unnecessary fields from Generate

cloud-fan commented on a change in pull request #34701: URL: https://github.com/apache/spark/pull/34701#discussion_r760776756 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/optimizer/Optimizer.scala ## @@ -2162,6 +2163,48 @@ object

[GitHub] [spark] cloud-fan commented on a change in pull request #34701: [SPARK-37450][SQL] Prune unnecessary fields from Generate

cloud-fan commented on a change in pull request #34701: URL: https://github.com/apache/spark/pull/34701#discussion_r760776756 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/optimizer/Optimizer.scala ## @@ -2162,6 +2163,48 @@ object

[GitHub] [spark] cloud-fan commented on a change in pull request #34701: [SPARK-37450][SQL] Prune unnecessary fields from Generate

cloud-fan commented on a change in pull request #34701: URL: https://github.com/apache/spark/pull/34701#discussion_r760776370 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/optimizer/Optimizer.scala ## @@ -2162,6 +2163,48 @@ object

[GitHub] [spark] SparkQA removed a comment on pull request #34764: [SPARK-37330][SQL] Migrate ReplaceTableStatement to v2 command

SparkQA removed a comment on pull request #34764: URL: https://github.com/apache/spark/pull/34764#issuecomment-984260141 **[Test build #145836 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/145836/testReport)** for PR 34764 at commit

[GitHub] [spark] AmplabJenkins commented on pull request #34764: [SPARK-37330][SQL] Migrate ReplaceTableStatement to v2 command

AmplabJenkins commented on pull request #34764: URL: https://github.com/apache/spark/pull/34764#issuecomment-984309930 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/145836/ -- This

[GitHub] [spark] AmplabJenkins removed a comment on pull request #34764: [SPARK-37330][SQL] Migrate ReplaceTableStatement to v2 command

AmplabJenkins removed a comment on pull request #34764: URL: https://github.com/apache/spark/pull/34764#issuecomment-984309930 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/145836/

[GitHub] [spark] SparkQA commented on pull request #34764: [SPARK-37330][SQL] Migrate ReplaceTableStatement to v2 command

SparkQA commented on pull request #34764: URL: https://github.com/apache/spark/pull/34764#issuecomment-984309768 **[Test build #145836 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/145836/testReport)** for PR 34764 at commit

[GitHub] [spark] SparkQA removed a comment on pull request #34760: [SPARK-37506][CORE][SQL][DSTREAM][GRAPHX][ML][MLLIB][SS][EXAMPLES] Change the never changed 'var' to 'val'

SparkQA removed a comment on pull request #34760: URL: https://github.com/apache/spark/pull/34760#issuecomment-984238599 **[Test build #145835 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/145835/testReport)** for PR 34760 at commit

[GitHub] [spark] SparkQA commented on pull request #34760: [SPARK-37506][CORE][SQL][DSTREAM][GRAPHX][ML][MLLIB][SS][EXAMPLES] Change the never changed 'var' to 'val'

SparkQA commented on pull request #34760: URL: https://github.com/apache/spark/pull/34760#issuecomment-984309442 **[Test build #145835 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/145835/testReport)** for PR 34760 at commit

[GitHub] [spark] venkata91 commented on a change in pull request #33896: [SPARK-33701][SHUFFLE] Adaptive shuffle merge finalization for push-based shuffle

venkata91 commented on a change in pull request #33896: URL: https://github.com/apache/spark/pull/33896#discussion_r760774868 ## File path: core/src/test/scala/org/apache/spark/scheduler/DAGSchedulerSuite.scala ## @@ -3847,6 +3887,76 @@ class DAGSchedulerSuite extends

[GitHub] [spark] AmplabJenkins removed a comment on pull request #34776: [SPARK-37512][PYTHON] Support TimedeltaIndex creation given a timedelta Series/Index

AmplabJenkins removed a comment on pull request #34776: URL: https://github.com/apache/spark/pull/34776#issuecomment-984307640 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/145841/

[GitHub] [spark] SparkQA removed a comment on pull request #34776: [SPARK-37512][PYTHON] Support TimedeltaIndex creation given a timedelta Series/Index

SparkQA removed a comment on pull request #34776: URL: https://github.com/apache/spark/pull/34776#issuecomment-984307312 **[Test build #145841 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/145841/testReport)** for PR 34776 at commit

[GitHub] [spark] AmplabJenkins commented on pull request #34776: [SPARK-37512][PYTHON] Support TimedeltaIndex creation given a timedelta Series/Index

AmplabJenkins commented on pull request #34776: URL: https://github.com/apache/spark/pull/34776#issuecomment-984307640 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/145841/ -- This

[GitHub] [spark] SparkQA commented on pull request #34776: [SPARK-37512][PYTHON] Support TimedeltaIndex creation given a timedelta Series/Index

SparkQA commented on pull request #34776: URL: https://github.com/apache/spark/pull/34776#issuecomment-984307627 **[Test build #145841 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/145841/testReport)** for PR 34776 at commit

[GitHub] [spark] SparkQA commented on pull request #34774: [SPARK-37516][PYTHON][SQL] Uses Python's standard string formatter for SQL API in PySpark

SparkQA commented on pull request #34774: URL: https://github.com/apache/spark/pull/34774#issuecomment-984307383 **[Test build #145843 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/145843/testReport)** for PR 34774 at commit

[GitHub] [spark] SparkQA commented on pull request #34701: [SPARK-37450][SQL] Prune unnecessary fields from Generate

SparkQA commented on pull request #34701: URL: https://github.com/apache/spark/pull/34701#issuecomment-984307445 **[Test build #145845 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/145845/testReport)** for PR 34701 at commit

[GitHub] [spark] SparkQA commented on pull request #34757: [SPARK-37504][PYTHON] Pyspark create SparkSession with existed session should not pass static conf

SparkQA commented on pull request #34757: URL: https://github.com/apache/spark/pull/34757#issuecomment-984307362 **[Test build #145844 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/145844/testReport)** for PR 34757 at commit

[GitHub] [spark] SparkQA commented on pull request #34775: [SPARK-37511][DOCS][FOLLOW-UP] Fix documentation build warning from TimedeltaIndex

SparkQA commented on pull request #34775: URL: https://github.com/apache/spark/pull/34775#issuecomment-984307321 **[Test build #145842 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/145842/testReport)** for PR 34775 at commit

[GitHub] [spark] SparkQA commented on pull request #34777: [SPARK-37326][SQL][FOLLOW-UP] Update code and tests for TimestampNTZ support in CSV data source

SparkQA commented on pull request #34777: URL: https://github.com/apache/spark/pull/34777#issuecomment-984307292 **[Test build #145840 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/145840/testReport)** for PR 34777 at commit

[GitHub] [spark] SparkQA commented on pull request #34776: [SPARK-37512][PYTHON] Support TimedeltaIndex creation given a timedelta Series/Index

SparkQA commented on pull request #34776: URL: https://github.com/apache/spark/pull/34776#issuecomment-984307312 **[Test build #145841 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/145841/testReport)** for PR 34776 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #34659: [SPARK-34863][SQL] Support complex types for Parquet vectorized reader

AmplabJenkins removed a comment on pull request #34659: URL: https://github.com/apache/spark/pull/34659#issuecomment-984306042 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/145831/

[GitHub] [spark] AmplabJenkins removed a comment on pull request #34667: [SPARK-36902][SQL] Migrate CreateTableAsSelectStatement to v2 command

AmplabJenkins removed a comment on pull request #34667: URL: https://github.com/apache/spark/pull/34667#issuecomment-984306043 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/50312/

[GitHub] [spark] AmplabJenkins commented on pull request #34659: [SPARK-34863][SQL] Support complex types for Parquet vectorized reader

AmplabJenkins commented on pull request #34659: URL: https://github.com/apache/spark/pull/34659#issuecomment-984306042 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/145831/ -- This

[GitHub] [spark] AmplabJenkins commented on pull request #34667: [SPARK-36902][SQL] Migrate CreateTableAsSelectStatement to v2 command

AmplabJenkins commented on pull request #34667: URL: https://github.com/apache/spark/pull/34667#issuecomment-984306043 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/50312/ --

[GitHub] [spark] sadikovi commented on pull request #34777: [SPARK-37326][SQL][FOLLOW-UP] Update code and tests for TimestampNTZ support in CSV data source

sadikovi commented on pull request #34777: URL: https://github.com/apache/spark/pull/34777#issuecomment-984304694 cc @MaxGekk @cloud-fan @gengliangwang for review. Thanks! -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and

  1   2   3   4   5   6   7   >