[GitHub] [spark] SparkQA commented on pull request #34763: [SPARK-37389][SQL][FOLLOWUP] SET command shuold not parse comments

SparkQA commented on pull request #34763: URL: https://github.com/apache/spark/pull/34763#issuecomment-983386819 Kubernetes integration test status failure URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/50271/ -- This is an automated message from the

[GitHub] [spark] SparkQA commented on pull request #34758: [SPARK-37501][SQL] CREATE/REPLACE TABLE should qualify location for v2 command

SparkQA commented on pull request #34758: URL: https://github.com/apache/spark/pull/34758#issuecomment-983403373 **[Test build #145804 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/145804/testReport)** for PR 34758 at commit

[GitHub] [spark] SparkQA commented on pull request #34673: [SPARK-37343][SQL] Implement createIndex, IndexExists and dropIndex in JDBC (Postgres dialect)

SparkQA commented on pull request #34673: URL: https://github.com/apache/spark/pull/34673#issuecomment-983403563 **[Test build #145806 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/145806/testReport)** for PR 34673 at commit

[GitHub] [spark] SparkQA commented on pull request #34757: [SPARK-37504][PYTHON] Pyspark create SparkSession with existed session should not pass static conf

SparkQA commented on pull request #34757: URL: https://github.com/apache/spark/pull/34757#issuecomment-983403487 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/50274/ -- This is an automated message from the Apache

[GitHub] [spark] SparkQA commented on pull request #34753: [SPARK-37494][SQL] Unify v1 and v2 options output of `SHOW CREATE TABLE` command

SparkQA commented on pull request #34753: URL: https://github.com/apache/spark/pull/34753#issuecomment-983403459 **[Test build #145805 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/145805/testReport)** for PR 34753 at commit

[GitHub] [spark] SparkQA commented on pull request #34758: [SPARK-37501][SQL] CREATE/REPLACE TABLE should qualify location for v2 command

SparkQA commented on pull request #34758: URL: https://github.com/apache/spark/pull/34758#issuecomment-983410923 **[Test build #145784 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/145784/testReport)** for PR 34758 at commit

[GitHub] [spark] amirmasoudabdol commented on a change in pull request #34728: [WIP][SPARK-37474][R][DOCS] Migrate SparkR docs to pkgdown

amirmasoudabdol commented on a change in pull request #34728: URL: https://github.com/apache/spark/pull/34728#discussion_r759973118 ## File path: R/pkg/_pkgdown.yml ## @@ -0,0 +1,293 @@ +# +# Licensed to the Apache Software Foundation (ASF) under one or more +# contributor

[GitHub] [spark] HyukjinKwon commented on a change in pull request #34757: [SPARK-37504][PYTHON] Pyspark create SparkSession with existed session should not pass static conf

HyukjinKwon commented on a change in pull request #34757: URL: https://github.com/apache/spark/pull/34757#discussion_r759991137 ## File path: python/pyspark/sql/session.py ## @@ -304,8 +329,13 @@ def __init__( and not

[GitHub] [spark] AngersZhuuuu commented on a change in pull request #34757: [SPARK-37504][PYTHON] Pyspark create SparkSession with existed session should not pass static conf

AngersZh commented on a change in pull request #34757: URL: https://github.com/apache/spark/pull/34757#discussion_r759994141 ## File path: python/pyspark/sql/session.py ## @@ -287,6 +289,29 @@ def getOrCreate(self) -> "SparkSession": _instantiatedSession:

[GitHub] [spark] HyukjinKwon commented on pull request #34657: [SPARK-37511][PYTHON] Introduce TimedeltaIndex to pandas API on Spark

HyukjinKwon commented on pull request #34657: URL: https://github.com/apache/spark/pull/34657#issuecomment-983445674 Merged to master. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the

[GitHub] [spark] HyukjinKwon closed pull request #34657: [SPARK-37511][PYTHON] Introduce TimedeltaIndex to pandas API on Spark

HyukjinKwon closed pull request #34657: URL: https://github.com/apache/spark/pull/34657 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [spark] AngersZhuuuu commented on a change in pull request #34757: [SPARK-37504][PYTHON] Pyspark create SparkSession with existed session should not pass static conf

AngersZh commented on a change in pull request #34757: URL: https://github.com/apache/spark/pull/34757#discussion_r759994141 ## File path: python/pyspark/sql/session.py ## @@ -287,6 +289,29 @@ def getOrCreate(self) -> "SparkSession": _instantiatedSession:

[GitHub] [spark] yutoacts commented on a change in pull request #34718: [SPARK-37460][DOCS] Add the description of ALTER DATABASE SET LOCATION

yutoacts commented on a change in pull request #34718: URL: https://github.com/apache/spark/pull/34718#discussion_r759994496 ## File path: docs/sql-ref-syntax-ddl-alter-database.md ## @@ -21,25 +21,47 @@ license: | ### Description -You can alter metadata associated with a

[GitHub] [spark] SparkQA commented on pull request #34673: [SPARK-37343][SQL] Implement createIndex, IndexExists and dropIndex in JDBC (Postgres dialect)

SparkQA commented on pull request #34673: URL: https://github.com/apache/spark/pull/34673#issuecomment-983455409 Kubernetes integration test status failure URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/50275/ -- This is an automated message from the

[GitHub] [spark] AmplabJenkins commented on pull request #34673: [SPARK-37343][SQL] Implement createIndex, IndexExists and dropIndex in JDBC (Postgres dialect)

AmplabJenkins commented on pull request #34673: URL: https://github.com/apache/spark/pull/34673#issuecomment-983455444 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/50275/ --

[GitHub] [spark] yutoacts commented on a change in pull request #34718: [SPARK-37460][DOCS] Add the description of ALTER DATABASE SET LOCATION

yutoacts commented on a change in pull request #34718: URL: https://github.com/apache/spark/pull/34718#discussion_r759994496 ## File path: docs/sql-ref-syntax-ddl-alter-database.md ## @@ -21,25 +21,47 @@ license: | ### Description -You can alter metadata associated with a

[GitHub] [spark] MaxGekk closed pull request #34761: [SPARK-37508][SQL] Add CONTAINS() string function

MaxGekk closed pull request #34761: URL: https://github.com/apache/spark/pull/34761 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [spark] SparkQA removed a comment on pull request #34767: [SPARK-37461][YARN][FOLLOWUP] Refactor YARN Client code to avoid add unnecessary parameter of `appId`

SparkQA removed a comment on pull request #34767: URL: https://github.com/apache/spark/pull/34767#issuecomment-983450256 **[Test build #145808 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/145808/testReport)** for PR 34767 at commit

[GitHub] [spark] SparkQA removed a comment on pull request #34718: [SPARK-37460][DOCS] Add the description of ALTER DATABASE SET LOCATION

SparkQA removed a comment on pull request #34718: URL: https://github.com/apache/spark/pull/34718#issuecomment-983463340 **[Test build #145811 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/145811/testReport)** for PR 34718 at commit

[GitHub] [spark] SparkQA commented on pull request #34758: [SPARK-37501][SQL] CREATE/REPLACE TABLE should qualify location for v2 command

SparkQA commented on pull request #34758: URL: https://github.com/apache/spark/pull/34758#issuecomment-983488822 Kubernetes integration test status failure URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/50276/ -- This is an automated message from the

[GitHub] [spark] SparkQA commented on pull request #34767: [SPARK-37461][YARN][FOLLOWUP] Refactor YARN Client code to avoid add unnecessary parameter of `appId`

SparkQA commented on pull request #34767: URL: https://github.com/apache/spark/pull/34767#issuecomment-983495201 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/50281/ -- This is an automated message from the Apache

[GitHub] [spark] SparkQA removed a comment on pull request #34712: [SPARK-37463][SQL] Read/Write Timestamp ntz or ltz to Orc uses UTC timestamp

SparkQA removed a comment on pull request #34712: URL: https://github.com/apache/spark/pull/34712#issuecomment-983508705 **[Test build #145812 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/145812/testReport)** for PR 34712 at commit

[GitHub] [spark] SparkQA commented on pull request #34673: [SPARK-37343][SQL] Implement createIndex, IndexExists and dropIndex in JDBC (Postgres dialect)

SparkQA commented on pull request #34673: URL: https://github.com/apache/spark/pull/34673#issuecomment-983523358 Kubernetes integration test status failure URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/50280/ -- This is an automated message from the

[GitHub] [spark] Peng-Lei commented on a change in pull request #34758: [SPARK-37501][SQL] CREATE/REPLACE TABLE should qualify location for v2 command

Peng-Lei commented on a change in pull request #34758: URL: https://github.com/apache/spark/pull/34758#discussion_r759937743 ## File path: sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/v2/DataSourceV2Strategy.scala ## @@ -186,7 +185,10 @@ class

[GitHub] [spark] cloud-fan commented on a change in pull request #34754: [SPARK-37496][SQL] Migrate ReplaceTableAsSelectStatement to v2 command

cloud-fan commented on a change in pull request #34754: URL: https://github.com/apache/spark/pull/34754#discussion_r759937291 ## File path: sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/v2/WriteToDataSourceV2Exec.scala ## @@ -196,11 +204,19 @@ case class

[GitHub] [spark] SparkQA removed a comment on pull request #34757: [SPARK-37504][PYTHON] Pyspark create SparkSession with existed session should not pass static conf

SparkQA removed a comment on pull request #34757: URL: https://github.com/apache/spark/pull/34757#issuecomment-983363743 **[Test build #145800 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/145800/testReport)** for PR 34757 at commit

[GitHub] [spark] Yikun commented on pull request #34734: [SPARK-37480][K8S][DOC] Sync Kubernetes configuration to latest in running-on-k8s.md

Yikun commented on pull request #34734: URL: https://github.com/apache/spark/pull/34734#issuecomment-983400375 > If you don't mind, could you make a backporting PR to branch-3.2 after excluding 3.3.0 configs? @dongjoon-hyun Sure, will backport it soon. Thanks for review! -- This

[GitHub] [spark] cloud-fan commented on a change in pull request #34673: [SPARK-37343][SQL] Implement createIndex, IndexExists and dropIndex in JDBC (Postgres dialect)

cloud-fan commented on a change in pull request #34673: URL: https://github.com/apache/spark/pull/34673#discussion_r759950310 ## File path: external/docker-integration-tests/src/test/scala/org/apache/spark/sql/jdbc/v2/V2JDBCTest.scala ## @@ -193,6 +193,8 @@ private[v2] trait

[GitHub] [spark] SparkQA removed a comment on pull request #34758: [SPARK-37501][SQL] CREATE/REPLACE TABLE should qualify location for v2 command

SparkQA removed a comment on pull request #34758: URL: https://github.com/apache/spark/pull/34758#issuecomment-983250705 **[Test build #145784 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/145784/testReport)** for PR 34758 at commit

[GitHub] [spark] SparkQA removed a comment on pull request #34741: [SPARK-37463][SQL] Read/Write Timestamp ntz from/to Orc uses UTC time zone

SparkQA removed a comment on pull request #34741: URL: https://github.com/apache/spark/pull/34741#issuecomment-983276497 **[Test build #145792 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/145792/testReport)** for PR 34741 at commit

[GitHub] [spark] HyukjinKwon commented on a change in pull request #34715: [SPARK-37445][BUILD] Rename the maven hadoop profile to hadoop-3 and hadoop-2

HyukjinKwon commented on a change in pull request #34715: URL: https://github.com/apache/spark/pull/34715#discussion_r759983638 ## File path: python/pyspark/install.py ## @@ -65,7 +68,7 @@ def checked_versions(spark_version, hadoop_version, hive_version): if

[GitHub] [spark] SparkQA commented on pull request #34741: [SPARK-37463][SQL] Read/Write Timestamp ntz from/to Orc uses UTC time zone

SparkQA commented on pull request #34741: URL: https://github.com/apache/spark/pull/34741#issuecomment-983433942 **[Test build #145792 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/145792/testReport)** for PR 34741 at commit

[GitHub] [spark] yutoacts commented on a change in pull request #34718: [SPARK-37460][DOCS] Add the description of ALTER DATABASE SET LOCATION

yutoacts commented on a change in pull request #34718: URL: https://github.com/apache/spark/pull/34718#discussion_r759994496 ## File path: docs/sql-ref-syntax-ddl-alter-database.md ## @@ -21,25 +21,47 @@ license: | ### Description -You can alter metadata associated with a

[GitHub] [spark] dchvn commented on a change in pull request #34667: [SPARK-36902][SQL] Migrate CreateTableAsSelectStatement to v2 command

dchvn commented on a change in pull request #34667: URL: https://github.com/apache/spark/pull/34667#discussion_r760031937 ## File path: sql/core/src/main/scala/org/apache/spark/sql/DataFrameWriter.scala ## @@ -323,18 +323,25 @@ final class DataFrameWriter[T] private[sql](ds:

[GitHub] [spark] SparkQA commented on pull request #34712: [SPARK-37463][SQL] Read/Write Timestamp ntz or ltz to Orc uses UTC timestamp

SparkQA commented on pull request #34712: URL: https://github.com/apache/spark/pull/34712#issuecomment-983520681 Kubernetes integration test unable to build dist. exiting with code: 1 URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/50286/ --

[GitHub] [spark] SparkQA commented on pull request #34741: [SPARK-37463][SQL] Read/Write Timestamp ntz from/to Orc uses UTC time zone

SparkQA commented on pull request #34741: URL: https://github.com/apache/spark/pull/34741#issuecomment-983535667 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/50284/ -- This is an automated message from the Apache

[GitHub] [spark] AmplabJenkins removed a comment on pull request #34764: [SPARK-37330][SQL] Migrate ReplaceTableStatement to v2 command

AmplabJenkins removed a comment on pull request #34764: URL: https://github.com/apache/spark/pull/34764#issuecomment-983553655 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/145795/

[GitHub] [spark] SparkQA removed a comment on pull request #34761: [SPARK-37508][SQL] Add CONTAINS() string function

SparkQA removed a comment on pull request #34761: URL: https://github.com/apache/spark/pull/34761#issuecomment-983250633 **[Test build #145783 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/145783/testReport)** for PR 34761 at commit

[GitHub] [spark] AngersZhuuuu commented on pull request #34767: [SPARK-37461][YARN][FOLLOWUP] Refactor YARN Client code to avoid add unnecessary parameter of `appId`

AngersZh commented on pull request #34767: URL: https://github.com/apache/spark/pull/34767#issuecomment-983416676 @tgravescs Now may be what you want. cc @srowen -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use

[GitHub] [spark] SparkQA commented on pull request #34758: [SPARK-37501][SQL] CREATE/REPLACE TABLE should qualify location for v2 command

SparkQA commented on pull request #34758: URL: https://github.com/apache/spark/pull/34758#issuecomment-983452415 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/50278/ -- This is an automated message from the Apache

[GitHub] [spark] yutoacts commented on a change in pull request #34718: [SPARK-37460][DOCS] Add the description of ALTER DATABASE SET LOCATION

yutoacts commented on a change in pull request #34718: URL: https://github.com/apache/spark/pull/34718#discussion_r760009048 ## File path: docs/sql-ref-syntax-ddl-alter-database.md ## @@ -21,25 +21,47 @@ license: | ### Description -You can alter metadata associated with a

[GitHub] [spark] AmplabJenkins removed a comment on pull request #34718: [SPARK-37460][DOCS] Add the description of ALTER DATABASE SET LOCATION

AmplabJenkins removed a comment on pull request #34718: URL: https://github.com/apache/spark/pull/34718#issuecomment-983498756 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/145811/

[GitHub] [spark] AmplabJenkins removed a comment on pull request #34758: [SPARK-37501][SQL] CREATE/REPLACE TABLE should qualify location for v2 command

AmplabJenkins removed a comment on pull request #34758: URL: https://github.com/apache/spark/pull/34758#issuecomment-983498755 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/50276/

[GitHub] [spark] SparkQA commented on pull request #34753: [SPARK-37494][SQL] Unify v1 and v2 options output of `SHOW CREATE TABLE` command

SparkQA commented on pull request #34753: URL: https://github.com/apache/spark/pull/34753#issuecomment-983516749 Kubernetes integration test status failure URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/50279/ -- This is an automated message from the

[GitHub] [spark] AmplabJenkins commented on pull request #34763: [SPARK-37389][SQL][FOLLOWUP] SET command shuold not parse comments

AmplabJenkins commented on pull request #34763: URL: https://github.com/apache/spark/pull/34763#issuecomment-983545861 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/145796/ -- This

[GitHub] [spark] AmplabJenkins commented on pull request #34673: [SPARK-37343][SQL] Implement createIndex, IndexExists and dropIndex in JDBC (Postgres dialect)

AmplabJenkins commented on pull request #34673: URL: https://github.com/apache/spark/pull/34673#issuecomment-983545863 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/50280/ --

[GitHub] [spark] AmplabJenkins commented on pull request #34753: [SPARK-37494][SQL] Unify v1 and v2 options output of `SHOW CREATE TABLE` command

AmplabJenkins commented on pull request #34753: URL: https://github.com/apache/spark/pull/34753#issuecomment-983545869 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/50279/ --

[GitHub] [spark] SparkQA removed a comment on pull request #34764: [SPARK-37330][SQL] Migrate ReplaceTableStatement to v2 command

SparkQA removed a comment on pull request #34764: URL: https://github.com/apache/spark/pull/34764#issuecomment-983329462 **[Test build #145795 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/145795/testReport)** for PR 34764 at commit

[GitHub] [spark] SparkQA commented on pull request #34764: [SPARK-37330][SQL] Migrate ReplaceTableStatement to v2 command

SparkQA commented on pull request #34764: URL: https://github.com/apache/spark/pull/34764#issuecomment-983551560 **[Test build #145795 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/145795/testReport)** for PR 34764 at commit

[GitHub] [spark] cloud-fan commented on a change in pull request #34754: [SPARK-37496][SQL] Migrate ReplaceTableAsSelectStatement to v2 command

cloud-fan commented on a change in pull request #34754: URL: https://github.com/apache/spark/pull/34754#discussion_r759935336 ## File path: sql/core/src/main/scala/org/apache/spark/sql/DataFrameWriterV2.scala ## @@ -195,20 +195,12 @@ final class DataFrameWriterV2[T]

[GitHub] [spark] SparkQA commented on pull request #34765: [WIP][SPARK-37487][SQL][CORE] Avoid performing CollectMetrics twice if the operation is followed by global sort.

SparkQA commented on pull request #34765: URL: https://github.com/apache/spark/pull/34765#issuecomment-983438671 **[Test build #145798 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/145798/testReport)** for PR 34765 at commit

[GitHub] [spark] SparkQA removed a comment on pull request #34765: [WIP][SPARK-37487][SQL][CORE] Avoid performing CollectMetrics twice if the operation is followed by global sort.

SparkQA removed a comment on pull request #34765: URL: https://github.com/apache/spark/pull/34765#issuecomment-983331523 **[Test build #145798 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/145798/testReport)** for PR 34765 at commit

[GitHub] [spark] Peng-Lei commented on a change in pull request #34753: [SPARK-37494][SQL] Unify v1 and v2 options output of `SHOW CREATE TABLE` command

Peng-Lei commented on a change in pull request #34753: URL: https://github.com/apache/spark/pull/34753#discussion_r759987137 ## File path: sql/core/src/test/scala/org/apache/spark/sql/ShowCreateTableSuite.scala ## @@ -200,6 +200,32 @@ abstract class ShowCreateTableSuite

[GitHub] [spark] SparkQA commented on pull request #34758: [SPARK-37501][SQL] CREATE/REPLACE TABLE should qualify location for v2 command

SparkQA commented on pull request #34758: URL: https://github.com/apache/spark/pull/34758#issuecomment-983439518 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/50276/ -- This is an automated message from the Apache

[GitHub] [spark] SparkQA commented on pull request #34212: [SPARK-36402][PYTHON] Implement Series.combine

SparkQA commented on pull request #34212: URL: https://github.com/apache/spark/pull/34212#issuecomment-983446971 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/50277/ -- This is an automated message from the Apache

[GitHub] [spark] HyukjinKwon commented on a change in pull request #34757: [SPARK-37504][PYTHON] Pyspark create SparkSession with existed session should not pass static conf

HyukjinKwon commented on a change in pull request #34757: URL: https://github.com/apache/spark/pull/34757#discussion_r759995944 ## File path: python/pyspark/sql/session.py ## @@ -287,6 +289,29 @@ def getOrCreate(self) -> "SparkSession": _instantiatedSession:

[GitHub] [spark] AngersZhuuuu commented on a change in pull request #34757: [SPARK-37504][PYTHON] Pyspark create SparkSession with existed session should not pass static conf

AngersZh commented on a change in pull request #34757: URL: https://github.com/apache/spark/pull/34757#discussion_r759995714 ## File path: python/pyspark/sql/session.py ## @@ -277,8 +277,10 @@ def getOrCreate(self) -> "SparkSession": # Do not update

[GitHub] [spark] AmplabJenkins removed a comment on pull request #34673: [SPARK-37343][SQL] Implement createIndex, IndexExists and dropIndex in JDBC (Postgres dialect)

AmplabJenkins removed a comment on pull request #34673: URL: https://github.com/apache/spark/pull/34673#issuecomment-983455444 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/50275/

[GitHub] [spark] SparkQA commented on pull request #34718: [SPARK-37460][DOCS] Add the description of ALTER DATABASE SET LOCATION

SparkQA commented on pull request #34718: URL: https://github.com/apache/spark/pull/34718#issuecomment-983474159 **[Test build #145811 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/145811/testReport)** for PR 34718 at commit

[GitHub] [spark] MaxGekk commented on pull request #34761: [SPARK-37508][SQL] Add CONTAINS() string function

MaxGekk commented on pull request #34761: URL: https://github.com/apache/spark/pull/34761#issuecomment-983474309 +1, LGTM. Merging to master. Thank you, @AngersZh and @LuciferYang for review. -- This is an automated message from the Apache Git Service. To respond to the message,

[GitHub] [spark] SparkQA commented on pull request #34673: [SPARK-37343][SQL] Implement createIndex, IndexExists and dropIndex in JDBC (Postgres dialect)

SparkQA commented on pull request #34673: URL: https://github.com/apache/spark/pull/34673#issuecomment-983489905 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/50280/ -- This is an automated message from the Apache

[GitHub] [spark] SparkQA commented on pull request #34767: [SPARK-37461][YARN][FOLLOWUP] Refactor YARN Client code to avoid add unnecessary parameter of `appId`

SparkQA commented on pull request #34767: URL: https://github.com/apache/spark/pull/34767#issuecomment-983505238 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/50282/ -- This is an automated message from the Apache

[GitHub] [spark] AmplabJenkins removed a comment on pull request #34758: [SPARK-37501][SQL] CREATE/REPLACE TABLE should qualify location for v2 command

AmplabJenkins removed a comment on pull request #34758: URL: https://github.com/apache/spark/pull/34758#issuecomment-983504413 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/50278/

[GitHub] [spark] SparkQA commented on pull request #34753: [SPARK-37494][SQL] Unify v1 and v2 options output of `SHOW CREATE TABLE` command

SparkQA commented on pull request #34753: URL: https://github.com/apache/spark/pull/34753#issuecomment-983514144 **[Test build #145805 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/145805/testReport)** for PR 34753 at commit

[GitHub] [spark] SparkQA commented on pull request #34767: [SPARK-37461][YARN][FOLLOWUP] Refactor YARN Client code to avoid add unnecessary parameter of `appId`

SparkQA commented on pull request #34767: URL: https://github.com/apache/spark/pull/34767#issuecomment-983539225 Kubernetes integration test status failure URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/50281/ -- This is an automated message from the

[GitHub] [spark] SparkQA commented on pull request #34767: [SPARK-37461][YARN][FOLLOWUP] Refactor YARN Client code to avoid add unnecessary parameter of `appId`

SparkQA commented on pull request #34767: URL: https://github.com/apache/spark/pull/34767#issuecomment-983552304 Kubernetes integration test status failure URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/50282/ -- This is an automated message from the

[GitHub] [spark] AmplabJenkins commented on pull request #34767: [SPARK-37461][YARN][FOLLOWUP] Refactor YARN Client code to avoid add unnecessary parameter of `appId`

AmplabJenkins commented on pull request #34767: URL: https://github.com/apache/spark/pull/34767#issuecomment-983552351 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/50282/ --

[GitHub] [spark] AmplabJenkins removed a comment on pull request #34767: [SPARK-37461][YARN][FOLLOWUP] Refactor YARN Client code to avoid add unnecessary parameter of `appId`

AmplabJenkins removed a comment on pull request #34767: URL: https://github.com/apache/spark/pull/34767#issuecomment-983552351 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/50282/

[GitHub] [spark] cloud-fan edited a comment on pull request #34763: [SPARK-37389][SQL][FOLLOWUP] SET command shuold not parse comments

cloud-fan edited a comment on pull request #34763: URL: https://github.com/apache/spark/pull/34763#issuecomment-983407688 thanks for the review, merging to master/3.2/3.1! -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and

[GitHub] [spark] cloud-fan closed pull request #34763: [SPARK-37389][SQL][FOLLOWUP] SET command shuold not parse comments

cloud-fan closed pull request #34763: URL: https://github.com/apache/spark/pull/34763 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [spark] SparkQA commented on pull request #34761: [SPARK-37508][SQL] Add CONTAINS() string function

SparkQA commented on pull request #34761: URL: https://github.com/apache/spark/pull/34761#issuecomment-983408489 **[Test build #145783 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/145783/testReport)** for PR 34761 at commit

[GitHub] [spark] SparkQA removed a comment on pull request #34367: [SPARK-37099][SQL] Impl a rank-based filter to optimize top-k computation

SparkQA removed a comment on pull request #34367: URL: https://github.com/apache/spark/pull/34367#issuecomment-983256901 **[Test build #145790 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/145790/testReport)** for PR 34367 at commit

[GitHub] [spark] HyukjinKwon commented on a change in pull request #34757: [SPARK-37504][PYTHON] Pyspark create SparkSession with existed session should not pass static conf

HyukjinKwon commented on a change in pull request #34757: URL: https://github.com/apache/spark/pull/34757#discussion_r759989446 ## File path: python/pyspark/sql/session.py ## @@ -287,6 +289,29 @@ def getOrCreate(self) -> "SparkSession": _instantiatedSession:

[GitHub] [spark] SparkQA commented on pull request #34657: [SPARK-37511][PYTHON] Introduce TimedeltaIndex to pandas API on Spark

SparkQA commented on pull request #34657: URL: https://github.com/apache/spark/pull/34657#issuecomment-983440858 Kubernetes integration test status failure URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/50272/ -- This is an automated message from the

[GitHub] [spark] HyukjinKwon commented on a change in pull request #34757: [SPARK-37504][PYTHON] Pyspark create SparkSession with existed session should not pass static conf

HyukjinKwon commented on a change in pull request #34757: URL: https://github.com/apache/spark/pull/34757#discussion_r759992352 ## File path: python/pyspark/sql/session.py ## @@ -277,8 +277,10 @@ def getOrCreate(self) -> "SparkSession": # Do not update

[GitHub] [spark] AmplabJenkins commented on pull request #34757: [SPARK-37504][PYTHON] Pyspark create SparkSession with existed session should not pass static conf

AmplabJenkins commented on pull request #34757: URL: https://github.com/apache/spark/pull/34757#issuecomment-983451534 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/50274/ --

[GitHub] [spark] AmplabJenkins removed a comment on pull request #34757: [SPARK-37504][PYTHON] Pyspark create SparkSession with existed session should not pass static conf

AmplabJenkins removed a comment on pull request #34757: URL: https://github.com/apache/spark/pull/34757#issuecomment-983451534 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/50274/

[GitHub] [spark] SparkQA commented on pull request #34718: [SPARK-37460][DOCS] Add the description of ALTER DATABASE SET LOCATION

SparkQA commented on pull request #34718: URL: https://github.com/apache/spark/pull/34718#issuecomment-983463340 **[Test build #145811 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/145811/testReport)** for PR 34718 at commit

[GitHub] [spark] SparkQA commented on pull request #34212: [SPARK-36402][PYTHON] Implement Series.combine

SparkQA commented on pull request #34212: URL: https://github.com/apache/spark/pull/34212#issuecomment-983482102 Kubernetes integration test status failure URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/50277/ -- This is an automated message from the

[GitHub] [spark] SparkQA commented on pull request #34712: [SPARK-37463][SQL] Read/Write Timestamp ntz or ltz to Orc uses UTC timestamp

SparkQA commented on pull request #34712: URL: https://github.com/apache/spark/pull/34712#issuecomment-983508705 **[Test build #145812 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/145812/testReport)** for PR 34712 at commit

[GitHub] [spark] AmplabJenkins commented on pull request #34764: [SPARK-37330][SQL] Migrate ReplaceTableStatement to v2 command

AmplabJenkins commented on pull request #34764: URL: https://github.com/apache/spark/pull/34764#issuecomment-983553655 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/145795/ -- This

[GitHub] [spark] dongjoon-hyun closed pull request #34706: [SPARK-37458][SS] Remove unnecessary SerializeFromObject from the plan of foreachBatch

dongjoon-hyun closed pull request #34706: URL: https://github.com/apache/spark/pull/34706 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [spark] HeartSaVioR commented on pull request #34706: [SPARK-37458][SS] Remove unnecessary SerializeFromObject from the plan of foreachBatch

HeartSaVioR commented on pull request #34706: URL: https://github.com/apache/spark/pull/34706#issuecomment-983383081 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To

[GitHub] [spark] cloud-fan commented on a change in pull request #34701: [SPARK-37450][SQL] Prune unnecessary fields from Generate under count-only Aggregate

cloud-fan commented on a change in pull request #34701: URL: https://github.com/apache/spark/pull/34701#discussion_r759945029 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/optimizer/Optimizer.scala ## @@ -2162,6 +2163,74 @@ object

[GitHub] [spark] SparkQA commented on pull request #34766: [SPARK-37513][SQL][DOC] date +/- interval with only day-time fields returns different data type between Spark3.2 and Spark3.1

SparkQA commented on pull request #34766: URL: https://github.com/apache/spark/pull/34766#issuecomment-983395418 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/50273/ -- This is an automated message from the Apache

[GitHub] [spark] SparkQA removed a comment on pull request #34212: [SPARK-36402][PYTHON] Implement Series.combine

SparkQA removed a comment on pull request #34212: URL: https://github.com/apache/spark/pull/34212#issuecomment-983373300 **[Test build #145803 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/145803/testReport)** for PR 34212 at commit

[GitHub] [spark] AmplabJenkins commented on pull request #34765: [WIP][SPARK-37487][SQL][CORE] Avoid performing CollectMetrics twice if the operation is followed by global sort.

AmplabJenkins commented on pull request #34765: URL: https://github.com/apache/spark/pull/34765#issuecomment-983402469 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/50269/ --

[GitHub] [spark] AmplabJenkins commented on pull request #34212: [SPARK-36402][PYTHON] Implement Series.combine

AmplabJenkins commented on pull request #34212: URL: https://github.com/apache/spark/pull/34212#issuecomment-983402466 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/145803/ -- This

[GitHub] [spark] AmplabJenkins commented on pull request #34764: [SPARK-37330][SQL] Migrate ReplaceTableStatement to v2 command

AmplabJenkins commented on pull request #34764: URL: https://github.com/apache/spark/pull/34764#issuecomment-983402467 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/50270/ --

[GitHub] [spark] AmplabJenkins removed a comment on pull request #34764: [SPARK-37330][SQL] Migrate ReplaceTableStatement to v2 command

AmplabJenkins removed a comment on pull request #34764: URL: https://github.com/apache/spark/pull/34764#issuecomment-983402467 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/50270/

[GitHub] [spark] AmplabJenkins removed a comment on pull request #34757: [SPARK-37504][PYTHON] Pyspark create SparkSession with existed session should not pass static conf

AmplabJenkins removed a comment on pull request #34757: URL: https://github.com/apache/spark/pull/34757#issuecomment-983402465 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/145800/

[GitHub] [spark] AmplabJenkins removed a comment on pull request #34765: [WIP][SPARK-37487][SQL][CORE] Avoid performing CollectMetrics twice if the operation is followed by global sort.

AmplabJenkins removed a comment on pull request #34765: URL: https://github.com/apache/spark/pull/34765#issuecomment-983402469 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/50269/

[GitHub] [spark] AmplabJenkins removed a comment on pull request #34212: [SPARK-36402][PYTHON] Implement Series.combine

AmplabJenkins removed a comment on pull request #34212: URL: https://github.com/apache/spark/pull/34212#issuecomment-983402466 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/145803/

[GitHub] [spark] AmplabJenkins removed a comment on pull request #34763: [SPARK-37389][SQL][FOLLOWUP] SET command shuold not parse comments

AmplabJenkins removed a comment on pull request #34763: URL: https://github.com/apache/spark/pull/34763#issuecomment-983402468 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/50271/

[GitHub] [spark] cloud-fan commented on a change in pull request #34673: [SPARK-37343][SQL] Implement createIndex, IndexExists and dropIndex in JDBC (Postgres dialect)

cloud-fan commented on a change in pull request #34673: URL: https://github.com/apache/spark/pull/34673#discussion_r759951994 ## File path: sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/jdbc/JdbcUtils.scala ## @@ -1073,6 +1075,66 @@ object JdbcUtils

[GitHub] [spark] AmplabJenkins commented on pull request #34757: [SPARK-37504][PYTHON] Pyspark create SparkSession with existed session should not pass static conf

AmplabJenkins commented on pull request #34757: URL: https://github.com/apache/spark/pull/34757#issuecomment-983402465 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/145800/ -- This

[GitHub] [spark] AmplabJenkins commented on pull request #34763: [SPARK-37389][SQL][FOLLOWUP] SET command shuold not parse comments

AmplabJenkins commented on pull request #34763: URL: https://github.com/apache/spark/pull/34763#issuecomment-983402468 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/50271/ --

[GitHub] [spark] AmplabJenkins commented on pull request #34761: [SPARK-37508][SQL] Add CONTAINS() string function

AmplabJenkins commented on pull request #34761: URL: https://github.com/apache/spark/pull/34761#issuecomment-983409939 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/145783/ -- This

[GitHub] [spark] AmplabJenkins removed a comment on pull request #34761: [SPARK-37508][SQL] Add CONTAINS() string function

AmplabJenkins removed a comment on pull request #34761: URL: https://github.com/apache/spark/pull/34761#issuecomment-983409939 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/145783/

[GitHub] [spark] AmplabJenkins removed a comment on pull request #34657: [SPARK-37511][PYTHON] Introduce TimedeltaIndex to pandas API on Spark

AmplabJenkins removed a comment on pull request #34657: URL: https://github.com/apache/spark/pull/34657#issuecomment-983414387 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/50268/

  1   2   3   4   5   6   7   >