[GitHub] [spark] AngersZhuuuu commented on a change in pull request #30156: [SPARK-33248][SQL] Add a configuration to control the legacy behavior of whether need to pad null value when value size less

AngersZh commented on a change in pull request #30156: URL: https://github.com/apache/spark/pull/30156#discussion_r512381921 ## File path: sql/core/src/main/scala/org/apache/spark/sql/execution/BaseScriptTransformationExec.scala ## @@ -104,10 +104,16 @@ trait

[GitHub] [spark] HeartSaVioR commented on pull request #30148: [SPARK-33244][SQL] Unify the code paths for spark.table and spark.read.table

HeartSaVioR commented on pull request #30148: URL: https://github.com/apache/spark/pull/30148#issuecomment-716940007 This effectively prevents `spark.read.table` to check for the mode - `spark.table` can be used on both batch and streaming, whereas `spark.read.table` shouldn't (we just

[GitHub] [spark] beliefer commented on a change in pull request #29800: [SPARK-32934][SQL] Improve the performance for NTH_VALUE and reactor the OffsetWindowFunction

beliefer commented on a change in pull request #29800: URL: https://github.com/apache/spark/pull/29800#discussion_r512381721 ## File path: sql/core/src/main/scala/org/apache/spark/sql/execution/window/WindowExecBase.scala ## @@ -172,17 +179,41 @@ trait WindowExecBase extends

[GitHub] [spark] HeartSaVioR commented on pull request #30126: [SPARK-33215][WEBUI] Speed up event log download by skipping UI rebuild

HeartSaVioR commented on pull request #30126: URL: https://github.com/apache/spark/pull/30126#issuecomment-716940154 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub

[GitHub] [spark] AngersZhuuuu opened a new pull request #30156: [SPARK-33248][SQL] Add a configuration to control the legacy behavior of whether need to pad null value when value size less then schema

AngersZh opened a new pull request #30156: URL: https://github.com/apache/spark/pull/30156 ### What changes were proposed in this pull request? Add a configuration to control the legacy behavior of whether need to pad null value when value size less then schema size. Since we

[GitHub] [spark] AmplabJenkins removed a comment on pull request #30145: [SPARK-33233][SQL]CUBE/ROLLUP/GROUPING SETS support GROUP BY ordinal

AmplabJenkins removed a comment on pull request #30145: URL: https://github.com/apache/spark/pull/30145#issuecomment-716939329 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on pull request #30145: [SPARK-33233][SQL]CUBE/ROLLUP/GROUPING SETS support GROUP BY ordinal

AmplabJenkins commented on pull request #30145: URL: https://github.com/apache/spark/pull/30145#issuecomment-716939316 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] SparkQA commented on pull request #30145: [SPARK-33233][SQL]CUBE/ROLLUP/GROUPING SETS support GROUP BY ordinal

SparkQA commented on pull request #30145: URL: https://github.com/apache/spark/pull/30145#issuecomment-716939308 Kubernetes integration test status failure URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/34907/

[GitHub] [spark] AmplabJenkins removed a comment on pull request #30145: [SPARK-33233][SQL]CUBE/ROLLUP/GROUPING SETS support GROUP BY ordinal

AmplabJenkins removed a comment on pull request #30145: URL: https://github.com/apache/spark/pull/30145#issuecomment-716939316 Merged build finished. Test FAILed. This is an automated message from the Apache Git Service. To

[GitHub] [spark] SparkQA commented on pull request #30154: [SPARK-32405][SQL] Apply table options while creating tables in JDBC Table Catalog

SparkQA commented on pull request #30154: URL: https://github.com/apache/spark/pull/30154#issuecomment-716937709 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/34908/

[GitHub] [spark] beliefer commented on a change in pull request #29800: [SPARK-32934][SQL] Improve the performance for NTH_VALUE and reactor the OffsetWindowFunction

beliefer commented on a change in pull request #29800: URL: https://github.com/apache/spark/pull/29800#discussion_r512376963 ## File path: sql/core/src/main/scala/org/apache/spark/sql/execution/window/WindowExecBase.scala ## @@ -136,8 +136,15 @@ trait WindowExecBase extends

[GitHub] [spark] beliefer commented on a change in pull request #29800: [SPARK-32934][SQL] Improve the performance for NTH_VALUE and reactor the OffsetWindowFunction

beliefer commented on a change in pull request #29800: URL: https://github.com/apache/spark/pull/29800#discussion_r512376471 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/windowExpressions.scala ## @@ -355,6 +344,35 @@ abstract class

[GitHub] [spark] SparkQA commented on pull request #30145: [SPARK-33233][SQL]CUBE/ROLLUP/GROUPING SETS support GROUP BY ordinal

SparkQA commented on pull request #30145: URL: https://github.com/apache/spark/pull/30145#issuecomment-716931879 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/34907/

[GitHub] [spark] HyukjinKwon commented on pull request #30143: [SPARK-32084][PYTHON][SQL] Expand dictionary functions

HyukjinKwon commented on pull request #30143: URL: https://github.com/apache/spark/pull/30143#issuecomment-716930118 Merged to master. This is an automated message from the Apache Git Service. To respond to the message,

[GitHub] [spark] HyukjinKwon closed pull request #30143: [SPARK-32084][PYTHON][SQL] Expand dictionary functions

HyukjinKwon closed pull request #30143: URL: https://github.com/apache/spark/pull/30143 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to

[GitHub] [spark] HyukjinKwon commented on a change in pull request #30143: [SPARK-32084][PYTHON][SQL] Expand dictionary functions

HyukjinKwon commented on a change in pull request #30143: URL: https://github.com/apache/spark/pull/30143#discussion_r512367831 ## File path: python/pyspark/sql/functions.py ## @@ -42,154 +41,457 @@ # since it requires to make every single overridden definition. -def

[GitHub] [spark] SparkQA commented on pull request #28938: [WIP][SPARK-32118][SQL] Use fine-grained read write lock for each database in HiveExternalCatalog

SparkQA commented on pull request #28938: URL: https://github.com/apache/spark/pull/28938#issuecomment-716929003 **[Test build #130307 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/130307/testReport)** for PR 28938 at commit

[GitHub] [spark] LantaoJin commented on pull request #28938: [WIP][SPARK-32118][SQL] Use fine-grained read write lock for each database in HiveExternalCatalog

LantaoJin commented on pull request #28938: URL: https://github.com/apache/spark/pull/28938#issuecomment-716928333 retest this please This is an automated message from the Apache Git Service. To respond to the message,

[GitHub] [spark] LantaoJin commented on pull request #29890: [SPARK-33014][SQL] Support multiple bucket columns in DataSourceV2 table

LantaoJin commented on pull request #29890: URL: https://github.com/apache/spark/pull/29890#issuecomment-716925255 Gentle ping @cloud-fan @HyukjinKwon @dongjoon-hyun again This is an automated message from the Apache Git

[GitHub] [spark] SparkQA commented on pull request #30154: [SPARK-32405][SQL] Apply table options while creating tables in JDBC Table Catalog

SparkQA commented on pull request #30154: URL: https://github.com/apache/spark/pull/30154#issuecomment-716923554 **[Test build #130306 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/130306/testReport)** for PR 30154 at commit

[GitHub] [spark] huaxingao commented on pull request #30154: [SPARK-32405][SQL] Apply table options while creating tables in JDBC Table Catalog

huaxingao commented on pull request #30154: URL: https://github.com/apache/spark/pull/30154#issuecomment-716922392 retest this please This is an automated message from the Apache Git Service. To respond to the message,

[GitHub] [spark] SparkQA commented on pull request #30145: [SPARK-33233][SQL]CUBE/ROLLUP/GROUPING SETS support GROUP BY ordinal

SparkQA commented on pull request #30145: URL: https://github.com/apache/spark/pull/30145#issuecomment-716919084 **[Test build #130305 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/130305/testReport)** for PR 30145 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #30155: [SPARK-33231][CORE] Make pod allocation executor timeouts configurable

AmplabJenkins removed a comment on pull request #30155: URL: https://github.com/apache/spark/pull/30155#issuecomment-716912043 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins commented on pull request #30155: [SPARK-33231][CORE] Make pod allocation executor timeouts configurable

AmplabJenkins commented on pull request #30155: URL: https://github.com/apache/spark/pull/30155#issuecomment-716912043 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] SparkQA commented on pull request #30155: [SPARK-33231][CORE] Make pod allocation executor timeouts configurable

SparkQA commented on pull request #30155: URL: https://github.com/apache/spark/pull/30155#issuecomment-716912027 Kubernetes integration test status success URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/34906/

[GitHub] [spark] AmplabJenkins removed a comment on pull request #30130: [WIP][SPARK-32354][K8S][TESTS] Re-enable RTestsSuite

AmplabJenkins removed a comment on pull request #30130: URL: https://github.com/apache/spark/pull/30130#issuecomment-716909771 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on pull request #30130: [WIP][SPARK-32354][K8S][TESTS] Re-enable RTestsSuite

AmplabJenkins removed a comment on pull request #30130: URL: https://github.com/apache/spark/pull/30130#issuecomment-716909762 Merged build finished. Test FAILed. This is an automated message from the Apache Git Service. To

[GitHub] [spark] AmplabJenkins commented on pull request #30130: [WIP][SPARK-32354][K8S][TESTS] Re-enable RTestsSuite

AmplabJenkins commented on pull request #30130: URL: https://github.com/apache/spark/pull/30130#issuecomment-716909762 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] SparkQA commented on pull request #30130: [WIP][SPARK-32354][K8S][TESTS] Re-enable RTestsSuite

SparkQA commented on pull request #30130: URL: https://github.com/apache/spark/pull/30130#issuecomment-716909734 Kubernetes integration test status failure URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/34905/

[GitHub] [spark] AmplabJenkins removed a comment on pull request #30154: [SPARK-32405][SQL] Apply table options while creating tables in JDBC Table Catalog

AmplabJenkins removed a comment on pull request #30154: URL: https://github.com/apache/spark/pull/30154#issuecomment-716909073 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on pull request #30154: [SPARK-32405][SQL] Apply table options while creating tables in JDBC Table Catalog

AmplabJenkins removed a comment on pull request #30154: URL: https://github.com/apache/spark/pull/30154#issuecomment-716909067 Merged build finished. Test FAILed. This is an automated message from the Apache Git Service. To

[GitHub] [spark] AmplabJenkins commented on pull request #30154: [SPARK-32405][SQL] Apply table options while creating tables in JDBC Table Catalog

AmplabJenkins commented on pull request #30154: URL: https://github.com/apache/spark/pull/30154#issuecomment-716909067 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] SparkQA removed a comment on pull request #30154: [SPARK-32405][SQL] Apply table options while creating tables in JDBC Table Catalog

SparkQA removed a comment on pull request #30154: URL: https://github.com/apache/spark/pull/30154#issuecomment-716871143 **[Test build #130302 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/130302/testReport)** for PR 30154 at commit

[GitHub] [spark] github-actions[bot] commented on pull request #28731: [SPARK-31909][SQL] Add SPARK_SUBMIT_OPTS to Beeline Script

github-actions[bot] commented on pull request #28731: URL: https://github.com/apache/spark/pull/28731#issuecomment-716908544 We're closing this PR because it hasn't been updated in a while. This isn't a judgement on the merit of the PR in any way. It's just a way of keeping the PR queue

[GitHub] [spark] SparkQA commented on pull request #30154: [SPARK-32405][SQL] Apply table options while creating tables in JDBC Table Catalog

SparkQA commented on pull request #30154: URL: https://github.com/apache/spark/pull/30154#issuecomment-716908605 **[Test build #130302 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/130302/testReport)** for PR 30154 at commit

[GitHub] [spark] github-actions[bot] closed pull request #28994: [SPARK-32170][CORE] Improve the speculation for the inefficient tasks by the task metrics.

github-actions[bot] closed pull request #28994: URL: https://github.com/apache/spark/pull/28994 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL

[GitHub] [spark] github-actions[bot] commented on pull request #28256: [SPARK-31483][PySpark] Use SPARK_PYTHON or 'python' to run find_spark_home.py

github-actions[bot] commented on pull request #28256: URL: https://github.com/apache/spark/pull/28256#issuecomment-716908550 We're closing this PR because it hasn't been updated in a while. This isn't a judgement on the merit of the PR in any way. It's just a way of keeping the PR queue

[GitHub] [spark] HyukjinKwon closed pull request #30150: [SPARK-32188][PYTHON][DOCS][FOLLOW-UP] Document Column APIs in API reference

HyukjinKwon closed pull request #30150: URL: https://github.com/apache/spark/pull/30150 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to

[GitHub] [spark] HyukjinKwon commented on pull request #30150: [SPARK-32188][PYTHON][DOCS][FOLLOW-UP] Document Column APIs in API reference

HyukjinKwon commented on pull request #30150: URL: https://github.com/apache/spark/pull/30150#issuecomment-716906968 Merged to master. This is an automated message from the Apache Git Service. To respond to the message,

[GitHub] [spark] HyukjinKwon edited a comment on pull request #30150: [SPARK-32188][PYTHON][DOCS][FOLLOW-UP] Document Column APIs in API reference

HyukjinKwon edited a comment on pull request #30150: URL: https://github.com/apache/spark/pull/30150#issuecomment-716904192 Yeah, good point to have examples. I will file an umbrella ticket for that. We can create sub-tasks. I filed SPARK-33247. We'll have to move to numpydoc style first

[GitHub] [spark] SparkQA commented on pull request #30155: [SPARK-33231][CORE] Make pod allocation executor timeouts configurable

SparkQA commented on pull request #30155: URL: https://github.com/apache/spark/pull/30155#issuecomment-716905709 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/34906/

[GitHub] [spark] HyukjinKwon commented on pull request #30150: [SPARK-32188][PYTHON][DOCS][FOLLOW-UP] Document Column APIs in API reference

HyukjinKwon commented on pull request #30150: URL: https://github.com/apache/spark/pull/30150#issuecomment-716904192 Yeah, good point to have examples. I will file an umbrella ticket for that. We can create sub-tasks. This

[GitHub] [spark] SparkQA commented on pull request #30130: [WIP][SPARK-32354][K8S][TESTS] Re-enable RTestsSuite

SparkQA commented on pull request #30130: URL: https://github.com/apache/spark/pull/30130#issuecomment-716901639 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/34905/

[GitHub] [spark] HyukjinKwon closed pull request #29421: [SPARK-32388][SQL] TRANSFORM with schema-less mode should keep the same with hive

HyukjinKwon closed pull request #29421: URL: https://github.com/apache/spark/pull/29421 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to

[GitHub] [spark] HyukjinKwon commented on pull request #29421: [SPARK-32388][SQL] TRANSFORM with schema-less mode should keep the same with hive

HyukjinKwon commented on pull request #29421: URL: https://github.com/apache/spark/pull/29421#issuecomment-716899254 Merged to master. This is an automated message from the Apache Git Service. To respond to the message,

[GitHub] [spark] AmplabJenkins removed a comment on pull request #30155: [SPARK-33231][CORE] Make pod allocation executor timeouts configurable

AmplabJenkins removed a comment on pull request #30155: URL: https://github.com/apache/spark/pull/30155#issuecomment-716896945 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins removed a comment on pull request #30154: [SPARK-32405][SQL] Apply table options while creating tables in JDBC Table Catalog

AmplabJenkins removed a comment on pull request #30154: URL: https://github.com/apache/spark/pull/30154#issuecomment-716896944 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] SparkQA removed a comment on pull request #30155: [SPARK-33231][CORE] Make pod allocation executor timeouts configurable

SparkQA removed a comment on pull request #30155: URL: https://github.com/apache/spark/pull/30155#issuecomment-716892631 **[Test build #130304 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/130304/testReport)** for PR 30155 at commit

[GitHub] [spark] SparkQA commented on pull request #30154: [SPARK-32405][SQL] Apply table options while creating tables in JDBC Table Catalog

SparkQA commented on pull request #30154: URL: https://github.com/apache/spark/pull/30154#issuecomment-716896934 Kubernetes integration test status success URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/34904/

[GitHub] [spark] AmplabJenkins commented on pull request #30154: [SPARK-32405][SQL] Apply table options while creating tables in JDBC Table Catalog

AmplabJenkins commented on pull request #30154: URL: https://github.com/apache/spark/pull/30154#issuecomment-716896944 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins commented on pull request #30155: [SPARK-33231][CORE] Make pod allocation executor timeouts configurable

AmplabJenkins commented on pull request #30155: URL: https://github.com/apache/spark/pull/30155#issuecomment-716896945 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] SparkQA commented on pull request #30155: [SPARK-33231][CORE] Make pod allocation executor timeouts configurable

SparkQA commented on pull request #30155: URL: https://github.com/apache/spark/pull/30155#issuecomment-716896795 **[Test build #130304 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/130304/testReport)** for PR 30155 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #30155: [SPARK-33231][CORE] Make pod allocation executor timeouts configurable

AmplabJenkins removed a comment on pull request #30155: URL: https://github.com/apache/spark/pull/30155#issuecomment-716894352 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on pull request #30155: [SPARK-33231][CORE] Make pod allocation executor timeouts configurable

AmplabJenkins removed a comment on pull request #30155: URL: https://github.com/apache/spark/pull/30155#issuecomment-716894347 Merged build finished. Test FAILed. This is an automated message from the Apache Git Service. To

[GitHub] [spark] AmplabJenkins commented on pull request #30155: [SPARK-33231][CORE] Make pod allocation executor timeouts configurable

AmplabJenkins commented on pull request #30155: URL: https://github.com/apache/spark/pull/30155#issuecomment-716894347 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] SparkQA commented on pull request #30155: [SPARK-33231][CORE] Make pod allocation executor timeouts configurable

SparkQA commented on pull request #30155: URL: https://github.com/apache/spark/pull/30155#issuecomment-716894338 Kubernetes integration test status failure URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/34903/

[GitHub] [spark] AmplabJenkins removed a comment on pull request #30154: [SPARK-32405][SQL] Apply table options while creating tables in JDBC Table Catalog

AmplabJenkins removed a comment on pull request #30154: URL: https://github.com/apache/spark/pull/30154#issuecomment-716893346 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins commented on pull request #30154: [SPARK-32405][SQL] Apply table options while creating tables in JDBC Table Catalog

AmplabJenkins commented on pull request #30154: URL: https://github.com/apache/spark/pull/30154#issuecomment-716893346 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] SparkQA commented on pull request #30154: [SPARK-32405][SQL] Apply table options while creating tables in JDBC Table Catalog

SparkQA commented on pull request #30154: URL: https://github.com/apache/spark/pull/30154#issuecomment-716893330 Kubernetes integration test status success URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/34902/

[GitHub] [spark] SparkQA commented on pull request #30155: [SPARK-33231][CORE] Make pod allocation executor timeouts configurable

SparkQA commented on pull request #30155: URL: https://github.com/apache/spark/pull/30155#issuecomment-716892631 **[Test build #130304 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/130304/testReport)** for PR 30155 at commit

[GitHub] [spark] BryanCutler commented on pull request #29818: [SPARK-32953][PYTHON] Add Arrow self_destruct support to toPandas

BryanCutler commented on pull request #29818: URL: https://github.com/apache/spark/pull/29818#issuecomment-716889755 @lidavidm I'm a little swamped right now with some other things, but will take another look as soon as I can.

[GitHub] [spark] SparkQA removed a comment on pull request #30130: [WIP][SPARK-32354][K8S][TESTS] Re-enable RTestsSuite

SparkQA removed a comment on pull request #30130: URL: https://github.com/apache/spark/pull/30130#issuecomment-716884839 **[Test build #130303 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/130303/testReport)** for PR 30130 at commit

[GitHub] [spark] holdenk commented on pull request #30155: [SPARK-33231][CORE] Make pod allocation executor timeouts configurable

holdenk commented on pull request #30155: URL: https://github.com/apache/spark/pull/30155#issuecomment-716889302 Revert the change in ExecutorPodsAllocatorSuite.scala and then try and run the test This is an automated

[GitHub] [spark] holdenk commented on a change in pull request #30155: [SPARK-33231][CORE] Make pod allocation executor timeouts configurable

holdenk commented on a change in pull request #30155: URL: https://github.com/apache/spark/pull/30155#discussion_r512337317 ## File path: resource-managers/kubernetes/core/src/main/scala/org/apache/spark/deploy/k8s/Config.scala ## @@ -227,6 +227,14 @@ private[spark] object

[GitHub] [spark] holdenk commented on a change in pull request #30155: [SPARK-33231][CORE] Make pod allocation executor timeouts configurable

holdenk commented on a change in pull request #30155: URL: https://github.com/apache/spark/pull/30155#discussion_r512337517 ## File path: resource-managers/kubernetes/core/src/main/scala/org/apache/spark/deploy/k8s/Config.scala ## @@ -227,6 +227,14 @@ private[spark] object

[GitHub] [spark] AmplabJenkins removed a comment on pull request #30130: [WIP][SPARK-32354][K8S][TESTS] Re-enable RTestsSuite

AmplabJenkins removed a comment on pull request #30130: URL: https://github.com/apache/spark/pull/30130#issuecomment-716889090 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] BryanCutler commented on a change in pull request #30149: [SPARK-33243][PYTHON][BUILD] Add numpydoc into documentation dependency

BryanCutler commented on a change in pull request #30149: URL: https://github.com/apache/spark/pull/30149#discussion_r512337126 ## File path: python/pyspark/context.py ## @@ -83,40 +130,6 @@ class SparkContext(object): def __init__(self, master=None, appName=None,

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29970: [SPARK-33087][SQL] DataFrameWriterV2 should delegate table resolution to the analyzer

AmplabJenkins removed a comment on pull request #29970: URL: https://github.com/apache/spark/pull/29970#issuecomment-71612 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on pull request #30130: [WIP][SPARK-32354][K8S][TESTS] Re-enable RTestsSuite

AmplabJenkins commented on pull request #30130: URL: https://github.com/apache/spark/pull/30130#issuecomment-716889090 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] SparkQA commented on pull request #30130: [WIP][SPARK-32354][K8S][TESTS] Re-enable RTestsSuite

SparkQA commented on pull request #30130: URL: https://github.com/apache/spark/pull/30130#issuecomment-716888935 **[Test build #130303 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/130303/testReport)** for PR 30130 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29970: [SPARK-33087][SQL] DataFrameWriterV2 should delegate table resolution to the analyzer

AmplabJenkins removed a comment on pull request #29970: URL: https://github.com/apache/spark/pull/29970#issuecomment-71604 Merged build finished. Test FAILed. This is an automated message from the Apache Git Service. To

[GitHub] [spark] SparkQA commented on pull request #29970: [SPARK-33087][SQL] DataFrameWriterV2 should delegate table resolution to the analyzer

SparkQA commented on pull request #29970: URL: https://github.com/apache/spark/pull/29970#issuecomment-716888790 Kubernetes integration test status failure URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/34901/

[GitHub] [spark] AmplabJenkins commented on pull request #29970: [SPARK-33087][SQL] DataFrameWriterV2 should delegate table resolution to the analyzer

AmplabJenkins commented on pull request #29970: URL: https://github.com/apache/spark/pull/29970#issuecomment-71604 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] holdenk commented on a change in pull request #30155: [SPARK-33231][CORE] Make pod allocation executor timeouts configurable

holdenk commented on a change in pull request #30155: URL: https://github.com/apache/spark/pull/30155#discussion_r512336669 ## File path: resource-managers/kubernetes/core/src/main/scala/org/apache/spark/scheduler/cluster/k8s/ExecutorPodsAllocator.scala ## @@ -214,10 +216,9

[GitHub] [spark] AmplabJenkins removed a comment on pull request #30130: [WIP][SPARK-32354][K8S][TESTS] Re-enable RTestsSuite

AmplabJenkins removed a comment on pull request #30130: URL: https://github.com/apache/spark/pull/30130#issuecomment-716886953 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] SparkQA commented on pull request #30154: [SPARK-32405][SQL] Apply table options while creating tables in JDBC Table Catalog

SparkQA commented on pull request #30154: URL: https://github.com/apache/spark/pull/30154#issuecomment-716887314 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/34904/

[GitHub] [spark] AmplabJenkins removed a comment on pull request #30130: [WIP][SPARK-32354][K8S][TESTS] Re-enable RTestsSuite

AmplabJenkins removed a comment on pull request #30130: URL: https://github.com/apache/spark/pull/30130#issuecomment-716886945 Merged build finished. Test FAILed. This is an automated message from the Apache Git Service. To

[GitHub] [spark] SparkQA commented on pull request #30130: [WIP][SPARK-32354][K8S][TESTS] Re-enable RTestsSuite

SparkQA commented on pull request #30130: URL: https://github.com/apache/spark/pull/30130#issuecomment-716886931 Kubernetes integration test status failure URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/34900/

[GitHub] [spark] AmplabJenkins commented on pull request #30130: [WIP][SPARK-32354][K8S][TESTS] Re-enable RTestsSuite

AmplabJenkins commented on pull request #30130: URL: https://github.com/apache/spark/pull/30130#issuecomment-716886945 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] SparkQA commented on pull request #30155: [SPARK-33231][CORE] Make pod allocation executor timeouts configurable

SparkQA commented on pull request #30155: URL: https://github.com/apache/spark/pull/30155#issuecomment-716886195 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/34903/

[GitHub] [spark] SparkQA commented on pull request #30130: [WIP][SPARK-32354][K8S][TESTS] Re-enable RTestsSuite

SparkQA commented on pull request #30130: URL: https://github.com/apache/spark/pull/30130#issuecomment-716884839 **[Test build #130303 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/130303/testReport)** for PR 30130 at commit

[GitHub] [spark] SparkQA commented on pull request #30154: [SPARK-32405][SQL] Apply table options while creating tables in JDBC Table Catalog

SparkQA commented on pull request #30154: URL: https://github.com/apache/spark/pull/30154#issuecomment-716883297 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/34902/

[GitHub] [spark] dongjoon-hyun commented on a change in pull request #30155: [SPARK-33231][CORE] Make pod allocation executor timeouts configurable

dongjoon-hyun commented on a change in pull request #30155: URL: https://github.com/apache/spark/pull/30155#discussion_r512330529 ## File path: resource-managers/kubernetes/core/src/main/scala/org/apache/spark/scheduler/cluster/k8s/ExecutorPodsAllocator.scala ## @@ -214,10

[GitHub] [spark] dongjoon-hyun commented on a change in pull request #30155: [SPARK-33231][CORE] Make pod allocation executor timeouts configurable

dongjoon-hyun commented on a change in pull request #30155: URL: https://github.com/apache/spark/pull/30155#discussion_r512330374 ## File path: resource-managers/kubernetes/core/src/main/scala/org/apache/spark/scheduler/cluster/k8s/ExecutorPodsAllocator.scala ## @@ -214,10

[GitHub] [spark] HeartSaVioR commented on a change in pull request #26935: [SPARK-30294][SS] Explicitly defines read-only StateStore and optimize for HDFSBackedStateStore

HeartSaVioR commented on a change in pull request #26935: URL: https://github.com/apache/spark/pull/26935#discussion_r512329977 ## File path: sql/core/src/main/scala/org/apache/spark/sql/execution/streaming/state/StateStoreRDD.scala ## @@ -29,14 +29,51 @@ import

[GitHub] [spark] HeartSaVioR commented on a change in pull request #26935: [SPARK-30294][SS] Explicitly defines read-only StateStore and optimize for HDFSBackedStateStore

HeartSaVioR commented on a change in pull request #26935: URL: https://github.com/apache/spark/pull/26935#discussion_r512329942 ## File path: sql/core/src/main/scala/org/apache/spark/sql/execution/streaming/state/StateStoreRDD.scala ## @@ -29,14 +29,51 @@ import

[GitHub] [spark] HeartSaVioR commented on a change in pull request #26935: [SPARK-30294][SS] Explicitly defines read-only StateStore and optimize for HDFSBackedStateStore

HeartSaVioR commented on a change in pull request #26935: URL: https://github.com/apache/spark/pull/26935#discussion_r512329430 ## File path: sql/core/src/main/scala/org/apache/spark/sql/execution/streaming/state/StateStore.scala ## @@ -379,6 +428,21 @@ object StateStore

[GitHub] [spark] SparkQA commented on pull request #29970: [SPARK-33087][SQL] DataFrameWriterV2 should delegate table resolution to the analyzer

SparkQA commented on pull request #29970: URL: https://github.com/apache/spark/pull/29970#issuecomment-716880883 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/34901/

[GitHub] [spark] dongjoon-hyun commented on a change in pull request #30155: [SPARK-33231][CORE] Make pod allocation executor timeouts configurable

dongjoon-hyun commented on a change in pull request #30155: URL: https://github.com/apache/spark/pull/30155#discussion_r512328539 ## File path: resource-managers/kubernetes/core/src/main/scala/org/apache/spark/deploy/k8s/Config.scala ## @@ -227,6 +227,14 @@ private[spark]

[GitHub] [spark] dongjoon-hyun commented on a change in pull request #30155: [SPARK-33231][CORE] Make pod allocation executor timeouts configurable

dongjoon-hyun commented on a change in pull request #30155: URL: https://github.com/apache/spark/pull/30155#discussion_r512328539 ## File path: resource-managers/kubernetes/core/src/main/scala/org/apache/spark/deploy/k8s/Config.scala ## @@ -227,6 +227,14 @@ private[spark]

[GitHub] [spark] HeartSaVioR commented on a change in pull request #26935: [SPARK-30294][SS] Explicitly defines read-only StateStore and optimize for HDFSBackedStateStore

HeartSaVioR commented on a change in pull request #26935: URL: https://github.com/apache/spark/pull/26935#discussion_r512328018 ## File path: sql/core/src/main/scala/org/apache/spark/sql/execution/streaming/state/StateStore.scala ## @@ -89,16 +116,16 @@ trait StateStore {

[GitHub] [spark] dongjoon-hyun commented on a change in pull request #30155: [SPARK-33231][CORE] Make pod allocation executor timeouts configurable

dongjoon-hyun commented on a change in pull request #30155: URL: https://github.com/apache/spark/pull/30155#discussion_r512327125 ## File path: resource-managers/kubernetes/core/src/main/scala/org/apache/spark/deploy/k8s/Config.scala ## @@ -227,6 +227,14 @@ private[spark]

[GitHub] [spark] dongjoon-hyun commented on a change in pull request #30155: [SPARK-33231][CORE] Make pod allocation executor timeouts configurable

dongjoon-hyun commented on a change in pull request #30155: URL: https://github.com/apache/spark/pull/30155#discussion_r512327125 ## File path: resource-managers/kubernetes/core/src/main/scala/org/apache/spark/deploy/k8s/Config.scala ## @@ -227,6 +227,14 @@ private[spark]

[GitHub] [spark] SparkQA commented on pull request #30130: [WIP][SPARK-32354][K8S][TESTS] Re-enable RTestsSuite

SparkQA commented on pull request #30130: URL: https://github.com/apache/spark/pull/30130#issuecomment-716876286 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/34900/

[GitHub] [spark] AmplabJenkins commented on pull request #30155: [SPARK-33231][CORE] Make pod allocation executor timeouts configurable

AmplabJenkins commented on pull request #30155: URL: https://github.com/apache/spark/pull/30155#issuecomment-716875202 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins removed a comment on pull request #30155: [SPARK-33231][CORE] Make pod allocation executor timeouts configurable

AmplabJenkins removed a comment on pull request #30155: URL: https://github.com/apache/spark/pull/30155#issuecomment-716875202 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] SparkQA removed a comment on pull request #30155: [SPARK-33231][CORE] Make pod allocation executor timeouts configurable

SparkQA removed a comment on pull request #30155: URL: https://github.com/apache/spark/pull/30155#issuecomment-716871108 **[Test build #130301 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/130301/testReport)** for PR 30155 at commit

[GitHub] [spark] SparkQA commented on pull request #30155: [SPARK-33231][CORE] Make pod allocation executor timeouts configurable

SparkQA commented on pull request #30155: URL: https://github.com/apache/spark/pull/30155#issuecomment-716875052 **[Test build #130301 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/130301/testReport)** for PR 30155 at commit

[GitHub] [spark] SparkQA commented on pull request #30154: [SPARK-32405][SQL] Apply table options while creating tables in JDBC Table Catalog

SparkQA commented on pull request #30154: URL: https://github.com/apache/spark/pull/30154#issuecomment-716871143 **[Test build #130302 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/130302/testReport)** for PR 30154 at commit

[GitHub] [spark] SparkQA commented on pull request #30155: [SPARK-33231][CORE] Make pod allocation executor timeouts configurable

SparkQA commented on pull request #30155: URL: https://github.com/apache/spark/pull/30155#issuecomment-716871108 **[Test build #130301 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/130301/testReport)** for PR 30155 at commit

<    1   2   3   4   5   6   7   8   >