[GitHub] [spark] AmplabJenkins removed a comment on pull request #33793: [SPARK-36549][SQL] Add taskStatus supports multiple value to monitoring doc

AmplabJenkins removed a comment on pull request #33793: URL: https://github.com/apache/spark/pull/33793#issuecomment-903048457 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/47180/

[GitHub] [spark] AmplabJenkins commented on pull request #33793: [SPARK-36549][SQL] Add taskStatus supports multiple value to monitoring doc

AmplabJenkins commented on pull request #33793: URL: https://github.com/apache/spark/pull/33793#issuecomment-903048457 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/47180/ -- T

[GitHub] [spark] SparkQA commented on pull request #33793: [SPARK-36549][SQL] Add taskStatus supports multiple value to monitoring doc

SparkQA commented on pull request #33793: URL: https://github.com/apache/spark/pull/33793#issuecomment-903046101 Kubernetes integration test status success URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/47180/ -- This is an automated message from the A

[GitHub] [spark] SparkQA commented on pull request #33793: [SPARK-36549][SQL] Add taskStatus supports multiple value to monitoring doc

SparkQA commented on pull request #33793: URL: https://github.com/apache/spark/pull/33793#issuecomment-903041541 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/47180/ -- This is an automated message from the Apache

[GitHub] [spark] AmplabJenkins removed a comment on pull request #33793: [SPARK-36549][SQL] Add taskStatus supports multiple value to monitoring doc

AmplabJenkins removed a comment on pull request #33793: URL: https://github.com/apache/spark/pull/33793#issuecomment-903041160 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/142678/ -

[GitHub] [spark] AmplabJenkins commented on pull request #33793: [SPARK-36549][SQL] Add taskStatus supports multiple value to monitoring doc

AmplabJenkins commented on pull request #33793: URL: https://github.com/apache/spark/pull/33793#issuecomment-903041160 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/142678/ -- This

[GitHub] [spark] HyukjinKwon edited a comment on pull request #33788: [MINOR] Fixes typo on javadoc for LogicalPlan#sameOutput

HyukjinKwon edited a comment on pull request #33788: URL: https://github.com/apache/spark/pull/33788#issuecomment-903040689 Yeah let's leave it -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to th

[GitHub] [spark] HyukjinKwon commented on pull request #33788: [MINOR] Fixes typo on javadoc for LogicalPlan#sameOutput

HyukjinKwon commented on pull request #33788: URL: https://github.com/apache/spark/pull/33788#issuecomment-903040689 Yeah let's leave ut -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the speci

[GitHub] [spark] SparkQA removed a comment on pull request #33793: [SPARK-36549][SQL] Add taskStatus supports multiple value to monitoring doc

SparkQA removed a comment on pull request #33793: URL: https://github.com/apache/spark/pull/33793#issuecomment-903035816 **[Test build #142678 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/142678/testReport)** for PR 33793 at commit [`7c0b06a`](https://gi

[GitHub] [spark] venkata91 commented on a change in pull request #33253: [SPARK-36038][CORE] Speculation metrics summary at stage level

venkata91 commented on a change in pull request #33253: URL: https://github.com/apache/spark/pull/33253#discussion_r693288502 ## File path: core/src/main/scala/org/apache/spark/status/AppStatusListener.scala ## @@ -1208,6 +1232,33 @@ private[spark] class AppStatusListener(

[GitHub] [spark] SparkQA commented on pull request #33793: [SPARK-36549][SQL] Add taskStatus supports multiple value to monitoring doc

SparkQA commented on pull request #33793: URL: https://github.com/apache/spark/pull/33793#issuecomment-903037487 **[Test build #142678 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/142678/testReport)** for PR 33793 at commit [`7c0b06a`](https://github.co

[GitHub] [spark] SparkQA commented on pull request #33793: [SPARK-36549][SQL] Add taskStatus supports multiple value to monitoring doc

SparkQA commented on pull request #33793: URL: https://github.com/apache/spark/pull/33793#issuecomment-903035816 **[Test build #142678 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/142678/testReport)** for PR 33793 at commit [`7c0b06a`](https://github.com

[GitHub] [spark] AngersZhuuuu commented on a change in pull request #33793: [SPARK-36549][SQL] Add taskStatus supports multiple value to monitoring doc

AngersZh commented on a change in pull request #33793: URL: https://github.com/apache/spark/pull/33793#discussion_r693286333 ## File path: docs/monitoring.md ## @@ -477,7 +477,7 @@ can be identified by their `[attempt-id]`. In the API listed below, when running A li

[GitHub] [spark] AngersZhuuuu commented on a change in pull request #33793: [SPARK-36549][SQL] Add taskStatus supports multiple value to monitoring doc

AngersZh commented on a change in pull request #33793: URL: https://github.com/apache/spark/pull/33793#discussion_r693286179 ## File path: docs/monitoring.md ## @@ -477,7 +477,7 @@ can be identified by their `[attempt-id]`. In the API listed below, when running A li

[GitHub] [spark] AmplabJenkins removed a comment on pull request #33800: [WIP][SPARK-34415][ML][FOLLOWUP] Choose random grid points in search actually randomly each time

AmplabJenkins removed a comment on pull request #33800: URL: https://github.com/apache/spark/pull/33800#issuecomment-903023208 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/47179/

[GitHub] [spark] AmplabJenkins commented on pull request #33800: [WIP][SPARK-34415][ML][FOLLOWUP] Choose random grid points in search actually randomly each time

AmplabJenkins commented on pull request #33800: URL: https://github.com/apache/spark/pull/33800#issuecomment-903023208 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/47179/ -- T

[GitHub] [spark] sumeetgajjar commented on pull request #33782: [SPARK-35011][CORE][3.0] Avoid Block Manager registrations when StopExecutor msg is in-flight

sumeetgajjar commented on pull request #33782: URL: https://github.com/apache/spark/pull/33782#issuecomment-903022497 Thank you @Ngone51 for merging this. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above

[GitHub] [spark] SparkQA commented on pull request #33800: [WIP][SPARK-34415][ML][FOLLOWUP] Choose random grid points in search actually randomly each time

SparkQA commented on pull request #33800: URL: https://github.com/apache/spark/pull/33800#issuecomment-903018133 Kubernetes integration test status failure URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/47179/ -- This is an automated message from the A

[GitHub] [spark] github-actions[bot] commented on pull request #32483: [SPARK-35355][SQL] In the case of insert with limit, improve execution performance

github-actions[bot] commented on pull request #32483: URL: https://github.com/apache/spark/pull/32483#issuecomment-903016199 We're closing this PR because it hasn't been updated in a while. This isn't a judgement on the merit of the PR in any way. It's just a way of keeping the PR queue ma

[GitHub] [spark] github-actions[bot] closed pull request #30057: [SPARK-32838][SQL]Check DataSource insert command path with actual path

github-actions[bot] closed pull request #30057: URL: https://github.com/apache/spark/pull/30057 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: re

[GitHub] [spark] github-actions[bot] commented on pull request #32510: [SPARK-35376][CORE] Fallback config should override defaultValue

github-actions[bot] commented on pull request #32510: URL: https://github.com/apache/spark/pull/32510#issuecomment-903016194 We're closing this PR because it hasn't been updated in a while. This isn't a judgement on the merit of the PR in any way. It's just a way of keeping the PR queue ma

[GitHub] [spark] github-actions[bot] commented on pull request #32514: [SPARK-35379][SQL]Improve InferFiltersFromConstraints rule performance when parsing spark sql

github-actions[bot] commented on pull request #32514: URL: https://github.com/apache/spark/pull/32514#issuecomment-903016184 We're closing this PR because it hasn't been updated in a while. This isn't a judgement on the merit of the PR in any way. It's just a way of keeping the PR queue ma

[GitHub] [spark] AmplabJenkins removed a comment on pull request #33800: [WIP][SPARK-34415][ML][FOLLOWUP] Choose random grid points in search actually randomly each time

AmplabJenkins removed a comment on pull request #33800: URL: https://github.com/apache/spark/pull/33800#issuecomment-903010546 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/142677/ -

[GitHub] [spark] AmplabJenkins commented on pull request #33800: [WIP][SPARK-34415][ML][FOLLOWUP] Choose random grid points in search actually randomly each time

AmplabJenkins commented on pull request #33800: URL: https://github.com/apache/spark/pull/33800#issuecomment-903010546 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/142677/ -- This

[GitHub] [spark] SparkQA removed a comment on pull request #33800: [WIP][SPARK-34415][ML][FOLLOWUP] Choose random grid points in search actually randomly each time

SparkQA removed a comment on pull request #33800: URL: https://github.com/apache/spark/pull/33800#issuecomment-902992141 **[Test build #142677 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/142677/testReport)** for PR 33800 at commit [`64cc2ab`](https://gi

[GitHub] [spark] SparkQA commented on pull request #33800: [WIP][SPARK-34415][ML][FOLLOWUP] Choose random grid points in search actually randomly each time

SparkQA commented on pull request #33800: URL: https://github.com/apache/spark/pull/33800#issuecomment-903010390 **[Test build #142677 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/142677/testReport)** for PR 33800 at commit [`64cc2ab`](https://github.co

[GitHub] [spark] SparkQA commented on pull request #33800: [WIP][SPARK-34415][ML][FOLLOWUP] Choose random grid points in search actually randomly each time

SparkQA commented on pull request #33800: URL: https://github.com/apache/spark/pull/33800#issuecomment-903005732 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/47179/ -- This is an automated message from the Apache

[GitHub] [spark] holdenk commented on pull request #33508: [SPARK-36058][K8S] Add support for statefulset APIs in K8s

holdenk commented on pull request #33508: URL: https://github.com/apache/spark/pull/33508#issuecomment-902996801 If there are no other concerns, I plan to merge this early next week (current dev branch only). -- This is an automated message from the Apache Git Service. To respond to the

[GitHub] [spark] SparkQA commented on pull request #33800: [WIP][SPARK-34415][ML][FOLLOWUP] Choose random grid points in search actually randomly each time

SparkQA commented on pull request #33800: URL: https://github.com/apache/spark/pull/33800#issuecomment-902992141 **[Test build #142677 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/142677/testReport)** for PR 33800 at commit [`64cc2ab`](https://github.com

[GitHub] [spark] AmplabJenkins removed a comment on pull request #33799: [SPARK-36374][FOLLOW-UP]Change config key spark.shuffle.server.mergedShuffleFileManagerImpl to spark.shuffle.push.server.merged

AmplabJenkins removed a comment on pull request #33799: URL: https://github.com/apache/spark/pull/33799#issuecomment-902991407 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/142676/ -

[GitHub] [spark] AmplabJenkins removed a comment on pull request #33706: [SPARK-36477][SQL] Inferring schema from JSON file shall handle CharConversionException/MalformedInputException

AmplabJenkins removed a comment on pull request #33706: URL: https://github.com/apache/spark/pull/33706#issuecomment-902991406 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/142671/ -

[GitHub] [spark] AmplabJenkins commented on pull request #33799: [SPARK-36374][FOLLOW-UP]Change config key spark.shuffle.server.mergedShuffleFileManagerImpl to spark.shuffle.push.server.mergedShuffleF

AmplabJenkins commented on pull request #33799: URL: https://github.com/apache/spark/pull/33799#issuecomment-902991407 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/142676/ -- This

[GitHub] [spark] AmplabJenkins commented on pull request #33706: [SPARK-36477][SQL] Inferring schema from JSON file shall handle CharConversionException/MalformedInputException

AmplabJenkins commented on pull request #33706: URL: https://github.com/apache/spark/pull/33706#issuecomment-902991406 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/142671/ -- This

[GitHub] [spark] SparkQA removed a comment on pull request #33706: [SPARK-36477][SQL] Inferring schema from JSON file shall handle CharConversionException/MalformedInputException

SparkQA removed a comment on pull request #33706: URL: https://github.com/apache/spark/pull/33706#issuecomment-902710616 **[Test build #142671 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/142671/testReport)** for PR 33706 at commit [`9e8b227`](https://gi

[GitHub] [spark] SparkQA removed a comment on pull request #33799: [SPARK-36374][FOLLOW-UP]Change config key spark.shuffle.server.mergedShuffleFileManagerImpl to spark.shuffle.push.server.mergedShuffl

SparkQA removed a comment on pull request #33799: URL: https://github.com/apache/spark/pull/33799#issuecomment-902914335 **[Test build #142676 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/142676/testReport)** for PR 33799 at commit [`f70db3f`](https://gi

[GitHub] [spark] SparkQA commented on pull request #33706: [SPARK-36477][SQL] Inferring schema from JSON file shall handle CharConversionException/MalformedInputException

SparkQA commented on pull request #33706: URL: https://github.com/apache/spark/pull/33706#issuecomment-902985612 **[Test build #142671 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/142671/testReport)** for PR 33706 at commit [`9e8b227`](https://github.co

[GitHub] [spark] SparkQA commented on pull request #33799: [SPARK-36374][FOLLOW-UP]Change config key spark.shuffle.server.mergedShuffleFileManagerImpl to spark.shuffle.push.server.mergedShuffleFileMan

SparkQA commented on pull request #33799: URL: https://github.com/apache/spark/pull/33799#issuecomment-902984842 **[Test build #142676 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/142676/testReport)** for PR 33799 at commit [`f70db3f`](https://github.co

[GitHub] [spark] srowen commented on pull request #33800: [WIP][SPARK-34415][ML][FOLLOWUP] Choose random grid points in search actually randomly each time

srowen commented on pull request #33800: URL: https://github.com/apache/spark/pull/33800#issuecomment-902984376 CC @PhillHenry @mengxr this is a quick take on the issue you noted in https://issues.apache.org/jira/browse/SPARK-34415 This, I think, gives the more desired behavior.

[GitHub] [spark] srowen opened a new pull request #33800: [WIP][SPARK-34415][ML][FOLLOWUP] Choose random grid points in search actually randomly each time

srowen opened a new pull request #33800: URL: https://github.com/apache/spark/pull/33800 ### What changes were proposed in this pull request? In the new ParamRandomBuilder, choose each grid point's values randomly each time, rather than choosing the _grid_ randomly and performing gri

[GitHub] [spark] SparkQA removed a comment on pull request #33695: [SPARK-34863][SQL] Support complex types for Parquet vectorized reader

SparkQA removed a comment on pull request #33695: URL: https://github.com/apache/spark/pull/33695#issuecomment-898809100 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To

[GitHub] [spark] dbtsai commented on pull request #33695: [SPARK-34863][SQL] Support complex types for Parquet vectorized reader

dbtsai commented on pull request #33695: URL: https://github.com/apache/spark/pull/33695#issuecomment-902976692 FYI @aokolnychyi @RussellSpitzer -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to

[GitHub] [spark] AmplabJenkins removed a comment on pull request #33508: [SPARK-36058][K8S] Add support for statefulset APIs in K8s

AmplabJenkins removed a comment on pull request #33508: URL: https://github.com/apache/spark/pull/33508#issuecomment-902970539 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/47178/

[GitHub] [spark] AmplabJenkins commented on pull request #33508: [SPARK-36058][K8S] Add support for statefulset APIs in K8s

AmplabJenkins commented on pull request #33508: URL: https://github.com/apache/spark/pull/33508#issuecomment-902970539 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/47178/ -- T

[GitHub] [spark] SparkQA commented on pull request #33508: [SPARK-36058][K8S] Add support for statefulset APIs in K8s

SparkQA commented on pull request #33508: URL: https://github.com/apache/spark/pull/33508#issuecomment-902955355 Kubernetes integration test status success URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/47178/ -- This is an automated message from the A

[GitHub] [spark] AmplabJenkins removed a comment on pull request #33799: [SPARK-36374][FOLLOW-UP]Change config key spark.shuffle.server.mergedShuffleFileManagerImpl to spark.shuffle.push.server.merged

AmplabJenkins removed a comment on pull request #33799: URL: https://github.com/apache/spark/pull/33799#issuecomment-902953071 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/47177/

[GitHub] [spark] AmplabJenkins commented on pull request #33799: [SPARK-36374][FOLLOW-UP]Change config key spark.shuffle.server.mergedShuffleFileManagerImpl to spark.shuffle.push.server.mergedShuffleF

AmplabJenkins commented on pull request #33799: URL: https://github.com/apache/spark/pull/33799#issuecomment-902953071 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/47177/ -- T

[GitHub] [spark] SparkQA commented on pull request #33799: [SPARK-36374][FOLLOW-UP]Change config key spark.shuffle.server.mergedShuffleFileManagerImpl to spark.shuffle.push.server.mergedShuffleFileMan

SparkQA commented on pull request #33799: URL: https://github.com/apache/spark/pull/33799#issuecomment-902953048 Kubernetes integration test status success URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/47177/ -- This is an automated message from the A

[GitHub] [spark] AmplabJenkins removed a comment on pull request #33508: [SPARK-36058][K8S] Add support for statefulset APIs in K8s

AmplabJenkins removed a comment on pull request #33508: URL: https://github.com/apache/spark/pull/33508#issuecomment-902951435 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/142675/ -

[GitHub] [spark] AmplabJenkins commented on pull request #33508: [SPARK-36058][K8S] Add support for statefulset APIs in K8s

AmplabJenkins commented on pull request #33508: URL: https://github.com/apache/spark/pull/33508#issuecomment-902951435 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/142675/ -- This

[GitHub] [spark] SparkQA removed a comment on pull request #33508: [SPARK-36058][K8S] Add support for statefulset APIs in K8s

SparkQA removed a comment on pull request #33508: URL: https://github.com/apache/spark/pull/33508#issuecomment-902892831 **[Test build #142675 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/142675/testReport)** for PR 33508 at commit [`362172c`](https://gi

[GitHub] [spark] SparkQA commented on pull request #33508: [SPARK-36058][K8S] Add support for statefulset APIs in K8s

SparkQA commented on pull request #33508: URL: https://github.com/apache/spark/pull/33508#issuecomment-902950709 **[Test build #142675 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/142675/testReport)** for PR 33508 at commit [`362172c`](https://github.co

[GitHub] [spark] xuanyuanking commented on pull request #33792: [SPARK-35312][SS][FOLLOW-UP] More documents and checking logic for the new options

xuanyuanking commented on pull request #33792: URL: https://github.com/apache/spark/pull/33792#issuecomment-902950584 Thank you for the quick review and merge. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL a

[GitHub] [spark] SparkQA commented on pull request #33508: [SPARK-36058][K8S] Add support for statefulset APIs in K8s

SparkQA commented on pull request #33508: URL: https://github.com/apache/spark/pull/33508#issuecomment-902937386 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/47178/ -- This is an automated message from the Apache

[GitHub] [spark] SparkQA commented on pull request #33799: [SPARK-36374][FOLLOW-UP]Change config key spark.shuffle.server.mergedShuffleFileManagerImpl to spark.shuffle.push.server.mergedShuffleFileMan

SparkQA commented on pull request #33799: URL: https://github.com/apache/spark/pull/33799#issuecomment-902935352 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/47177/ -- This is an automated message from the Apache

[GitHub] [spark] mridulm edited a comment on pull request #33799: [SPARK-36374][FOLLOW-UP]Change config key spark.shuffle.server.mergedShuffleFileManagerImpl to spark.shuffle.push.server.mergedShuffle

mridulm edited a comment on pull request #33799: URL: https://github.com/apache/spark/pull/33799#issuecomment-902915808 +CC @gengliangwang, @Ngone51 We should get this into branch-3.2 as well. -- This is an automated message from the Apache Git Service. To respond to the message,

[GitHub] [spark] mridulm commented on pull request #33799: [SPARK-36374][FOLLOW-UP]Change config key spark.shuffle.server.mergedShuffleFileManagerImpl to spark.shuffle.push.server.mergedShuffleFileMan

mridulm commented on pull request #33799: URL: https://github.com/apache/spark/pull/33799#issuecomment-902915808 +CC @gengliangwang, @Ngone51 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the

[GitHub] [spark] SparkQA commented on pull request #33799: [SPARK-36374][FOLLOW-UP]Change config key spark.shuffle.server.mergedShuffleFileManagerImpl to spark.shuffle.push.server.mergedShuffleFileMan

SparkQA commented on pull request #33799: URL: https://github.com/apache/spark/pull/33799#issuecomment-902914335 **[Test build #142676 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/142676/testReport)** for PR 33799 at commit [`f70db3f`](https://github.com

[GitHub] [spark] AmplabJenkins removed a comment on pull request #33650: [SPARK-36351][SQL] Refactor filter push down in file source v2

AmplabJenkins removed a comment on pull request #33650: URL: https://github.com/apache/spark/pull/33650#issuecomment-902912765 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/142672/ -

[GitHub] [spark] AmplabJenkins commented on pull request #33650: [SPARK-36351][SQL] Refactor filter push down in file source v2

AmplabJenkins commented on pull request #33650: URL: https://github.com/apache/spark/pull/33650#issuecomment-902912765 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/142672/ -- This

[GitHub] [spark] mridulm commented on pull request #33799: [SPARK-36374][FOLLOW-UP]Change config key spark.shuffle.server.mergedShuffleFileManagerImpl to spark.shuffle.push.server.mergedShuffleFileMan

mridulm commented on pull request #33799: URL: https://github.com/apache/spark/pull/33799#issuecomment-902912152 Ok to test -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment.

[GitHub] [spark] venkata91 commented on pull request #33799: [SPARK-36374][FOLLOW-UP]Change config key spark.shuffle.server.mergedShuffleFileManagerImpl to spark.shuffle.push.server.mergedShuffleFileM

venkata91 commented on pull request #33799: URL: https://github.com/apache/spark/pull/33799#issuecomment-902910533 cc @mridulm @Ngone51 I missed to change one of the config key to use `spark.shuffle.push.server.mergedShuffleFileManagerImpl`. Sorry about that. -- This is an automated mess

[GitHub] [spark] venkata91 opened a new pull request #33799: [SPARK-36374][FOLLOW-UP]Change config key spark.shuffle.server.mergedShuffleFileManagerImpl to spark.shuffle.push.server.mergedShuffleFileM

venkata91 opened a new pull request #33799: URL: https://github.com/apache/spark/pull/33799 ### What changes were proposed in this pull request? Minor changes to change the config key name from `spark.shuffle.server.mergedShuffleFileManagerImpl` to `spark.shuffle.push.se

[GitHub] [spark] SparkQA removed a comment on pull request #33650: [SPARK-36351][SQL] Refactor filter push down in file source v2

SparkQA removed a comment on pull request #33650: URL: https://github.com/apache/spark/pull/33650#issuecomment-902738032 **[Test build #142672 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/142672/testReport)** for PR 33650 at commit [`7156958`](https://gi

[GitHub] [spark] SparkQA commented on pull request #33650: [SPARK-36351][SQL] Refactor filter push down in file source v2

SparkQA commented on pull request #33650: URL: https://github.com/apache/spark/pull/33650#issuecomment-902899242 **[Test build #142672 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/142672/testReport)** for PR 33650 at commit [`7156958`](https://github.co

[GitHub] [spark] SparkQA commented on pull request #33508: [SPARK-36058][K8S] Add support for statefulset APIs in K8s

SparkQA commented on pull request #33508: URL: https://github.com/apache/spark/pull/33508#issuecomment-902892831 **[Test build #142675 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/142675/testReport)** for PR 33508 at commit [`362172c`](https://github.com

[GitHub] [spark] zsxwing commented on a change in pull request #33793: [SPARK-36549][SQL] Add taskStatus supports multiple value to monitoring doc

zsxwing commented on a change in pull request #33793: URL: https://github.com/apache/spark/pull/33793#discussion_r693146548 ## File path: docs/monitoring.md ## @@ -477,7 +477,7 @@ can be identified by their `[attempt-id]`. In the API listed below, when running A list of

[GitHub] [spark] AmplabJenkins removed a comment on pull request #33508: [SPARK-36058][K8S] Add support for statefulset APIs in K8s

AmplabJenkins removed a comment on pull request #33508: URL: https://github.com/apache/spark/pull/33508#issuecomment-902882646 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/142673/ -

[GitHub] [spark] AmplabJenkins commented on pull request #33508: [SPARK-36058][K8S] Add support for statefulset APIs in K8s

AmplabJenkins commented on pull request #33508: URL: https://github.com/apache/spark/pull/33508#issuecomment-902882646 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/142673/ -- This

[GitHub] [spark] SparkQA removed a comment on pull request #33508: [SPARK-36058][K8S] Add support for statefulset APIs in K8s

SparkQA removed a comment on pull request #33508: URL: https://github.com/apache/spark/pull/33508#issuecomment-902821437 **[Test build #142673 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/142673/testReport)** for PR 33508 at commit [`49ab072`](https://gi

[GitHub] [spark] AmplabJenkins removed a comment on pull request #33508: [SPARK-36058][K8S] Add support for statefulset APIs in K8s

AmplabJenkins removed a comment on pull request #33508: URL: https://github.com/apache/spark/pull/33508#issuecomment-902881726 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/47175/

[GitHub] [spark] AmplabJenkins removed a comment on pull request #33756: [SPARK-36470][PYTHON] Implement `CategoricalIndex.map` and `DatetimeIndex.map`

AmplabJenkins removed a comment on pull request #33756: URL: https://github.com/apache/spark/pull/33756#issuecomment-902881724 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment

[GitHub] [spark] SparkQA commented on pull request #33508: [SPARK-36058][K8S] Add support for statefulset APIs in K8s

SparkQA commented on pull request #33508: URL: https://github.com/apache/spark/pull/33508#issuecomment-902881911 **[Test build #142673 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/142673/testReport)** for PR 33508 at commit [`49ab072`](https://github.co

[GitHub] [spark] AmplabJenkins commented on pull request #33756: [SPARK-36470][PYTHON] Implement `CategoricalIndex.map` and `DatetimeIndex.map`

AmplabJenkins commented on pull request #33756: URL: https://github.com/apache/spark/pull/33756#issuecomment-902881724 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To un

[GitHub] [spark] AmplabJenkins commented on pull request #33508: [SPARK-36058][K8S] Add support for statefulset APIs in K8s

AmplabJenkins commented on pull request #33508: URL: https://github.com/apache/spark/pull/33508#issuecomment-902881726 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/47175/ -- T

[GitHub] [spark] SparkQA commented on pull request #33508: [SPARK-36058][K8S] Add support for statefulset APIs in K8s

SparkQA commented on pull request #33508: URL: https://github.com/apache/spark/pull/33508#issuecomment-902879297 Kubernetes integration test status failure URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/47175/ -- This is an automated message from the A

[GitHub] [spark] SparkQA removed a comment on pull request #33756: [SPARK-36470][PYTHON] Implement `CategoricalIndex.map` and `DatetimeIndex.map`

SparkQA removed a comment on pull request #33756: URL: https://github.com/apache/spark/pull/33756#issuecomment-902850839 **[Test build #142674 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/142674/testReport)** for PR 33756 at commit [`080b746`](https://gi

[GitHub] [spark] SparkQA commented on pull request #33756: [SPARK-36470][PYTHON] Implement `CategoricalIndex.map` and `DatetimeIndex.map`

SparkQA commented on pull request #33756: URL: https://github.com/apache/spark/pull/33756#issuecomment-902874637 Kubernetes integration test unable to build dist. exiting with code: 1 URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/47176/ -- This

[GitHub] [spark] catalinii commented on a change in pull request #32679: [SPARK-28098][SQL]Support read partitioned Hive tables with subdirect…

catalinii commented on a change in pull request #32679: URL: https://github.com/apache/spark/pull/32679#discussion_r693130413 ## File path: sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/InMemoryFileIndex.scala ## @@ -94,10 +97,23 @@ class InMemoryFileIndex

[GitHub] [spark] viirya commented on pull request #33650: [SPARK-36351][SQL] Refactor filter push down in file source v2

viirya commented on pull request #33650: URL: https://github.com/apache/spark/pull/33650#issuecomment-902867028 > @viirya If you look at the file scan (e.g. `ParquetScan`, https://github.com/apache/spark/blob/master/sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/v2/parqu

[GitHub] [spark] SparkQA commented on pull request #33756: [SPARK-36470][PYTHON] Implement `CategoricalIndex.map` and `DatetimeIndex.map`

SparkQA commented on pull request #33756: URL: https://github.com/apache/spark/pull/33756#issuecomment-902865433 **[Test build #142674 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/142674/testReport)** for PR 33756 at commit [`080b746`](https://github.co

[GitHub] [spark] sarutak commented on a change in pull request #33253: [SPARK-36038][CORE] Speculation metrics summary at stage level

sarutak commented on a change in pull request #33253: URL: https://github.com/apache/spark/pull/33253#discussion_r693123565 ## File path: core/src/main/scala/org/apache/spark/status/AppStatusListener.scala ## @@ -1208,6 +1232,33 @@ private[spark] class AppStatusListener( }

[GitHub] [spark] sarutak commented on a change in pull request #33253: [SPARK-36038][CORE] Speculation metrics summary at stage level

sarutak commented on a change in pull request #33253: URL: https://github.com/apache/spark/pull/33253#discussion_r693123565 ## File path: core/src/main/scala/org/apache/spark/status/AppStatusListener.scala ## @@ -1208,6 +1232,33 @@ private[spark] class AppStatusListener( }

[GitHub] [spark] viirya commented on pull request #33650: [SPARK-36351][SQL] Refactor filter push down in file source v2

viirya commented on pull request #33650: URL: https://github.com/apache/spark/pull/33650#issuecomment-902858157 `pushDataFilters` is not mentioned in the description. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use th

[GitHub] [spark] viirya commented on pull request #33650: [SPARK-36351][SQL] Refactor filter push down in file source v2

viirya commented on pull request #33650: URL: https://github.com/apache/spark/pull/33650#issuecomment-902856349 Some description looks ambiguous. E.g., > add pushFilters in file source v2. In this method... As you are adding a method to a class. It is better to use the exact cl

[GitHub] [spark] SparkQA commented on pull request #33756: [SPARK-36470][PYTHON] Implement `CategoricalIndex.map` and `DatetimeIndex.map`

SparkQA commented on pull request #33756: URL: https://github.com/apache/spark/pull/33756#issuecomment-902850839 **[Test build #142674 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/142674/testReport)** for PR 33756 at commit [`080b746`](https://github.com

[GitHub] [spark] SparkQA commented on pull request #33508: [SPARK-36058][K8S] Add support for statefulset APIs in K8s

SparkQA commented on pull request #33508: URL: https://github.com/apache/spark/pull/33508#issuecomment-902848441 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/47175/ -- This is an automated message from the Apache

[GitHub] [spark] xinrong-databricks commented on a change in pull request #33756: [SPARK-36470][PYTHON] Implement `CategoricalIndex.map` and `DatetimeIndex.map`

xinrong-databricks commented on a change in pull request #33756: URL: https://github.com/apache/spark/pull/33756#discussion_r693103627 ## File path: python/pyspark/pandas/tests/indexes/test_base.py ## @@ -516,19 +515,6 @@ def test_missing(self): getattr(psdf.se

[GitHub] [spark] SparkQA commented on pull request #33508: [SPARK-36058][K8S] Add support for statefulset APIs in K8s

SparkQA commented on pull request #33508: URL: https://github.com/apache/spark/pull/33508#issuecomment-902821437 **[Test build #142673 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/142673/testReport)** for PR 33508 at commit [`49ab072`](https://github.com

[GitHub] [spark] holdenk commented on pull request #33508: [SPARK-36058][K8S] Add support for statefulset APIs in K8s

holdenk commented on pull request #33508: URL: https://github.com/apache/spark/pull/33508#issuecomment-902820557 Jenkins retest this please. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the s

[GitHub] [spark] AmplabJenkins removed a comment on pull request #33650: [SPARK-36351][SQL] Refactor filter push down in file source v2

AmplabJenkins removed a comment on pull request #33650: URL: https://github.com/apache/spark/pull/33650#issuecomment-902815942 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/47174/

[GitHub] [spark] AmplabJenkins commented on pull request #33650: [SPARK-36351][SQL] Refactor filter push down in file source v2

AmplabJenkins commented on pull request #33650: URL: https://github.com/apache/spark/pull/33650#issuecomment-902815942 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/47174/ -- T

[GitHub] [spark] SparkQA commented on pull request #33650: [SPARK-36351][SQL] Refactor filter push down in file source v2

SparkQA commented on pull request #33650: URL: https://github.com/apache/spark/pull/33650#issuecomment-902812123 Kubernetes integration test status failure URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/47174/ -- This is an automated message from the A

[GitHub] [spark] AmplabJenkins removed a comment on pull request #33798: [SPARK-36552][SQL] Fix different behavior for writing char/varchar to hive and datasource table

AmplabJenkins removed a comment on pull request #33798: URL: https://github.com/apache/spark/pull/33798#issuecomment-902790094 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/142670/ -

[GitHub] [spark] AmplabJenkins commented on pull request #33798: [SPARK-36552][SQL] Fix different behavior for writing char/varchar to hive and datasource table

AmplabJenkins commented on pull request #33798: URL: https://github.com/apache/spark/pull/33798#issuecomment-902790094 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/142670/ -- This

[GitHub] [spark] SparkQA removed a comment on pull request #33798: [SPARK-36552][SQL] Fix different behavior for writing char/varchar to hive and datasource table

SparkQA removed a comment on pull request #33798: URL: https://github.com/apache/spark/pull/33798#issuecomment-902705245 **[Test build #142670 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/142670/testReport)** for PR 33798 at commit [`f33ca39`](https://gi

[GitHub] [spark] SparkQA commented on pull request #33798: [SPARK-36552][SQL] Fix different behavior for writing char/varchar to hive and datasource table

SparkQA commented on pull request #33798: URL: https://github.com/apache/spark/pull/33798#issuecomment-902789094 **[Test build #142670 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/142670/testReport)** for PR 33798 at commit [`f33ca39`](https://github.co

[GitHub] [spark] AmplabJenkins removed a comment on pull request #33706: [SPARK-36477][SQL] Inferring schema from JSON file shall handle CharConversionException/MalformedInputException

AmplabJenkins removed a comment on pull request #33706: URL: https://github.com/apache/spark/pull/33706#issuecomment-902787298 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/47173/

[GitHub] [spark] SparkQA commented on pull request #33706: [SPARK-36477][SQL] Inferring schema from JSON file shall handle CharConversionException/MalformedInputException

SparkQA commented on pull request #33706: URL: https://github.com/apache/spark/pull/33706#issuecomment-902787254 Kubernetes integration test status failure URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/47173/ -- This is an automated message from the A

[GitHub] [spark] AmplabJenkins commented on pull request #33706: [SPARK-36477][SQL] Inferring schema from JSON file shall handle CharConversionException/MalformedInputException

AmplabJenkins commented on pull request #33706: URL: https://github.com/apache/spark/pull/33706#issuecomment-902787298 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/47173/ -- T

[GitHub] [spark] AmplabJenkins removed a comment on pull request #33798: [SPARK-36552][SQL] Fix different behavior for writing char/varchar to hive and datasource table

AmplabJenkins removed a comment on pull request #33798: URL: https://github.com/apache/spark/pull/33798#issuecomment-902779134 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/47172/

  1   2   >