[GitHub] [spark] dongjoon-hyun commented on pull request #28587: [SPARK-31766][K8S][TESTS] Add Spark version prefix to K8s UUID test image tag

dongjoon-hyun commented on pull request #28587: URL: https://github.com/apache/spark/pull/28587#issuecomment-631254257 Thank you, @HyukjinKwon . Since this helps the testing infra, I'll backport to branch-3.0 too. This is

[GitHub] [spark] HyukjinKwon closed pull request #28587: [SPARK-31766][K8S][TESTS] Add Spark version prefix to K8s UUID test image tag

HyukjinKwon closed pull request #28587: URL: https://github.com/apache/spark/pull/28587 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to

[GitHub] [spark] HyukjinKwon commented on pull request #28587: [SPARK-31766][K8S][TESTS] Add Spark version prefix to K8s UUID test image tag

HyukjinKwon commented on pull request #28587: URL: https://github.com/apache/spark/pull/28587#issuecomment-631253486 Merged to master. This is an automated message from the Apache Git Service. To respond to the message,

[GitHub] [spark] HyukjinKwon commented on pull request #28589: [SPARK-31767][PYTHON][CORE] Remove ResourceInformation in pyspark module's namespace

HyukjinKwon commented on pull request #28589: URL: https://github.com/apache/spark/pull/28589#issuecomment-631249658 Thank you @dongjoon-hyun. This is an automated message from the Apache Git Service. To respond to the

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28585: [SPARK-31765][WEBUI] Upgrade HtmlUnit >= 2.37.0

AmplabJenkins removed a comment on pull request #28585: URL: https://github.com/apache/spark/pull/28585#issuecomment-631248730 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] SparkQA removed a comment on pull request #28585: [SPARK-31765][WEBUI] Upgrade HtmlUnit >= 2.37.0

SparkQA removed a comment on pull request #28585: URL: https://github.com/apache/spark/pull/28585#issuecomment-631205985 **[Test build #122866 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/122866/testReport)** for PR 28585 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28585: [SPARK-31765][WEBUI] Upgrade HtmlUnit >= 2.37.0

AmplabJenkins removed a comment on pull request #28585: URL: https://github.com/apache/spark/pull/28585#issuecomment-631248727 Merged build finished. Test FAILed. This is an automated message from the Apache Git Service. To

[GitHub] [spark] AmplabJenkins commented on pull request #28585: [SPARK-31765][WEBUI] Upgrade HtmlUnit >= 2.37.0

AmplabJenkins commented on pull request #28585: URL: https://github.com/apache/spark/pull/28585#issuecomment-631248727 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] SparkQA commented on pull request #28585: [SPARK-31765][WEBUI] Upgrade HtmlUnit >= 2.37.0

SparkQA commented on pull request #28585: URL: https://github.com/apache/spark/pull/28585#issuecomment-631248382 **[Test build #122866 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/122866/testReport)** for PR 28585 at commit

[GitHub] [spark] dongjoon-hyun closed pull request #28589: [SPARK-31767][PYTHON][CORE] Remove ResourceInformation in pyspark module's namespace

dongjoon-hyun closed pull request #28589: URL: https://github.com/apache/spark/pull/28589 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28527: [SPARK-31709][SQL] Proper base path for database/table location when it is a relative path

AmplabJenkins removed a comment on pull request #28527: URL: https://github.com/apache/spark/pull/28527#issuecomment-631247365 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins commented on pull request #28527: [SPARK-31709][SQL] Proper base path for database/table location when it is a relative path

AmplabJenkins commented on pull request #28527: URL: https://github.com/apache/spark/pull/28527#issuecomment-631247365 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] SparkQA commented on pull request #28527: [SPARK-31709][SQL] Proper base path for database/table location when it is a relative path

SparkQA commented on pull request #28527: URL: https://github.com/apache/spark/pull/28527#issuecomment-631246654 **[Test build #122859 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/122859/testReport)** for PR 28527 at commit

[GitHub] [spark] SparkQA removed a comment on pull request #28527: [SPARK-31709][SQL] Proper base path for database/table location when it is a relative path

SparkQA removed a comment on pull request #28527: URL: https://github.com/apache/spark/pull/28527#issuecomment-631146068 **[Test build #122859 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/122859/testReport)** for PR 28527 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28584: [SPARK-31730][CORE][TEST] Fix flaky tests in BarrierTaskContextSuite

AmplabJenkins removed a comment on pull request #28584: URL: https://github.com/apache/spark/pull/28584#issuecomment-631241387 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on pull request #28584: [SPARK-31730][CORE][TEST] Fix flaky tests in BarrierTaskContextSuite

AmplabJenkins commented on pull request #28584: URL: https://github.com/apache/spark/pull/28584#issuecomment-631241380 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28584: [SPARK-31730][CORE][TEST] Fix flaky tests in BarrierTaskContextSuite

AmplabJenkins removed a comment on pull request #28584: URL: https://github.com/apache/spark/pull/28584#issuecomment-631241380 Merged build finished. Test FAILed. This is an automated message from the Apache Git Service. To

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28589: [SPARK-31767][PYTHON][CORE] Remove ResourceInformation in pyspark module's namespace

AmplabJenkins removed a comment on pull request #28589: URL: https://github.com/apache/spark/pull/28589#issuecomment-631241298 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] SparkQA removed a comment on pull request #28584: [SPARK-31730][CORE][TEST] Fix flaky tests in BarrierTaskContextSuite

SparkQA removed a comment on pull request #28584: URL: https://github.com/apache/spark/pull/28584#issuecomment-631197540 **[Test build #122865 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/122865/testReport)** for PR 28584 at commit

[GitHub] [spark] AmplabJenkins commented on pull request #28589: [SPARK-31767][PYTHON][CORE] Remove ResourceInformation in pyspark module's namespace

AmplabJenkins commented on pull request #28589: URL: https://github.com/apache/spark/pull/28589#issuecomment-631241298 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] SparkQA removed a comment on pull request #28589: [SPARK-31767][PYTHON][CORE] Remove ResourceInformation in pyspark module's namespace

SparkQA removed a comment on pull request #28589: URL: https://github.com/apache/spark/pull/28589#issuecomment-631229769 **[Test build #122872 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/122872/testReport)** for PR 28589 at commit

[GitHub] [spark] SparkQA commented on pull request #28584: [SPARK-31730][CORE][TEST] Fix flaky tests in BarrierTaskContextSuite

SparkQA commented on pull request #28584: URL: https://github.com/apache/spark/pull/28584#issuecomment-631241046 **[Test build #122865 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/122865/testReport)** for PR 28584 at commit

[GitHub] [spark] SparkQA commented on pull request #28589: [SPARK-31767][PYTHON][CORE] Remove ResourceInformation in pyspark module's namespace

SparkQA commented on pull request #28589: URL: https://github.com/apache/spark/pull/28589#issuecomment-631240905 **[Test build #122872 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/122872/testReport)** for PR 28589 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28587: [SPARK-31766][K8S][TESTS] Add Spark version prefix to K8s UUID test image tag

AmplabJenkins removed a comment on pull request #28587: URL: https://github.com/apache/spark/pull/28587#issuecomment-631240376 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] SparkQA commented on pull request #28587: [SPARK-31766][K8S][TESTS] Add Spark version prefix to K8s UUID test image tag

SparkQA commented on pull request #28587: URL: https://github.com/apache/spark/pull/28587#issuecomment-631240358 Kubernetes integration test status success URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/27511/

[GitHub] [spark] AmplabJenkins commented on pull request #28587: [SPARK-31766][K8S][TESTS] Add Spark version prefix to K8s UUID test image tag

AmplabJenkins commented on pull request #28587: URL: https://github.com/apache/spark/pull/28587#issuecomment-631240376 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28590: [SPARK-31768][ML] add getMetrics in Evaluators

AmplabJenkins removed a comment on pull request #28590: URL: https://github.com/apache/spark/pull/28590#issuecomment-631237933 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins commented on pull request #28590: [SPARK-31768][ML] add getMetrics in Evaluators

AmplabJenkins commented on pull request #28590: URL: https://github.com/apache/spark/pull/28590#issuecomment-631237933 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] SparkQA commented on pull request #28590: [SPARK-31768][ML] add getMetrics in Evaluators

SparkQA commented on pull request #28590: URL: https://github.com/apache/spark/pull/28590#issuecomment-631237557 **[Test build #122873 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/122873/testReport)** for PR 28590 at commit

[GitHub] [spark] huaxingao opened a new pull request #28590: [SPARK-31768][ML] add getMetrics in Evaluators

huaxingao opened a new pull request #28590: URL: https://github.com/apache/spark/pull/28590 ### What changes were proposed in this pull request? add getMetrics in Evaluators to get the corresponding Metrics instance, so users can use it to get any of the metrics scores. For example:

[GitHub] [spark] dongjoon-hyun commented on pull request #28587: [SPARK-31766][K8S][TESTS] Add Spark version prefix to K8s UUID test image tag

dongjoon-hyun commented on pull request #28587: URL: https://github.com/apache/spark/pull/28587#issuecomment-631236882 Could you review this PR, @HyukjinKwon ? This is an automated message from the Apache Git Service. To

[GitHub] [spark] cloud-fan commented on pull request #28588: Revert [SPARK-27142][SPARK-31440] SQL rest API in branch 3.0

cloud-fan commented on pull request #28588: URL: https://github.com/apache/spark/pull/28588#issuecomment-631235208 It's unfortunate that we find problems in SQL REST API at this stage which is too late to change. LGTM to revert it from 3.0 and release it in 3.1.

[GitHub] [spark] SparkQA commented on pull request #28587: [SPARK-31766][K8S][TESTS] Add Spark version prefix to K8s UUID test image tag

SparkQA commented on pull request #28587: URL: https://github.com/apache/spark/pull/28587#issuecomment-631232801 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/27511/

[GitHub] [spark] HyukjinKwon closed pull request #28586: [SPARK-31748][PYTHON][3.0] Document resource module in PySpark doc and rename/move classes

HyukjinKwon closed pull request #28586: URL: https://github.com/apache/spark/pull/28586 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28586: [SPARK-31748][PYTHON][3.0] Document resource module in PySpark doc and rename/move classes

AmplabJenkins removed a comment on pull request #28586: URL: https://github.com/apache/spark/pull/28586#issuecomment-631231179 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] HyukjinKwon commented on pull request #28586: [SPARK-31748][PYTHON][3.0] Document resource module in PySpark doc and rename/move classes

HyukjinKwon commented on pull request #28586: URL: https://github.com/apache/spark/pull/28586#issuecomment-631231141 Merged to branch-3.0. Thanks. This is an automated message from the Apache Git Service. To respond to the

[GitHub] [spark] SparkQA removed a comment on pull request #28586: [SPARK-31748][PYTHON][3.0] Document resource module in PySpark doc and rename/move classes

SparkQA removed a comment on pull request #28586: URL: https://github.com/apache/spark/pull/28586#issuecomment-631221224 **[Test build #122869 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/122869/testReport)** for PR 28586 at commit

[GitHub] [spark] AmplabJenkins commented on pull request #28586: [SPARK-31748][PYTHON][3.0] Document resource module in PySpark doc and rename/move classes

AmplabJenkins commented on pull request #28586: URL: https://github.com/apache/spark/pull/28586#issuecomment-631231179 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] SparkQA commented on pull request #28586: [SPARK-31748][PYTHON][3.0] Document resource module in PySpark doc and rename/move classes

SparkQA commented on pull request #28586: URL: https://github.com/apache/spark/pull/28586#issuecomment-631230769 **[Test build #122869 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/122869/testReport)** for PR 28586 at commit

[GitHub] [spark] AmplabJenkins commented on pull request #28589: [SPARK-31767][PYTHON][CORE] Remove ResourceInformation in pyspark module's namespace

AmplabJenkins commented on pull request #28589: URL: https://github.com/apache/spark/pull/28589#issuecomment-631230092 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28589: [SPARK-31767][PYTHON][CORE] Remove ResourceInformation in pyspark module's namespace

AmplabJenkins removed a comment on pull request #28589: URL: https://github.com/apache/spark/pull/28589#issuecomment-631230092 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] SparkQA commented on pull request #28589: [SPARK-31767][PYTHON][CORE] Remove ResourceInformation in pyspark module's namespace

SparkQA commented on pull request #28589: URL: https://github.com/apache/spark/pull/28589#issuecomment-631229769 **[Test build #122872 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/122872/testReport)** for PR 28589 at commit

[GitHub] [spark] HyukjinKwon commented on pull request #28589: [SPARK-31767][PYTHON][CORE] Remove ResourceInformation in pyspark module's namespace

HyukjinKwon commented on pull request #28589: URL: https://github.com/apache/spark/pull/28589#issuecomment-631229613 This can be backported to branch-3.0 as well. This is an automated message from the Apache Git Service. To

[GitHub] [spark] gengliangwang commented on pull request #28588: Revert [SPARK-27142][SPARK-31440] SQL rest API in branch 3.0

gengliangwang commented on pull request #28588: URL: https://github.com/apache/spark/pull/28588#issuecomment-631229677 @ajithme thanks for understanding! The commits are still in the master branch and they will be 3.1 as well.

[GitHub] [spark] HyukjinKwon opened a new pull request #28589: [SPARK-31767][PYTHON][CORE] Remove ResourceInformation in pyspark module's namespace

HyukjinKwon opened a new pull request #28589: URL: https://github.com/apache/spark/pull/28589 ### What changes were proposed in this pull request? This PR proposes to only allow the import of `ResourceInformation` as below: ``` pyspark.resource.ResourceInformation ```

[GitHub] [spark] ajithme edited a comment on pull request #28588: Revert [SPARK-27142][SPARK-31440] SQL rest API in branch 3.0

ajithme edited a comment on pull request #28588: URL: https://github.com/apache/spark/pull/28588#issuecomment-631229046 agree. Its better to revert and we can reraise the PR on later release. will 3.x be a candidate for these PRs.?

[GitHub] [spark] ajithme commented on pull request #28588: Revert [SPARK-27142][SPARK-31440] SQL rest API in branch 3.0

ajithme commented on pull request #28588: URL: https://github.com/apache/spark/pull/28588#issuecomment-631229046 agree. Its better to revert and we can reraise the PR on later release. This is an automated message from the

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28575: [SPARK-31705][SQL] Push predicate through join by rewriting join condition to conjunctive normal form

AmplabJenkins removed a comment on pull request #28575: URL: https://github.com/apache/spark/pull/28575#issuecomment-631228921 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins commented on pull request #28575: [SPARK-31705][SQL] Push predicate through join by rewriting join condition to conjunctive normal form

AmplabJenkins commented on pull request #28575: URL: https://github.com/apache/spark/pull/28575#issuecomment-631228921 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28588: Revert [SPARK-27142][SPARK-31440] SQL rest API in branch 3.0

AmplabJenkins removed a comment on pull request #28588: URL: https://github.com/apache/spark/pull/28588#issuecomment-631228387 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] SparkQA removed a comment on pull request #28575: [SPARK-31705][SQL] Push predicate through join by rewriting join condition to conjunctive normal form

SparkQA removed a comment on pull request #28575: URL: https://github.com/apache/spark/pull/28575#issuecomment-631146069 **[Test build #122857 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/122857/testReport)** for PR 28575 at commit

[GitHub] [spark] gengliangwang commented on pull request #28588: Revert [SPARK-27142][SPARK-31440] SQL rest API in branch 3.0

gengliangwang commented on pull request #28588: URL: https://github.com/apache/spark/pull/28588#issuecomment-631228555 cc @erenavsarogullari @ajithme as well This is an automated message from the Apache Git Service. To

[GitHub] [spark] AmplabJenkins commented on pull request #28588: Revert [SPARK-27142][SPARK-31440] SQL rest API in branch 3.0

AmplabJenkins commented on pull request #28588: URL: https://github.com/apache/spark/pull/28588#issuecomment-631228387 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] SparkQA commented on pull request #28575: [SPARK-31705][SQL] Push predicate through join by rewriting join condition to conjunctive normal form

SparkQA commented on pull request #28575: URL: https://github.com/apache/spark/pull/28575#issuecomment-631228285 **[Test build #122857 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/122857/testReport)** for PR 28575 at commit

[GitHub] [spark] SparkQA commented on pull request #28588: Revert [SPARK-27142][SPARK-31440] SQL rest API in branch 3.0

SparkQA commented on pull request #28588: URL: https://github.com/apache/spark/pull/28588#issuecomment-631228091 **[Test build #122871 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/122871/testReport)** for PR 28588 at commit

[GitHub] [spark] gengliangwang commented on pull request #24076: [SPARK-27142][SQL] Provide REST API for SQL information

gengliangwang commented on pull request #24076: URL: https://github.com/apache/spark/pull/24076#issuecomment-631227143 @ajithme I think we have to revert this one in branch-3.0. See my comments in https://github.com/apache/spark/pull/28588

[GitHub] [spark] gengliangwang commented on pull request #28208: [SPARK-31440][SQL] Improve SQL Rest API

gengliangwang commented on pull request #28208: URL: https://github.com/apache/spark/pull/28208#issuecomment-631227040 @erenavsarogullari I think we have to revert this one in branch-3.0. See my comments in https://github.com/apache/spark/pull/28588

[GitHub] [spark] gengliangwang opened a new pull request #28588: Revert [SPARK-27142][SPARK-31440] SQL rest API in branch 3.0

gengliangwang opened a new pull request #28588: URL: https://github.com/apache/spark/pull/28588 ### What changes were proposed in this pull request? Revert https://github.com/apache/spark/pull/28208 and https://github.com/apache/spark/pull/24076 in branch 3.0 ### Why

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28587: [SPARK-31766][K8S][TESTS] Add Spark version prefix to K8s UUID test image tag

AmplabJenkins removed a comment on pull request #28587: URL: https://github.com/apache/spark/pull/28587#issuecomment-631225112 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins commented on pull request #28587: [SPARK-31766][K8S][TESTS] Add Spark version prefix to K8s UUID test image tag

AmplabJenkins commented on pull request #28587: URL: https://github.com/apache/spark/pull/28587#issuecomment-631225112 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] SparkQA removed a comment on pull request #28587: [SPARK-31766][K8S][TESTS] Add Spark version prefix to K8s UUID test image tag

SparkQA removed a comment on pull request #28587: URL: https://github.com/apache/spark/pull/28587#issuecomment-631221225 **[Test build #122868 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/122868/testReport)** for PR 28587 at commit

[GitHub] [spark] SparkQA commented on pull request #28587: [SPARK-31766][K8S][TESTS] Add Spark version prefix to K8s UUID test image tag

SparkQA commented on pull request #28587: URL: https://github.com/apache/spark/pull/28587#issuecomment-631225005 **[Test build #122868 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/122868/testReport)** for PR 28587 at commit

[GitHub] [spark] AmplabJenkins commented on pull request #26624: [SPARK-8981][CORE][test-hadoop3.2][test-java11] Add MDC support in Executor

AmplabJenkins commented on pull request #26624: URL: https://github.com/apache/spark/pull/26624#issuecomment-631221498 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins commented on pull request #28586: [SPARK-31748][PYTHON][3.0] Document resource module in PySpark doc and rename/move classes

AmplabJenkins commented on pull request #28586: URL: https://github.com/apache/spark/pull/28586#issuecomment-631221486 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28586: [SPARK-31748][PYTHON][3.0] Document resource module in PySpark doc and rename/move classes

AmplabJenkins removed a comment on pull request #28586: URL: https://github.com/apache/spark/pull/28586#issuecomment-631221486 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins removed a comment on pull request #26624: [SPARK-8981][CORE][test-hadoop3.2][test-java11] Add MDC support in Executor

AmplabJenkins removed a comment on pull request #26624: URL: https://github.com/apache/spark/pull/26624#issuecomment-631221498 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] SparkQA commented on pull request #28587: [SPARK-31766][K8S][TESTS] Add Spark version prefix to K8s UUID test image tag

SparkQA commented on pull request #28587: URL: https://github.com/apache/spark/pull/28587#issuecomment-631221225 **[Test build #122868 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/122868/testReport)** for PR 28587 at commit

[GitHub] [spark] SparkQA commented on pull request #28586: [SPARK-31748][PYTHON][3.0] Document resource module in PySpark doc and rename/move classes

SparkQA commented on pull request #28586: URL: https://github.com/apache/spark/pull/28586#issuecomment-631221224 **[Test build #122869 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/122869/testReport)** for PR 28586 at commit

[GitHub] [spark] SparkQA commented on pull request #26624: [SPARK-8981][CORE][test-hadoop3.2][test-java11] Add MDC support in Executor

SparkQA commented on pull request #26624: URL: https://github.com/apache/spark/pull/26624#issuecomment-631221221 **[Test build #122870 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/122870/testReport)** for PR 26624 at commit

[GitHub] [spark] cloud-fan commented on pull request #26624: [SPARK-8981][CORE][test-hadoop3.2][test-java11] Add MDC support in Executor

cloud-fan commented on pull request #26624: URL: https://github.com/apache/spark/pull/26624#issuecomment-631220794 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub

[GitHub] [spark] dongjoon-hyun opened a new pull request #28587: [SPARK-31766][K8S][TESTS] Add Spark version prefix to K8s UUID test image tag

dongjoon-hyun opened a new pull request #28587: URL: https://github.com/apache/spark/pull/28587 … ### What changes were proposed in this pull request? ### Why are the changes needed? ### Does this PR introduce _any_ user-facing change?

[GitHub] [spark] cloud-fan commented on a change in pull request #28576: [SPARK-31755][SQL] allow missing year/hour when parsing date/timestamp string

cloud-fan commented on a change in pull request #28576: URL: https://github.com/apache/spark/pull/28576#discussion_r427726709 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/util/DateTimeFormatterHelper.scala ## @@ -31,17 +31,50 @@ import

[GitHub] [spark] cloud-fan commented on a change in pull request #28576: [SPARK-31755][SQL] allow missing year/hour when parsing date/timestamp string

cloud-fan commented on a change in pull request #28576: URL: https://github.com/apache/spark/pull/28576#discussion_r427726478 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/util/DateTimeFormatterHelper.scala ## @@ -31,17 +31,50 @@ import

[GitHub] [spark] cloud-fan commented on a change in pull request #28576: [SPARK-31755][SQL] allow missing year/hour when parsing date/timestamp string

cloud-fan commented on a change in pull request #28576: URL: https://github.com/apache/spark/pull/28576#discussion_r427726258 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/util/DateTimeFormatterHelper.scala ## @@ -31,17 +31,50 @@ import

[GitHub] [spark] cloud-fan closed pull request #28523: [SPARK-31706][SQL] add back the support of streaming update mode

cloud-fan closed pull request #28523: URL: https://github.com/apache/spark/pull/28523 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go

[GitHub] [spark] cloud-fan commented on pull request #28523: [SPARK-31706][SQL] add back the support of streaming update mode

cloud-fan commented on pull request #28523: URL: https://github.com/apache/spark/pull/28523#issuecomment-631218314 merging to master/3.0, thanks for the review! This is an automated message from the Apache Git Service. To

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28586: [SPARK-31748][PYTHON][3.0] Document resource module in PySpark doc and rename/move classes

AmplabJenkins removed a comment on pull request #28586: URL: https://github.com/apache/spark/pull/28586#issuecomment-631217581 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] SparkQA removed a comment on pull request #28586: [SPARK-31748][PYTHON][3.0] Document resource module in PySpark doc and rename/move classes

SparkQA removed a comment on pull request #28586: URL: https://github.com/apache/spark/pull/28586#issuecomment-631211570 **[Test build #122867 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/122867/testReport)** for PR 28586 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28586: [SPARK-31748][PYTHON][3.0] Document resource module in PySpark doc and rename/move classes

AmplabJenkins removed a comment on pull request #28586: URL: https://github.com/apache/spark/pull/28586#issuecomment-631217576 Merged build finished. Test FAILed. This is an automated message from the Apache Git Service. To

[GitHub] [spark] AmplabJenkins commented on pull request #28586: [SPARK-31748][PYTHON][3.0] Document resource module in PySpark doc and rename/move classes

AmplabJenkins commented on pull request #28586: URL: https://github.com/apache/spark/pull/28586#issuecomment-631217576 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] SparkQA commented on pull request #28586: [SPARK-31748][PYTHON][3.0] Document resource module in PySpark doc and rename/move classes

SparkQA commented on pull request #28586: URL: https://github.com/apache/spark/pull/28586#issuecomment-631217499 **[Test build #122867 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/122867/testReport)** for PR 28586 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28586: [SPARK-31748][PYTHON][3.0] Document resource module in PySpark doc and rename/move classes

AmplabJenkins removed a comment on pull request #28586: URL: https://github.com/apache/spark/pull/28586#issuecomment-631211891 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins commented on pull request #28586: [SPARK-31748][PYTHON][3.0] Document resource module in PySpark doc and rename/move classes

AmplabJenkins commented on pull request #28586: URL: https://github.com/apache/spark/pull/28586#issuecomment-631211891 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] yaooqinn commented on pull request #28574: [SPARK-31752][SQL][DOCS] Add sql doc for interval type

yaooqinn commented on pull request #28574: URL: https://github.com/apache/spark/pull/28574#issuecomment-631211798 One thing is how to categorize all data types, and the other is to decide the outline and content based on the generality and difference of those types. We may set a good

[GitHub] [spark] SparkQA commented on pull request #28586: [SPARK-31748][PYTHON][3.0] Document resource module in PySpark doc and rename/move classes

SparkQA commented on pull request #28586: URL: https://github.com/apache/spark/pull/28586#issuecomment-631211570 **[Test build #122867 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/122867/testReport)** for PR 28586 at commit

[GitHub] [spark] HyukjinKwon commented on pull request #28586: [SPARK-31748][PYTHON][3.0] Document resource module in PySpark doc and rename/move classes

HyukjinKwon commented on pull request #28586: URL: https://github.com/apache/spark/pull/28586#issuecomment-631210515 cc @dongjoon-hyun, can you take a quick look? This is an automated message from the Apache Git Service. To

[GitHub] [spark] HyukjinKwon opened a new pull request #28586: [SPARK-31748][PYTHON][3.0] Document resource module in PySpark doc and rename/move classes

HyukjinKwon opened a new pull request #28586: URL: https://github.com/apache/spark/pull/28586 ### What changes were proposed in this pull request? This PR partially backports https://github.com/apache/spark/pull/28569. 1.. Rename ``` pyspark └──

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28578: [SPARK-31756][WEBUI] Add real headless browser support for UI test

AmplabJenkins removed a comment on pull request #28578: URL: https://github.com/apache/spark/pull/28578#issuecomment-631209414 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins commented on pull request #28578: [SPARK-31756][WEBUI] Add real headless browser support for UI test

AmplabJenkins commented on pull request #28578: URL: https://github.com/apache/spark/pull/28578#issuecomment-631209414 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] SparkQA removed a comment on pull request #28578: [SPARK-31756][WEBUI] Add real headless browser support for UI test

SparkQA removed a comment on pull request #28578: URL: https://github.com/apache/spark/pull/28578#issuecomment-631154272 **[Test build #122863 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/122863/testReport)** for PR 28578 at commit

[GitHub] [spark] SparkQA commented on pull request #28578: [SPARK-31756][WEBUI] Add real headless browser support for UI test

SparkQA commented on pull request #28578: URL: https://github.com/apache/spark/pull/28578#issuecomment-631208800 **[Test build #122863 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/122863/testReport)** for PR 28578 at commit

[GitHub] [spark] sarutak commented on a change in pull request #28585: [SPARK-31765][WEBUI] Upgrade HtmlUnit >= 2.37.0

sarutak commented on a change in pull request #28585: URL: https://github.com/apache/spark/pull/28585#discussion_r427716093 ## File path: core/src/main/scala/org/apache/spark/ui/JettyUtils.scala ## @@ -500,7 +501,11 @@ private[spark] case class ServerInfo( threadPool

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28585: [SPARK-31765][WEBUI] Upgrade HtmlUnit >= 2.37.0

AmplabJenkins removed a comment on pull request #28585: URL: https://github.com/apache/spark/pull/28585#issuecomment-631206283 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins commented on pull request #28585: [SPARK-31765][WEBUI] Upgrade HtmlUnit >= 2.37.0

AmplabJenkins commented on pull request #28585: URL: https://github.com/apache/spark/pull/28585#issuecomment-631206283 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] SparkQA commented on pull request #28585: [SPARK-31765][WEBUI] Upgrade HtmlUnit >= 2.37.0

SparkQA commented on pull request #28585: URL: https://github.com/apache/spark/pull/28585#issuecomment-631205985 **[Test build #122866 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/122866/testReport)** for PR 28585 at commit

[GitHub] [spark] sarutak opened a new pull request #28585: [SPARK-31765][WEBUI] Upgrade HtmlUnit >= 2.37.0

sarutak opened a new pull request #28585: URL: https://github.com/apache/spark/pull/28585 ### What changes were proposed in this pull request? This PR upgrades HtmlUnit. Selenium and Jetty also upgraded because of dependency. ### Why are the changes needed? Recently, a

[GitHub] [spark] maropu commented on a change in pull request #28580: [SPARK-31759][Deploy] Support configurable max number of rotate logs for spark daemons

maropu commented on a change in pull request #28580: URL: https://github.com/apache/spark/pull/28580#discussion_r427710973 ## File path: sbin/spark-daemon.sh ## @@ -74,10 +75,13 @@ shift spark_rotate_log () { log=$1; -num=5; -if [ -n "$2" ]; then - num=$2

[GitHub] [spark] yaooqinn commented on pull request #28511: [SPARK-31684][SQL] Overwrite partition failed with 'WRONG FS' when the target partition is not belong to the filesystem as same as the table

yaooqinn commented on pull request #28511: URL: https://github.com/apache/spark/pull/28511#issuecomment-631198476 thanks for reviewing and merging! This is an automated message from the Apache Git Service. To respond to the

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28584: [SPARK-31730][CORE][TEST] Fix flaky tests in BarrierTaskContextSuite

AmplabJenkins removed a comment on pull request #28584: URL: https://github.com/apache/spark/pull/28584#issuecomment-631197828 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28584: [SPARK-31730][CORE][TEST] Fix flaky tests in BarrierTaskContextSuite

AmplabJenkins removed a comment on pull request #28584: URL: https://github.com/apache/spark/pull/28584#issuecomment-631197375 Test FAILed. Refer to this link for build results (access rights to CI server needed):

  1   2   3   4   5   6   >