[GitHub] [spark] huaxingao commented on a change in pull request #28786: [SPARK-31925][ML] Summary.totalIterations greater than maxIters

huaxingao commented on a change in pull request #28786: URL: https://github.com/apache/spark/pull/28786#discussion_r438331048 ## File path: mllib/src/main/scala/org/apache/spark/ml/classification/LogisticRegression.scala ## @@ -594,7 +594,7 @@ class LogisticRegression @Since("

[GitHub] [spark] huaxingao commented on a change in pull request #28786: [SPARK-31925][ML] Summary.totalIterations greater than maxIters

huaxingao commented on a change in pull request #28786: URL: https://github.com/apache/spark/pull/28786#discussion_r438331234 ## File path: mllib/src/test/scala/org/apache/spark/ml/classification/LogisticRegressionSuite.scala ## @@ -2570,7 +2573,7 @@ class LogisticRegressionSu

[GitHub] [spark] jiangxb1987 commented on pull request #28746: [SPARK-31922][CORE] Fix "RpcEnv already stopped" error when exit spark-shell with local-cluster mode

jiangxb1987 commented on pull request #28746: URL: https://github.com/apache/spark/pull/28746#issuecomment-642184659 retest this please This is an automated message from the Apache Git Service. To respond to the message, plea

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28708: [SPARK-20629][CORE][K8S] Copy shuffle data when nodes are being shutdown

AmplabJenkins removed a comment on pull request #28708: URL: https://github.com/apache/spark/pull/28708#issuecomment-642183063 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8

[GitHub] [spark] SparkQA commented on pull request #28708: [SPARK-20629][CORE][K8S] Copy shuffle data when nodes are being shutdown

SparkQA commented on pull request #28708: URL: https://github.com/apache/spark/pull/28708#issuecomment-642183030 Kubernetes integration test status failure URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/28397/ ---

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28708: [SPARK-20629][CORE][K8S] Copy shuffle data when nodes are being shutdown

AmplabJenkins removed a comment on pull request #28708: URL: https://github.com/apache/spark/pull/28708#issuecomment-642183054 Merged build finished. Test FAILed. This is an automated message from the Apache Git Service. To r

[GitHub] [spark] AmplabJenkins commented on pull request #28708: [SPARK-20629][CORE][K8S] Copy shuffle data when nodes are being shutdown

AmplabJenkins commented on pull request #28708: URL: https://github.com/apache/spark/pull/28708#issuecomment-642183054 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28787: [SPARK-31959][SQL] Fix Gregorian-Julian micros rebasing while switching standard time zone offset

AmplabJenkins removed a comment on pull request #28787: URL: https://github.com/apache/spark/pull/28787#issuecomment-642181266 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins commented on pull request #28787: [SPARK-31959][SQL] Fix Gregorian-Julian micros rebasing while switching standard time zone offset

AmplabJenkins commented on pull request #28787: URL: https://github.com/apache/spark/pull/28787#issuecomment-642181266 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [spark] SparkQA commented on pull request #28787: [SPARK-31959][SQL] Fix Gregorian-Julian micros rebasing while switching standard time zone offset

SparkQA commented on pull request #28787: URL: https://github.com/apache/spark/pull/28787#issuecomment-642180711 **[Test build #123775 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/123775/testReport)** for PR 28787 at commit [`6227ef6`](https://github.com

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28786: [SPARK-31925][ML] Summary.totalIterations greater than maxIters

AmplabJenkins removed a comment on pull request #28786: URL: https://github.com/apache/spark/pull/28786#issuecomment-642178997 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/123

[GitHub] [spark] MaxGekk opened a new pull request #28787: [SPARK-31959][SQL] Fix Gregorian-Julian micros rebasing while switching standard time zone offset

MaxGekk opened a new pull request #28787: URL: https://github.com/apache/spark/pull/28787 ### What changes were proposed in this pull request? Fix the bug in microseconds rebasing during transitions from one standard time zone offset to another one. In the PR, I propose to change the im

[GitHub] [spark] SparkQA commented on pull request #28786: [SPARK-31925][ML] Summary.totalIterations greater than maxIters

SparkQA commented on pull request #28786: URL: https://github.com/apache/spark/pull/28786#issuecomment-642178947 **[Test build #123774 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/123774/testReport)** for PR 28786 at commit [`91529d0`](https://github.co

[GitHub] [spark] AmplabJenkins commented on pull request #28786: [SPARK-31925][ML] Summary.totalIterations greater than maxIters

AmplabJenkins commented on pull request #28786: URL: https://github.com/apache/spark/pull/28786#issuecomment-642178984 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [spark] SparkQA removed a comment on pull request #28786: [SPARK-31925][ML] Summary.totalIterations greater than maxIters

SparkQA removed a comment on pull request #28786: URL: https://github.com/apache/spark/pull/28786#issuecomment-642173603 **[Test build #123774 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/123774/testReport)** for PR 28786 at commit [`91529d0`](https://gi

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28786: [SPARK-31925][ML] Summary.totalIterations greater than maxIters

AmplabJenkins removed a comment on pull request #28786: URL: https://github.com/apache/spark/pull/28786#issuecomment-642178984 Merged build finished. Test FAILed. This is an automated message from the Apache Git Service. To r

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28769: [SPARK-31929][WEBUI] Close leveldbiterator when leveldb.close

AmplabJenkins removed a comment on pull request #28769: URL: https://github.com/apache/spark/pull/28769#issuecomment-642175378 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins commented on pull request #28769: [SPARK-31929][WEBUI] Close leveldbiterator when leveldb.close

AmplabJenkins commented on pull request #28769: URL: https://github.com/apache/spark/pull/28769#issuecomment-642175378 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [spark] AmplabJenkins commented on pull request #28786: [SPARK-31925][ML] Summary.totalIterations greater than maxIters

AmplabJenkins commented on pull request #28786: URL: https://github.com/apache/spark/pull/28786#issuecomment-642174048 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [spark] SparkQA commented on pull request #28769: [SPARK-31929][WEBUI] Close leveldbiterator when leveldb.close

SparkQA commented on pull request #28769: URL: https://github.com/apache/spark/pull/28769#issuecomment-642174146 **[Test build #123769 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/123769/testReport)** for PR 28769 at commit [`bde6b0c`](https://github.co

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28786: [SPARK-31925][ML] Summary.totalIterations greater than maxIters

AmplabJenkins removed a comment on pull request #28786: URL: https://github.com/apache/spark/pull/28786#issuecomment-642174048 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] SparkQA removed a comment on pull request #28769: [SPARK-31929][WEBUI] Close leveldbiterator when leveldb.close

SparkQA removed a comment on pull request #28769: URL: https://github.com/apache/spark/pull/28769#issuecomment-642054250 **[Test build #123769 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/123769/testReport)** for PR 28769 at commit [`bde6b0c`](https://gi

[GitHub] [spark] SparkQA commented on pull request #28786: [SPARK-31925][ML] Summary.totalIterations greater than maxIters

SparkQA commented on pull request #28786: URL: https://github.com/apache/spark/pull/28786#issuecomment-642173603 **[Test build #123774 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/123774/testReport)** for PR 28786 at commit [`91529d0`](https://github.com

[GitHub] [spark] huaxingao opened a new pull request #28786: [SPARK-31925][ML] Summary.totalIterations greater than maxIters

huaxingao opened a new pull request #28786: URL: https://github.com/apache/spark/pull/28786 ### What changes were proposed in this pull request? In LogisticRegression and LinearRegression, if set maxIter=n, the model.summary.totalIterations returns n+1 if the training procedure does

[GitHub] [spark] huaxingao commented on pull request #28772: [SPARK-31944] Add instance weight support in LinearRegressionSummary

huaxingao commented on pull request #28772: URL: https://github.com/apache/spark/pull/28772#issuecomment-642171457 cc @srowen @zhengruifeng This is an automated message from the Apache Git Service. To respond to the message,

[GitHub] [spark] SparkQA commented on pull request #28708: [SPARK-20629][CORE][K8S] Copy shuffle data when nodes are being shutdown

SparkQA commented on pull request #28708: URL: https://github.com/apache/spark/pull/28708#issuecomment-642167745 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/28397/ -

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28769: [SPARK-31929][WEBUI] Close leveldbiterator when leveldb.close

AmplabJenkins removed a comment on pull request #28769: URL: https://github.com/apache/spark/pull/28769#issuecomment-642166803 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28777: [SPARK-31915][SQL][PYTHON] Resolve the grouping column properly per the case sensitivity in grouped and cogrouped pandas UDFs

AmplabJenkins removed a comment on pull request #28777: URL: https://github.com/apache/spark/pull/28777#issuecomment-642166640 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins commented on pull request #28769: [SPARK-31929][WEBUI] Close leveldbiterator when leveldb.close

AmplabJenkins commented on pull request #28769: URL: https://github.com/apache/spark/pull/28769#issuecomment-642166803 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [spark] AmplabJenkins commented on pull request #28777: [SPARK-31915][SQL][PYTHON] Resolve the grouping column properly per the case sensitivity in grouped and cogrouped pandas UDFs

AmplabJenkins commented on pull request #28777: URL: https://github.com/apache/spark/pull/28777#issuecomment-642166640 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [spark] SparkQA removed a comment on pull request #28769: [SPARK-31929][WEBUI] Close leveldbiterator when leveldb.close

SparkQA removed a comment on pull request #28769: URL: https://github.com/apache/spark/pull/28769#issuecomment-642040791 **[Test build #123767 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/123767/testReport)** for PR 28769 at commit [`73d3b3f`](https://gi

[GitHub] [spark] SparkQA removed a comment on pull request #28777: [SPARK-31915][SQL][PYTHON] Resolve the grouping column properly per the case sensitivity in grouped and cogrouped pandas UDFs

SparkQA removed a comment on pull request #28777: URL: https://github.com/apache/spark/pull/28777#issuecomment-641947442 **[Test build #123759 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/123759/testReport)** for PR 28777 at commit [`c656ddb`](https://gi

[GitHub] [spark] SparkQA commented on pull request #28777: [SPARK-31915][SQL][PYTHON] Resolve the grouping column properly per the case sensitivity in grouped and cogrouped pandas UDFs

SparkQA commented on pull request #28777: URL: https://github.com/apache/spark/pull/28777#issuecomment-64216 **[Test build #123759 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/123759/testReport)** for PR 28777 at commit [`c656ddb`](https://github.co

[GitHub] [spark] SparkQA commented on pull request #28769: [SPARK-31929][WEBUI] Close leveldbiterator when leveldb.close

SparkQA commented on pull request #28769: URL: https://github.com/apache/spark/pull/28769#issuecomment-642165338 **[Test build #123767 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/123767/testReport)** for PR 28769 at commit [`73d3b3f`](https://github.co

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28781: [SPARK-31953][SS] Add Spark Structured Streaming History Server Support

AmplabJenkins removed a comment on pull request #28781: URL: https://github.com/apache/spark/pull/28781#issuecomment-642158735 Merged build finished. Test FAILed. This is an automated message from the Apache Git Service. To r

[GitHub] [spark] AmplabJenkins commented on pull request #28778: [SPARK-31949][SQL] Add spark.default.parallelism in SQLConf for isolated across session

AmplabJenkins commented on pull request #28778: URL: https://github.com/apache/spark/pull/28778#issuecomment-642159474 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28778: [SPARK-31949][SQL] Add spark.default.parallelism in SQLConf for isolated across session

AmplabJenkins removed a comment on pull request #28778: URL: https://github.com/apache/spark/pull/28778#issuecomment-642159474 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] SparkQA removed a comment on pull request #28778: [SPARK-31949][SQL] Add spark.default.parallelism in SQLConf for isolated across session

SparkQA removed a comment on pull request #28778: URL: https://github.com/apache/spark/pull/28778#issuecomment-641923620 **[Test build #123758 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/123758/testReport)** for PR 28778 at commit [`55d367f`](https://gi

[GitHub] [spark] gerashegalov commented on a change in pull request #28746: [SPARK-31922][CORE] Fix "RpcEnv already stopped" error when exit spark-shell with local-cluster mode

gerashegalov commented on a change in pull request #28746: URL: https://github.com/apache/spark/pull/28746#discussion_r438300717 ## File path: core/src/main/scala/org/apache/spark/deploy/LocalSparkCluster.scala ## @@ -74,6 +74,10 @@ class LocalSparkCluster( def stop(): Uni

[GitHub] [spark] AmplabJenkins commented on pull request #28781: [SPARK-31953][SS] Add Spark Structured Streaming History Server Support

AmplabJenkins commented on pull request #28781: URL: https://github.com/apache/spark/pull/28781#issuecomment-642158735 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [spark] SparkQA commented on pull request #28778: [SPARK-31949][SQL] Add spark.default.parallelism in SQLConf for isolated across session

SparkQA commented on pull request #28778: URL: https://github.com/apache/spark/pull/28778#issuecomment-642158163 **[Test build #123758 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/123758/testReport)** for PR 28778 at commit [`55d367f`](https://github.co

[GitHub] [spark] SparkQA removed a comment on pull request #28783: [SPARK-31956][SQL] Do not fail if there is no ambiguous self join

SparkQA removed a comment on pull request #28783: URL: https://github.com/apache/spark/pull/28783#issuecomment-641958705 **[Test build #123761 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/123761/testReport)** for PR 28783 at commit [`38c0508`](https://gi

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28783: [SPARK-31956][SQL] Do not fail if there is no ambiguous self join

AmplabJenkins removed a comment on pull request #28783: URL: https://github.com/apache/spark/pull/28783#issuecomment-642153515 Merged build finished. Test FAILed. This is an automated message from the Apache Git Service. To r

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28412: [SPARK-31608][CORE][WEBUI] Add a new type of KVStore to make loading UI faster

AmplabJenkins removed a comment on pull request #28412: URL: https://github.com/apache/spark/pull/28412#issuecomment-642153243 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins commented on pull request #28783: [SPARK-31956][SQL] Do not fail if there is no ambiguous self join

AmplabJenkins commented on pull request #28783: URL: https://github.com/apache/spark/pull/28783#issuecomment-642153515 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [spark] SparkQA commented on pull request #28783: [SPARK-31956][SQL] Do not fail if there is no ambiguous self join

SparkQA commented on pull request #28783: URL: https://github.com/apache/spark/pull/28783#issuecomment-642152503 **[Test build #123761 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/123761/testReport)** for PR 28783 at commit [`38c0508`](https://github.co

[GitHub] [spark] AmplabJenkins commented on pull request #28412: [SPARK-31608][CORE][WEBUI] Add a new type of KVStore to make loading UI faster

AmplabJenkins commented on pull request #28412: URL: https://github.com/apache/spark/pull/28412#issuecomment-642153243 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [spark] SparkQA commented on pull request #28412: [SPARK-31608][CORE][WEBUI] Add a new type of KVStore to make loading UI faster

SparkQA commented on pull request #28412: URL: https://github.com/apache/spark/pull/28412#issuecomment-642152258 **[Test build #123770 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/123770/testReport)** for PR 28412 at commit [`76dbd18`](https://github.co

[GitHub] [spark] SparkQA removed a comment on pull request #28412: [SPARK-31608][CORE][WEBUI] Add a new type of KVStore to make loading UI faster

SparkQA removed a comment on pull request #28412: URL: https://github.com/apache/spark/pull/28412#issuecomment-642054235 **[Test build #123770 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/123770/testReport)** for PR 28412 at commit [`76dbd18`](https://gi

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28783: [SPARK-31956][SQL] Do not fail if there is no ambiguous self join

AmplabJenkins removed a comment on pull request #28783: URL: https://github.com/apache/spark/pull/28783#issuecomment-642153525 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/123

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28766: [SPARK-31939][SQL][test-java11] Fix Parsing day of year when year field pattern is missing

AmplabJenkins removed a comment on pull request #28766: URL: https://github.com/apache/spark/pull/28766#issuecomment-642149970 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins commented on pull request #28766: [SPARK-31939][SQL][test-java11] Fix Parsing day of year when year field pattern is missing

AmplabJenkins commented on pull request #28766: URL: https://github.com/apache/spark/pull/28766#issuecomment-642149970 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [spark] SparkQA removed a comment on pull request #28766: [SPARK-31939][SQL][test-java11] Fix Parsing day of year when year field pattern is missing

SparkQA removed a comment on pull request #28766: URL: https://github.com/apache/spark/pull/28766#issuecomment-641919836 **[Test build #123757 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/123757/testReport)** for PR 28766 at commit [`04ce7ee`](https://gi

[GitHub] [spark] SparkQA commented on pull request #28766: [SPARK-31939][SQL][test-java11] Fix Parsing day of year when year field pattern is missing

SparkQA commented on pull request #28766: URL: https://github.com/apache/spark/pull/28766#issuecomment-642148668 **[Test build #123757 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/123757/testReport)** for PR 28766 at commit [`04ce7ee`](https://github.co

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28778: [SPARK-31949][SQL] Add spark.default.parallelism in SQLConf for isolated across session

AmplabJenkins removed a comment on pull request #28778: URL: https://github.com/apache/spark/pull/28778#issuecomment-642147124 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins commented on pull request #28778: [SPARK-31949][SQL] Add spark.default.parallelism in SQLConf for isolated across session

AmplabJenkins commented on pull request #28778: URL: https://github.com/apache/spark/pull/28778#issuecomment-642147124 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [spark] SparkQA commented on pull request #28708: [SPARK-20629][CORE][K8S] Copy shuffle data when nodes are being shutdown

SparkQA commented on pull request #28708: URL: https://github.com/apache/spark/pull/28708#issuecomment-642146987 **[Test build #123773 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/123773/testReport)** for PR 28708 at commit [`e4f2fb7`](https://github.com

[GitHub] [spark] SparkQA removed a comment on pull request #28778: [SPARK-31949][SQL] Add spark.default.parallelism in SQLConf for isolated across session

SparkQA removed a comment on pull request #28778: URL: https://github.com/apache/spark/pull/28778#issuecomment-641879361 **[Test build #123752 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/123752/testReport)** for PR 28778 at commit [`27e113b`](https://gi

[GitHub] [spark] SparkQA commented on pull request #28778: [SPARK-31949][SQL] Add spark.default.parallelism in SQLConf for isolated across session

SparkQA commented on pull request #28778: URL: https://github.com/apache/spark/pull/28778#issuecomment-642145362 **[Test build #123752 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/123752/testReport)** for PR 28778 at commit [`27e113b`](https://github.co

[GitHub] [spark] Tagar commented on pull request #25135: [SPARK-28367][SS] Use new KafkaConsumer.poll API in Kafka connector

Tagar commented on pull request #25135: URL: https://github.com/apache/spark/pull/25135#issuecomment-642143924 @gaborgsomogyi just for understanding, since the upstream Spark now uses Kafka 2.5 client, there is no obstacle to use KafkaConsumer.poll API in Kafka connector? Thanks for this i

[GitHub] [spark] iRakson commented on pull request #28752: [SPARK-31642][FOLLOWUP] Fix Sorting for duration column and make Status column sortable

iRakson commented on pull request #28752: URL: https://github.com/apache/spark/pull/28752#issuecomment-642138741 gentle ping @srowen @sarutak @HyukjinKwon This is an automated message from the Apache Git Service. To respond

[GitHub] [spark] holdenk commented on a change in pull request #28708: [SPARK-20629][CORE][K8S] Copy shuffle data when nodes are being shutdown

holdenk commented on a change in pull request #28708: URL: https://github.com/apache/spark/pull/28708#discussion_r438269803 ## File path: core/src/main/scala/org/apache/spark/storage/BlockManagerDecommissionManager.scala ## @@ -0,0 +1,265 @@ +/* + * Licensed to the Apache Soft

[GitHub] [spark] holdenk commented on a change in pull request #28708: [SPARK-20629][CORE][K8S] Copy shuffle data when nodes are being shutdown

holdenk commented on a change in pull request #28708: URL: https://github.com/apache/spark/pull/28708#discussion_r438269652 ## File path: core/src/test/scala/org/apache/spark/storage/BlockManagerDecommissionUnitSuite.scala ## @@ -0,0 +1,90 @@ +/* + * Licensed to the Apache Sof

[GitHub] [spark] AmplabJenkins commented on pull request #27432: [SPARK-28325][SQL]Support ANSI SQL: SIMILAR TO ... ESCAPE syntax

AmplabJenkins commented on pull request #27432: URL: https://github.com/apache/spark/pull/27432#issuecomment-642121441 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [spark] AmplabJenkins removed a comment on pull request #27432: [SPARK-28325][SQL]Support ANSI SQL: SIMILAR TO ... ESCAPE syntax

AmplabJenkins removed a comment on pull request #27432: URL: https://github.com/apache/spark/pull/27432#issuecomment-642121441 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] SaurabhChawla100 edited a comment on pull request #27636: [SPARK-30873][CORE][YARN]Handling Node Decommissioning for Yarn cluster manger in Spark

SaurabhChawla100 edited a comment on pull request #27636: URL: https://github.com/apache/spark/pull/27636#issuecomment-642102323 @agrawaldevesh - Thanks for checking this PR, Sure will check this PR https://github.com/apache/spark/pull/27864 and tried to use this in the current PR

[GitHub] [spark] SparkQA removed a comment on pull request #27432: [SPARK-28325][SQL]Support ANSI SQL: SIMILAR TO ... ESCAPE syntax

SparkQA removed a comment on pull request #27432: URL: https://github.com/apache/spark/pull/27432#issuecomment-641892753 **[Test build #123755 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/123755/testReport)** for PR 27432 at commit [`4329287`](https://gi

[GitHub] [spark] SparkQA commented on pull request #27432: [SPARK-28325][SQL]Support ANSI SQL: SIMILAR TO ... ESCAPE syntax

SparkQA commented on pull request #27432: URL: https://github.com/apache/spark/pull/27432#issuecomment-642119894 **[Test build #123755 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/123755/testReport)** for PR 27432 at commit [`4329287`](https://github.co

[GitHub] [spark] SaurabhChawla100 edited a comment on pull request #27636: [SPARK-30873][CORE][YARN]Handling Node Decommissioning for Yarn cluster manger in Spark

SaurabhChawla100 edited a comment on pull request #27636: URL: https://github.com/apache/spark/pull/27636#issuecomment-642102323 @agrawaldevesh - Thanks for checking this PR, Sure will check this PR https://github.com/apache/spark/pull/27864 and tried to use this in the current PR

[GitHub] [spark] viirya commented on pull request #28560: [SPARK-27217][SQL] Nested column aliasing for more operators which can prune nested column

viirya commented on pull request #28560: URL: https://github.com/apache/spark/pull/28560#issuecomment-642115638 Thanks @HyukjinKwon. I will address the comment at #28556. This is an automated message from the Apache Git Servi

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28776: [SPARK-31935][SQL][3.0] Hadoop file system config should be effective in data source options

AmplabJenkins removed a comment on pull request #28776: URL: https://github.com/apache/spark/pull/28776#issuecomment-642113961 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins commented on pull request #28776: [SPARK-31935][SQL][3.0] Hadoop file system config should be effective in data source options

AmplabJenkins commented on pull request #28776: URL: https://github.com/apache/spark/pull/28776#issuecomment-642113961 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [spark] viirya commented on a change in pull request #28743: [SPARK-31920][PYTHON] Fix pandas conversion using Arrow with __arrow_array__ columns

viirya commented on a change in pull request #28743: URL: https://github.com/apache/spark/pull/28743#discussion_r438245814 ## File path: python/pyspark/sql/pandas/conversion.py ## @@ -394,10 +394,11 @@ def _create_from_pandas_with_arrow(self, pdf, schema, timezone):

[GitHub] [spark] SparkQA removed a comment on pull request #28776: [SPARK-31935][SQL][3.0] Hadoop file system config should be effective in data source options

SparkQA removed a comment on pull request #28776: URL: https://github.com/apache/spark/pull/28776#issuecomment-641892921 **[Test build #123754 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/123754/testReport)** for PR 28776 at commit [`f6cca6b`](https://gi

[GitHub] [spark] SparkQA commented on pull request #28776: [SPARK-31935][SQL][3.0] Hadoop file system config should be effective in data source options

SparkQA commented on pull request #28776: URL: https://github.com/apache/spark/pull/28776#issuecomment-642112714 **[Test build #123754 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/123754/testReport)** for PR 28776 at commit [`f6cca6b`](https://github.co

[GitHub] [spark] maropu commented on a change in pull request #28785: [SPARK-31958][SQL] normalize special floating numbers in subquery

maropu commented on a change in pull request #28785: URL: https://github.com/apache/spark/pull/28785#discussion_r438241316 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/optimizer/NormalizeFloatingNumbers.scala ## @@ -56,10 +56,6 @@ import org.apache.s

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28770: [SPARK-31942] Revert "[SPARK-31864][SQL] Adjust AQE skew join trigger condition

AmplabJenkins removed a comment on pull request #28770: URL: https://github.com/apache/spark/pull/28770#issuecomment-642106637 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins commented on pull request #28770: [SPARK-31942] Revert "[SPARK-31864][SQL] Adjust AQE skew join trigger condition

AmplabJenkins commented on pull request #28770: URL: https://github.com/apache/spark/pull/28770#issuecomment-642106637 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [spark] viirya commented on a change in pull request #28782: [SPARK-31954][SQL] delete duplicate testcase

viirya commented on a change in pull request #28782: URL: https://github.com/apache/spark/pull/28782#discussion_r438238068 ## File path: sql/hive/src/test/scala/org/apache/spark/sql/hive/execution/HiveQuerySuite.scala ## @@ -580,9 +577,6 @@ class HiveQuerySuite extends HiveCom

[GitHub] [spark] SparkQA removed a comment on pull request #28770: [SPARK-31942] Revert "[SPARK-31864][SQL] Adjust AQE skew join trigger condition

SparkQA removed a comment on pull request #28770: URL: https://github.com/apache/spark/pull/28770#issuecomment-641865258 **[Test build #123748 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/123748/testReport)** for PR 28770 at commit [`f806c9a`](https://gi

[GitHub] [spark] SparkQA commented on pull request #28770: [SPARK-31942] Revert "[SPARK-31864][SQL] Adjust AQE skew join trigger condition

SparkQA commented on pull request #28770: URL: https://github.com/apache/spark/pull/28770#issuecomment-642104571 **[Test build #123748 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/123748/testReport)** for PR 28770 at commit [`f806c9a`](https://github.co

[GitHub] [spark] viirya commented on a change in pull request #28782: [SPARK-31954][SQL] delete duplicate testcase

viirya commented on a change in pull request #28782: URL: https://github.com/apache/spark/pull/28782#discussion_r438236216 ## File path: sql/hive/src/test/scala/org/apache/spark/sql/hive/execution/HiveQuerySuite.scala ## @@ -564,9 +564,6 @@ class HiveQuerySuite extends HiveCom

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28766: [SPARK-31939][SQL][test-java11] Fix Parsing day of year when year field pattern is missing

AmplabJenkins removed a comment on pull request #28766: URL: https://github.com/apache/spark/pull/28766#issuecomment-642103650 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins commented on pull request #28766: [SPARK-31939][SQL][test-java11] Fix Parsing day of year when year field pattern is missing

AmplabJenkins commented on pull request #28766: URL: https://github.com/apache/spark/pull/28766#issuecomment-642103650 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [spark] SaurabhChawla100 commented on pull request #27636: [SPARK-30873][CORE][YARN]Handling Node Decommissioning for Yarn cluster manger in Spark

SaurabhChawla100 commented on pull request #27636: URL: https://github.com/apache/spark/pull/27636#issuecomment-642102323 @agrawaldevesh - Thanks for checking this PR, Sure will check this PR https://github.com/apache/spark/pull/27864 and tried to use this in the current PR Regardi

[GitHub] [spark] SparkQA removed a comment on pull request #28766: [SPARK-31939][SQL][test-java11] Fix Parsing day of year when year field pattern is missing

SparkQA removed a comment on pull request #28766: URL: https://github.com/apache/spark/pull/28766#issuecomment-641817999 **[Test build #123743 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/123743/testReport)** for PR 28766 at commit [`20b585d`](https://gi

[GitHub] [spark] SparkQA commented on pull request #28766: [SPARK-31939][SQL][test-java11] Fix Parsing day of year when year field pattern is missing

SparkQA commented on pull request #28766: URL: https://github.com/apache/spark/pull/28766#issuecomment-642101060 **[Test build #123743 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/123743/testReport)** for PR 28766 at commit [`20b585d`](https://github.co

[GitHub] [spark] AmplabJenkins commented on pull request #28769: [SPARK-31929][WEBUI] Close leveldbiterator when leveldb.close

AmplabJenkins commented on pull request #28769: URL: https://github.com/apache/spark/pull/28769#issuecomment-642095440 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28769: [SPARK-31929][WEBUI] Close leveldbiterator when leveldb.close

AmplabJenkins removed a comment on pull request #28769: URL: https://github.com/apache/spark/pull/28769#issuecomment-642095440 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] SparkQA commented on pull request #28769: [SPARK-31929][WEBUI] Close leveldbiterator when leveldb.close

SparkQA commented on pull request #28769: URL: https://github.com/apache/spark/pull/28769#issuecomment-642094893 **[Test build #123772 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/123772/testReport)** for PR 28769 at commit [`abb47da`](https://github.com

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28785: [SPARK-31958][SQL] normalize special floating numbers in subquery

AmplabJenkins removed a comment on pull request #28785: URL: https://github.com/apache/spark/pull/28785#issuecomment-642086777 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins commented on pull request #28785: [SPARK-31958][SQL] normalize special floating numbers in subquery

AmplabJenkins commented on pull request #28785: URL: https://github.com/apache/spark/pull/28785#issuecomment-642086777 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [spark] SparkQA commented on pull request #28785: [SPARK-31958][SQL] normalize special floating numbers in subquery

SparkQA commented on pull request #28785: URL: https://github.com/apache/spark/pull/28785#issuecomment-642086267 **[Test build #123771 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/123771/testReport)** for PR 28785 at commit [`4dc6413`](https://github.com

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28761: [SPARK-25557][SQL] Nested column predicate pushdown for ORC

AmplabJenkins removed a comment on pull request #28761: URL: https://github.com/apache/spark/pull/28761#issuecomment-642084411 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins commented on pull request #28761: [SPARK-25557][SQL] Nested column predicate pushdown for ORC

AmplabJenkins commented on pull request #28761: URL: https://github.com/apache/spark/pull/28761#issuecomment-642084411 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [spark] cloud-fan commented on pull request #28785: [SPARK-31958][SQL] normalize special floating numbers in subquery

cloud-fan commented on pull request #28785: URL: https://github.com/apache/spark/pull/28785#issuecomment-642083355 cc @hvanhovell @maropu @viirya This is an automated message from the Apache Git Service. To respond to the me

[GitHub] [spark] cloud-fan opened a new pull request #28785: [SPARK-31958][SQL] normalize special floating numbers in subquery

cloud-fan opened a new pull request #28785: URL: https://github.com/apache/spark/pull/28785 ### What changes were proposed in this pull request? This is a followup of https://github.com/apache/spark/pull/23388 . https://github.com/apache/spark/pull/23388 has an issue: i

[GitHub] [spark] SparkQA removed a comment on pull request #28761: [SPARK-25557][SQL] Nested column predicate pushdown for ORC

SparkQA removed a comment on pull request #28761: URL: https://github.com/apache/spark/pull/28761#issuecomment-641782560 **[Test build #123732 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/123732/testReport)** for PR 28761 at commit [`bd691ed`](https://gi

[GitHub] [spark] SparkQA commented on pull request #28761: [SPARK-25557][SQL] Nested column predicate pushdown for ORC

SparkQA commented on pull request #28761: URL: https://github.com/apache/spark/pull/28761#issuecomment-642081105 **[Test build #123732 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/123732/testReport)** for PR 28761 at commit [`bd691ed`](https://github.co

[GitHub] [spark] AmplabJenkins commented on pull request #28782: [SPARK-31954][SQL] delete duplicate testcase

AmplabJenkins commented on pull request #28782: URL: https://github.com/apache/spark/pull/28782#issuecomment-642078033 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

<    2   3   4   5   6   7   8   9   10   11   >