[GitHub] [spark] cloud-fan commented on a change in pull request #28707: [SPARK-31894][SS] Introduce UnsafeRow format validation for streaming state store

cloud-fan commented on a change in pull request #28707: URL: https://github.com/apache/spark/pull/28707#discussion_r441492670 ## File path: sql/core/src/main/scala/org/apache/spark/sql/execution/streaming/state/HDFSBackedStateStoreProvider.scala ## @@ -259,6 +259,7 @@ private[

[GitHub] [spark] AmplabJenkins commented on pull request #28850: [SPARK-32015][Core]Remote inheritable thread local variables after spark context is stopped

AmplabJenkins commented on pull request #28850: URL: https://github.com/apache/spark/pull/28850#issuecomment-645333540 Can one of the admins verify this patch? This is an automated message from the Apache Git Service. To resp

[GitHub] [spark] AmplabJenkins commented on pull request #28850: [SPARK-32015][Core]Remote inheritable thread local variables after spark context is stopped

AmplabJenkins commented on pull request #28850: URL: https://github.com/apache/spark/pull/28850#issuecomment-645333997 Can one of the admins verify this patch? This is an automated message from the Apache Git Service. To resp

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28850: [SPARK-32015][Core]Remote inheritable thread local variables after spark context is stopped

AmplabJenkins removed a comment on pull request #28850: URL: https://github.com/apache/spark/pull/28850#issuecomment-645333540 Can one of the admins verify this patch? This is an automated message from the Apache Git Service.

[GitHub] [spark] SparkQA commented on pull request #28849: [SPARK-32000][CORE][TESTS] Fix the flaky test for partially launched task in barrier-mode

SparkQA commented on pull request #28849: URL: https://github.com/apache/spark/pull/28849#issuecomment-645347796 **[Test build #124163 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/124163/testReport)** for PR 28849 at commit [`773de15`](https://github.co

[GitHub] [spark] SparkQA removed a comment on pull request #28849: [SPARK-32000][CORE][TESTS] Fix the flaky test for partially launched task in barrier-mode

SparkQA removed a comment on pull request #28849: URL: https://github.com/apache/spark/pull/28849#issuecomment-645273217 **[Test build #124163 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/124163/testReport)** for PR 28849 at commit [`773de15`](https://gi

[GitHub] [spark] AmplabJenkins commented on pull request #28849: [SPARK-32000][CORE][TESTS] Fix the flaky test for partially launched task in barrier-mode

AmplabJenkins commented on pull request #28849: URL: https://github.com/apache/spark/pull/28849#issuecomment-645348876 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28849: [SPARK-32000][CORE][TESTS] Fix the flaky test for partially launched task in barrier-mode

AmplabJenkins removed a comment on pull request #28849: URL: https://github.com/apache/spark/pull/28849#issuecomment-645348876 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] Ngone51 edited a comment on pull request #28839: [SPARK-32000][CORE][TESTS] Fix the flaky testcase for partially launched task in barrier-mode.

Ngone51 edited a comment on pull request #28839: URL: https://github.com/apache/spark/pull/28839#issuecomment-645234503 Hi @sarutak, thanks for reporting and the fix. First of all, I think it's very unlikely that we'll reach the locality wait timeout(default 3s) since it is still ver

[GitHub] [spark] SparkQA commented on pull request #28840: [SPARK-31999][SQL] Add refresh function command

SparkQA commented on pull request #28840: URL: https://github.com/apache/spark/pull/28840#issuecomment-645355478 **[Test build #124164 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/124164/testReport)** for PR 28840 at commit [`de54470`](https://github.co

[GitHub] [spark] AmplabJenkins commented on pull request #28840: [SPARK-31999][SQL] Add refresh function command

AmplabJenkins commented on pull request #28840: URL: https://github.com/apache/spark/pull/28840#issuecomment-645355732 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [spark] SparkQA removed a comment on pull request #28840: [SPARK-31999][SQL] Add refresh function command

SparkQA removed a comment on pull request #28840: URL: https://github.com/apache/spark/pull/28840#issuecomment-645297273 **[Test build #124164 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/124164/testReport)** for PR 28840 at commit [`de54470`](https://gi

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28840: [SPARK-31999][SQL] Add refresh function command

AmplabJenkins removed a comment on pull request #28840: URL: https://github.com/apache/spark/pull/28840#issuecomment-645355732 Merged build finished. Test FAILed. This is an automated message from the Apache Git Service. To r

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28840: [SPARK-31999][SQL] Add refresh function command

AmplabJenkins removed a comment on pull request #28840: URL: https://github.com/apache/spark/pull/28840#issuecomment-645355742 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/124

[GitHub] [spark] tgravescs commented on pull request #28847: [SPARK-29148][CORE][FOLLOWUP] Fix warning message to show a correct executor id

tgravescs commented on pull request #28847: URL: https://github.com/apache/spark/pull/28847#issuecomment-645373089 thanks for fixing This is an automated message from the Apache Git Service. To respond to the message, please

[GitHub] [spark] cloud-fan commented on pull request #28849: [SPARK-32000][CORE][TESTS] Fix the flaky test for partially launched task in barrier-mode

cloud-fan commented on pull request #28849: URL: https://github.com/apache/spark/pull/28849#issuecomment-645373856 thanks, merging to master/3.0/2.4! This is an automated message from the Apache Git Service. To respond to the

[GitHub] [spark] cloud-fan closed pull request #28849: [SPARK-32000][CORE][TESTS] Fix the flaky test for partially launched task in barrier-mode

cloud-fan closed pull request #28849: URL: https://github.com/apache/spark/pull/28849 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go t

[GitHub] [spark] cloud-fan edited a comment on pull request #28849: [SPARK-32000][CORE][TESTS] Fix the flaky test for partially launched task in barrier-mode

cloud-fan edited a comment on pull request #28849: URL: https://github.com/apache/spark/pull/28849#issuecomment-645373856 thanks, merging to master/3.0! This is an automated message from the Apache Git Service. To respond to

[GitHub] [spark] tgravescs commented on a change in pull request #27843: [SPARK-31029] Avoid using global execution context in driver main thread for YarnSchedulerBackend

tgravescs commented on a change in pull request #27843: URL: https://github.com/apache/spark/pull/27843#discussion_r441549045 ## File path: resource-managers/yarn/src/main/scala/org/apache/spark/scheduler/cluster/YarnSchedulerBackend.scala ## @@ -67,6 +66,13 @@ private[spark]

[GitHub] [spark] cloud-fan commented on pull request #28846: [SPARK-32012][SQL] Incrementally create and materialize query stage to avoid unnecessary local shuffle

cloud-fan commented on pull request #28846: URL: https://github.com/apache/spark/pull/28846#issuecomment-645380472 Can you elaborate it more? How does this optimization help to plan broadcast join? > For example, the children of a sort merge join will be materialized as query stages

[GitHub] [spark] SparkQA removed a comment on pull request #28840: [SPARK-31999][SQL] Add refresh function command

SparkQA removed a comment on pull request #28840: URL: https://github.com/apache/spark/pull/28840#issuecomment-645259585 **[Test build #124161 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/124161/testReport)** for PR 28840 at commit [`f677a4a`](https://gi

[GitHub] [spark] SparkQA commented on pull request #28840: [SPARK-31999][SQL] Add refresh function command

SparkQA commented on pull request #28840: URL: https://github.com/apache/spark/pull/28840#issuecomment-645382096 **[Test build #124161 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/124161/testReport)** for PR 28840 at commit [`f677a4a`](https://github.co

[GitHub] [spark] AmplabJenkins commented on pull request #28840: [SPARK-31999][SQL] Add refresh function command

AmplabJenkins commented on pull request #28840: URL: https://github.com/apache/spark/pull/28840#issuecomment-645383249 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28840: [SPARK-31999][SQL] Add refresh function command

AmplabJenkins removed a comment on pull request #28840: URL: https://github.com/apache/spark/pull/28840#issuecomment-645383249 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] Ngone51 opened a new pull request #28851: [SPARK-32000][2.4][CORE][TESTS] Fix the flaky test for partially launched task in barrier-mode

Ngone51 opened a new pull request #28851: URL: https://github.com/apache/spark/pull/28851 ### What changes were proposed in this pull request? This PR changes the test to get an active executorId and set it as preferred location instead of setting a fixed preferred locati

[GitHub] [spark] Ngone51 commented on pull request #28851: [SPARK-32000][2.4][CORE][TESTS] Fix the flaky test for partially launched task in barrier-mode

Ngone51 commented on pull request #28851: URL: https://github.com/apache/spark/pull/28851#issuecomment-645401281 cc @sarutak @dongjoon-hyun @jiangxb1987 @cloud-fan This is an automated message from the Apache Git Service. To

[GitHub] [spark] Ngone51 commented on pull request #28849: [SPARK-32000][CORE][TESTS] Fix the flaky test for partially launched task in barrier-mode

Ngone51 commented on pull request #28849: URL: https://github.com/apache/spark/pull/28849#issuecomment-645400674 thanks all! I've opened a separate PR for branch-2.4: https://github.com/apache/spark/pull/28851 This is an aut

[GitHub] [spark] SparkQA commented on pull request #28840: [SPARK-31999][SQL] Add refresh function command

SparkQA commented on pull request #28840: URL: https://github.com/apache/spark/pull/28840#issuecomment-645401323 **[Test build #124168 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/124168/testReport)** for PR 28840 at commit [`9e9d5ce`](https://github.com

[GitHub] [spark] SparkQA commented on pull request #28851: [SPARK-32000][2.4][CORE][TESTS] Fix the flaky test for partially launched task in barrier-mode

SparkQA commented on pull request #28851: URL: https://github.com/apache/spark/pull/28851#issuecomment-645401352 **[Test build #124167 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/124167/testReport)** for PR 28851 at commit [`981aa13`](https://github.com

[GitHub] [spark] ulysses-you commented on a change in pull request #28840: [SPARK-31999][SQL] Add refresh function command

ulysses-you commented on a change in pull request #28840: URL: https://github.com/apache/spark/pull/28840#discussion_r441580909 ## File path: sql/core/src/main/scala/org/apache/spark/sql/catalyst/analysis/ResolveSessionCatalog.scala ## @@ -606,38 +601,16 @@ class ResolveSessio

[GitHub] [spark] AmplabJenkins commented on pull request #28851: [SPARK-32000][2.4][CORE][TESTS] Fix the flaky test for partially launched task in barrier-mode

AmplabJenkins commented on pull request #28851: URL: https://github.com/apache/spark/pull/28851#issuecomment-645402024 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [spark] AmplabJenkins commented on pull request #28840: [SPARK-31999][SQL] Add refresh function command

AmplabJenkins commented on pull request #28840: URL: https://github.com/apache/spark/pull/28840#issuecomment-645401988 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28851: [SPARK-32000][2.4][CORE][TESTS] Fix the flaky test for partially launched task in barrier-mode

AmplabJenkins removed a comment on pull request #28851: URL: https://github.com/apache/spark/pull/28851#issuecomment-645402024 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28840: [SPARK-31999][SQL] Add refresh function command

AmplabJenkins removed a comment on pull request #28840: URL: https://github.com/apache/spark/pull/28840#issuecomment-645401988 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] ulysses-you commented on a change in pull request #28840: [SPARK-31999][SQL] Add refresh function command

ulysses-you commented on a change in pull request #28840: URL: https://github.com/apache/spark/pull/28840#discussion_r441583171 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/plans/logical/v2Commands.scala ## @@ -516,3 +516,8 @@ case class CommentOnNam

[GitHub] [spark] SparkQA commented on pull request #28784: [SPARK-31957][SQL][test-maven] Cleanup hive scratch dir for the developer api startWithContext

SparkQA commented on pull request #28784: URL: https://github.com/apache/spark/pull/28784#issuecomment-645410316 **[Test build #124169 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/124169/testReport)** for PR 28784 at commit [`2ff9573`](https://github.com

[GitHub] [spark] AmplabJenkins commented on pull request #28784: [SPARK-31957][SQL][test-maven] Cleanup hive scratch dir for the developer api startWithContext

AmplabJenkins commented on pull request #28784: URL: https://github.com/apache/spark/pull/28784#issuecomment-645411065 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28784: [SPARK-31957][SQL][test-maven] Cleanup hive scratch dir for the developer api startWithContext

AmplabJenkins removed a comment on pull request #28784: URL: https://github.com/apache/spark/pull/28784#issuecomment-645411065 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] Ngone51 commented on a change in pull request #28848: [SPARK-32003][CORE] Unregister outputs for executor on fetch failure …

Ngone51 commented on a change in pull request #28848: URL: https://github.com/apache/spark/pull/28848#discussion_r441601775 ## File path: core/src/main/scala/org/apache/spark/scheduler/DAGScheduler.scala ## @@ -1939,24 +1941,22 @@ private[spark] class DAGScheduler( hostT

[GitHub] [spark] Ngone51 commented on pull request #28848: [SPARK-32003][CORE] Unregister outputs for executor on fetch failure …

Ngone51 commented on pull request #28848: URL: https://github.com/apache/spark/pull/28848#issuecomment-645423126 cc @jiangxb1987 This is an automated message from the Apache Git Service. To respond to the message, please log

[GitHub] [spark] SparkQA commented on pull request #28784: [SPARK-31957][SQL][test-maven] Cleanup hive scratch dir for the developer api startWithContext

SparkQA commented on pull request #28784: URL: https://github.com/apache/spark/pull/28784#issuecomment-645424212 **[Test build #124170 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/124170/testReport)** for PR 28784 at commit [`faf782e`](https://github.com

[GitHub] [spark] AmplabJenkins commented on pull request #28784: [SPARK-31957][SQL][test-maven] Cleanup hive scratch dir for the developer api startWithContext

AmplabJenkins commented on pull request #28784: URL: https://github.com/apache/spark/pull/28784#issuecomment-645425100 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28784: [SPARK-31957][SQL][test-maven] Cleanup hive scratch dir for the developer api startWithContext

AmplabJenkins removed a comment on pull request #28784: URL: https://github.com/apache/spark/pull/28784#issuecomment-645425100 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins commented on pull request #28707: [SPARK-31894][SS] Introduce UnsafeRow format validation for streaming state store

AmplabJenkins commented on pull request #28707: URL: https://github.com/apache/spark/pull/28707#issuecomment-645429724 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28707: [SPARK-31894][SS] Introduce UnsafeRow format validation for streaming state store

AmplabJenkins removed a comment on pull request #28707: URL: https://github.com/apache/spark/pull/28707#issuecomment-645429724 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] xuanyuanking commented on a change in pull request #28707: [SPARK-31894][SS] Introduce UnsafeRow format validation for streaming state store

xuanyuanking commented on a change in pull request #28707: URL: https://github.com/apache/spark/pull/28707#discussion_r441615184 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/util/UnsafeRowUtils.scala ## @@ -0,0 +1,84 @@ +/* + * Licensed to the Apache

[GitHub] [spark] xuanyuanking commented on a change in pull request #28707: [SPARK-31894][SS] Introduce UnsafeRow format validation for streaming state store

xuanyuanking commented on a change in pull request #28707: URL: https://github.com/apache/spark/pull/28707#discussion_r441617572 ## File path: sql/core/src/main/scala/org/apache/spark/sql/execution/streaming/state/StateStore.scala ## @@ -143,6 +145,16 @@ case class StateStoreC

[GitHub] [spark] xuanyuanking commented on a change in pull request #28707: [SPARK-31894][SS] Introduce UnsafeRow format validation for streaming state store

xuanyuanking commented on a change in pull request #28707: URL: https://github.com/apache/spark/pull/28707#discussion_r441618110 ## File path: sql/core/src/main/scala/org/apache/spark/sql/execution/streaming/state/StateStore.scala ## @@ -143,6 +145,16 @@ case class StateStoreC

[GitHub] [spark] xuanyuanking commented on a change in pull request #28707: [SPARK-31894][SS] Introduce UnsafeRow format validation for streaming state store

xuanyuanking commented on a change in pull request #28707: URL: https://github.com/apache/spark/pull/28707#discussion_r441618274 ## File path: sql/core/src/main/scala/org/apache/spark/sql/execution/streaming/state/HDFSBackedStateStoreProvider.scala ## @@ -259,6 +259,7 @@ priva

[GitHub] [spark] huaxingao commented on pull request #28844: [SPARK-32009][ML][PySpark] Remove deprecated method BisectingKMeansModel.computeCost

huaxingao commented on pull request #28844: URL: https://github.com/apache/spark/pull/28844#issuecomment-645433307 retest this please This is an automated message from the Apache Git Service. To respond to the message, please

[GitHub] [spark] SparkQA commented on pull request #28707: [SPARK-31894][SS] Introduce UnsafeRow format validation for streaming state store

SparkQA commented on pull request #28707: URL: https://github.com/apache/spark/pull/28707#issuecomment-645433621 **[Test build #124171 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/124171/testReport)** for PR 28707 at commit [`fd74ff9`](https://github.com

[GitHub] [spark] AmplabJenkins commented on pull request #28844: [SPARK-32009][ML][PySpark] Remove deprecated method BisectingKMeansModel.computeCost

AmplabJenkins commented on pull request #28844: URL: https://github.com/apache/spark/pull/28844#issuecomment-645434382 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28844: [SPARK-32009][ML][PySpark] Remove deprecated method BisectingKMeansModel.computeCost

AmplabJenkins removed a comment on pull request #28844: URL: https://github.com/apache/spark/pull/28844#issuecomment-645434382 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] SparkQA commented on pull request #28844: [SPARK-32009][ML][PySpark] Remove deprecated method BisectingKMeansModel.computeCost

SparkQA commented on pull request #28844: URL: https://github.com/apache/spark/pull/28844#issuecomment-645437913 **[Test build #124172 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/124172/testReport)** for PR 28844 at commit [`a010071`](https://github.com

[GitHub] [spark] SparkQA commented on pull request #28844: [SPARK-32009][ML][PySpark] Remove deprecated method BisectingKMeansModel.computeCost

SparkQA commented on pull request #28844: URL: https://github.com/apache/spark/pull/28844#issuecomment-645440167 **[Test build #124172 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/124172/testReport)** for PR 28844 at commit [`a010071`](https://github.co

[GitHub] [spark] SparkQA removed a comment on pull request #28844: [SPARK-32009][ML][PySpark] Remove deprecated method BisectingKMeansModel.computeCost

SparkQA removed a comment on pull request #28844: URL: https://github.com/apache/spark/pull/28844#issuecomment-645437913 **[Test build #124172 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/124172/testReport)** for PR 28844 at commit [`a010071`](https://gi

[GitHub] [spark] AmplabJenkins commented on pull request #28844: [SPARK-32009][ML][PySpark] Remove deprecated method BisectingKMeansModel.computeCost

AmplabJenkins commented on pull request #28844: URL: https://github.com/apache/spark/pull/28844#issuecomment-645440196 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28844: [SPARK-32009][ML][PySpark] Remove deprecated method BisectingKMeansModel.computeCost

AmplabJenkins removed a comment on pull request #28844: URL: https://github.com/apache/spark/pull/28844#issuecomment-645440196 Merged build finished. Test FAILed. This is an automated message from the Apache Git Service. To r

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28844: [SPARK-32009][ML][PySpark] Remove deprecated method BisectingKMeansModel.computeCost

AmplabJenkins removed a comment on pull request #28844: URL: https://github.com/apache/spark/pull/28844#issuecomment-645440211 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/124

[GitHub] [spark] huaxingao commented on pull request #28844: [SPARK-32009][ML][PySpark] Remove deprecated method BisectingKMeansModel.computeCost

huaxingao commented on pull request #28844: URL: https://github.com/apache/spark/pull/28844#issuecomment-645441057 retest this please This is an automated message from the Apache Git Service. To respond to the message, please

[GitHub] [spark] SparkQA commented on pull request #28844: [SPARK-32009][ML][PySpark] Remove deprecated method BisectingKMeansModel.computeCost

SparkQA commented on pull request #28844: URL: https://github.com/apache/spark/pull/28844#issuecomment-645442233 **[Test build #124173 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/124173/testReport)** for PR 28844 at commit [`a010071`](https://github.com

[GitHub] [spark] AmplabJenkins commented on pull request #28844: [SPARK-32009][ML][PySpark] Remove deprecated method BisectingKMeansModel.computeCost

AmplabJenkins commented on pull request #28844: URL: https://github.com/apache/spark/pull/28844#issuecomment-645442996 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28844: [SPARK-32009][ML][PySpark] Remove deprecated method BisectingKMeansModel.computeCost

AmplabJenkins removed a comment on pull request #28844: URL: https://github.com/apache/spark/pull/28844#issuecomment-645442996 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] SparkQA commented on pull request #28844: [SPARK-32009][ML][PySpark] Remove deprecated method BisectingKMeansModel.computeCost

SparkQA commented on pull request #28844: URL: https://github.com/apache/spark/pull/28844#issuecomment-645444518 **[Test build #124173 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/124173/testReport)** for PR 28844 at commit [`a010071`](https://github.co

[GitHub] [spark] AmplabJenkins commented on pull request #28844: [SPARK-32009][ML][PySpark] Remove deprecated method BisectingKMeansModel.computeCost

AmplabJenkins commented on pull request #28844: URL: https://github.com/apache/spark/pull/28844#issuecomment-645444551 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [spark] SparkQA removed a comment on pull request #28844: [SPARK-32009][ML][PySpark] Remove deprecated method BisectingKMeansModel.computeCost

SparkQA removed a comment on pull request #28844: URL: https://github.com/apache/spark/pull/28844#issuecomment-645442233 **[Test build #124173 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/124173/testReport)** for PR 28844 at commit [`a010071`](https://gi

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28844: [SPARK-32009][ML][PySpark] Remove deprecated method BisectingKMeansModel.computeCost

AmplabJenkins removed a comment on pull request #28844: URL: https://github.com/apache/spark/pull/28844#issuecomment-645444551 Merged build finished. Test FAILed. This is an automated message from the Apache Git Service. To r

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28844: [SPARK-32009][ML][PySpark] Remove deprecated method BisectingKMeansModel.computeCost

AmplabJenkins removed a comment on pull request #28844: URL: https://github.com/apache/spark/pull/28844#issuecomment-645444566 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/124

[GitHub] [spark] SparkQA commented on pull request #28840: [SPARK-31999][SQL] Add refresh function command

SparkQA commented on pull request #28840: URL: https://github.com/apache/spark/pull/28840#issuecomment-645452931 **[Test build #124165 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/124165/testReport)** for PR 28840 at commit [`9e09875`](https://github.co

[GitHub] [spark] huaxingao commented on pull request #28844: [SPARK-32009][ML][PySpark] Remove deprecated method BisectingKMeansModel.computeCost

huaxingao commented on pull request #28844: URL: https://github.com/apache/spark/pull/28844#issuecomment-645453428 retest this please This is an automated message from the Apache Git Service. To respond to the message, please

[GitHub] [spark] SparkQA removed a comment on pull request #28840: [SPARK-31999][SQL] Add refresh function command

SparkQA removed a comment on pull request #28840: URL: https://github.com/apache/spark/pull/28840#issuecomment-645303537 **[Test build #124165 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/124165/testReport)** for PR 28840 at commit [`9e09875`](https://gi

[GitHub] [spark] attilapiros commented on a change in pull request #28848: [SPARK-32003][CORE] Unregister outputs for executor on fetch failure …

attilapiros commented on a change in pull request #28848: URL: https://github.com/apache/spark/pull/28848#discussion_r441644246 ## File path: core/src/test/scala/org/apache/spark/scheduler/DAGSchedulerSuite.scala ## @@ -540,6 +540,46 @@ class DAGSchedulerSuite extends SparkFun

[GitHub] [spark] AmplabJenkins commented on pull request #28840: [SPARK-31999][SQL] Add refresh function command

AmplabJenkins commented on pull request #28840: URL: https://github.com/apache/spark/pull/28840#issuecomment-645454023 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28840: [SPARK-31999][SQL] Add refresh function command

AmplabJenkins removed a comment on pull request #28840: URL: https://github.com/apache/spark/pull/28840#issuecomment-645454023 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] SparkQA commented on pull request #28844: [SPARK-32009][ML][PySpark] Remove deprecated method BisectingKMeansModel.computeCost

SparkQA commented on pull request #28844: URL: https://github.com/apache/spark/pull/28844#issuecomment-645455144 **[Test build #124174 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/124174/testReport)** for PR 28844 at commit [`a010071`](https://github.com

[GitHub] [spark] SparkQA commented on pull request #28707: [SPARK-31894][SS] Introduce UnsafeRow format validation for streaming state store

SparkQA commented on pull request #28707: URL: https://github.com/apache/spark/pull/28707#issuecomment-645455712 **[Test build #124166 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/124166/testReport)** for PR 28707 at commit [`01007fb`](https://github.co

[GitHub] [spark] AmplabJenkins commented on pull request #28844: [SPARK-32009][ML][PySpark] Remove deprecated method BisectingKMeansModel.computeCost

AmplabJenkins commented on pull request #28844: URL: https://github.com/apache/spark/pull/28844#issuecomment-645455693 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [spark] attilapiros commented on a change in pull request #28848: [SPARK-32003][CORE] Unregister outputs for executor on fetch failure …

attilapiros commented on a change in pull request #28848: URL: https://github.com/apache/spark/pull/28848#discussion_r441647042 ## File path: core/src/main/scala/org/apache/spark/scheduler/DAGScheduler.scala ## @@ -1939,24 +1941,22 @@ private[spark] class DAGScheduler( h

[GitHub] [spark] SparkQA removed a comment on pull request #28707: [SPARK-31894][SS] Introduce UnsafeRow format validation for streaming state store

SparkQA removed a comment on pull request #28707: URL: https://github.com/apache/spark/pull/28707#issuecomment-645306547 **[Test build #124166 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/124166/testReport)** for PR 28707 at commit [`01007fb`](https://gi

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28844: [SPARK-32009][ML][PySpark] Remove deprecated method BisectingKMeansModel.computeCost

AmplabJenkins removed a comment on pull request #28844: URL: https://github.com/apache/spark/pull/28844#issuecomment-645455693 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins commented on pull request #28707: [SPARK-31894][SS] Introduce UnsafeRow format validation for streaming state store

AmplabJenkins commented on pull request #28707: URL: https://github.com/apache/spark/pull/28707#issuecomment-645456836 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [spark] SparkQA commented on pull request #28844: [SPARK-32009][ML][PySpark] Remove deprecated method BisectingKMeansModel.computeCost

SparkQA commented on pull request #28844: URL: https://github.com/apache/spark/pull/28844#issuecomment-645457329 **[Test build #124174 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/124174/testReport)** for PR 28844 at commit [`a010071`](https://github.co

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28707: [SPARK-31894][SS] Introduce UnsafeRow format validation for streaming state store

AmplabJenkins removed a comment on pull request #28707: URL: https://github.com/apache/spark/pull/28707#issuecomment-645456836 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins commented on pull request #28844: [SPARK-32009][ML][PySpark] Remove deprecated method BisectingKMeansModel.computeCost

AmplabJenkins commented on pull request #28844: URL: https://github.com/apache/spark/pull/28844#issuecomment-645457339 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [spark] SparkQA removed a comment on pull request #28844: [SPARK-32009][ML][PySpark] Remove deprecated method BisectingKMeansModel.computeCost

SparkQA removed a comment on pull request #28844: URL: https://github.com/apache/spark/pull/28844#issuecomment-645455144 **[Test build #124174 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/124174/testReport)** for PR 28844 at commit [`a010071`](https://gi

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28844: [SPARK-32009][ML][PySpark] Remove deprecated method BisectingKMeansModel.computeCost

AmplabJenkins removed a comment on pull request #28844: URL: https://github.com/apache/spark/pull/28844#issuecomment-645457339 Merged build finished. Test FAILed. This is an automated message from the Apache Git Service. To r

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28844: [SPARK-32009][ML][PySpark] Remove deprecated method BisectingKMeansModel.computeCost

AmplabJenkins removed a comment on pull request #28844: URL: https://github.com/apache/spark/pull/28844#issuecomment-645457352 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/124

[GitHub] [spark] huaxingao commented on pull request #28844: [SPARK-32009][ML][PySpark] Remove deprecated method BisectingKMeansModel.computeCost

huaxingao commented on pull request #28844: URL: https://github.com/apache/spark/pull/28844#issuecomment-645472998 retest this please This is an automated message from the Apache Git Service. To respond to the message, please

[GitHub] [spark] SparkQA commented on pull request #28840: [SPARK-31999][SQL] Add refresh function command

SparkQA commented on pull request #28840: URL: https://github.com/apache/spark/pull/28840#issuecomment-645472826 **[Test build #124168 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/124168/testReport)** for PR 28840 at commit [`9e9d5ce`](https://github.co

[GitHub] [spark] AmplabJenkins commented on pull request #28840: [SPARK-31999][SQL] Add refresh function command

AmplabJenkins commented on pull request #28840: URL: https://github.com/apache/spark/pull/28840#issuecomment-645473194 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [spark] SparkQA removed a comment on pull request #28840: [SPARK-31999][SQL] Add refresh function command

SparkQA removed a comment on pull request #28840: URL: https://github.com/apache/spark/pull/28840#issuecomment-645401323 **[Test build #124168 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/124168/testReport)** for PR 28840 at commit [`9e9d5ce`](https://gi

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28840: [SPARK-31999][SQL] Add refresh function command

AmplabJenkins removed a comment on pull request #28840: URL: https://github.com/apache/spark/pull/28840#issuecomment-645473194 Merged build finished. Test FAILed. This is an automated message from the Apache Git Service. To r

[GitHub] [spark] SparkQA commented on pull request #28844: [SPARK-32009][ML][PySpark] Remove deprecated method BisectingKMeansModel.computeCost

SparkQA commented on pull request #28844: URL: https://github.com/apache/spark/pull/28844#issuecomment-645475253 **[Test build #124175 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/124175/testReport)** for PR 28844 at commit [`a010071`](https://github.com

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28840: [SPARK-31999][SQL] Add refresh function command

AmplabJenkins removed a comment on pull request #28840: URL: https://github.com/apache/spark/pull/28840#issuecomment-645473199 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/124

[GitHub] [spark] AmplabJenkins commented on pull request #28844: [SPARK-32009][ML][PySpark] Remove deprecated method BisectingKMeansModel.computeCost

AmplabJenkins commented on pull request #28844: URL: https://github.com/apache/spark/pull/28844#issuecomment-645475996 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [spark] wypoon commented on a change in pull request #28848: [SPARK-32003][CORE] Unregister outputs for executor on fetch failure …

wypoon commented on a change in pull request #28848: URL: https://github.com/apache/spark/pull/28848#discussion_r441669857 ## File path: core/src/main/scala/org/apache/spark/scheduler/DAGScheduler.scala ## @@ -1939,24 +1941,22 @@ private[spark] class DAGScheduler( hostTo

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28844: [SPARK-32009][ML][PySpark] Remove deprecated method BisectingKMeansModel.computeCost

AmplabJenkins removed a comment on pull request #28844: URL: https://github.com/apache/spark/pull/28844#issuecomment-645475996 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] wypoon commented on a change in pull request #28848: [SPARK-32003][CORE] Unregister outputs for executor on fetch failure …

wypoon commented on a change in pull request #28848: URL: https://github.com/apache/spark/pull/28848#discussion_r441671240 ## File path: core/src/main/scala/org/apache/spark/scheduler/DAGScheduler.scala ## @@ -1939,24 +1941,22 @@ private[spark] class DAGScheduler( hostTo

[GitHub] [spark] wypoon commented on a change in pull request #28848: [SPARK-32003][CORE] Unregister outputs for executor on fetch failure …

wypoon commented on a change in pull request #28848: URL: https://github.com/apache/spark/pull/28848#discussion_r441673280 ## File path: core/src/main/scala/org/apache/spark/scheduler/DAGScheduler.scala ## @@ -1939,24 +1941,22 @@ private[spark] class DAGScheduler( hostTo

[GitHub] [spark] cloud-fan commented on a change in pull request #28707: [SPARK-31894][SS] Introduce UnsafeRow format validation for streaming state store

cloud-fan commented on a change in pull request #28707: URL: https://github.com/apache/spark/pull/28707#discussion_r441674969 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/util/UnsafeRowUtils.scala ## @@ -0,0 +1,86 @@ +/* + * Licensed to the Apache So

<    1   2   3   4   5   >