[GitHub] [spark] cloud-fan commented on issue #27150: [SPARK-30471][SQL] Fix issue when comparing String and IntegerType

cloud-fan commented on issue #27150: [SPARK-30471][SQL] Fix issue when comparing String and IntegerType URL: https://github.com/apache/spark/pull/27150#issuecomment-573498959 looks good, let's add a migration guide. @gatorsmile do you think we should also add a legacy config?

[GitHub] [spark] cloud-fan commented on a change in pull request #27150: [SPARK-30471][SQL] Fix issue when comparing String and IntegerType

cloud-fan commented on a change in pull request #27150: [SPARK-30471][SQL] Fix issue when comparing String and IntegerType URL: https://github.com/apache/spark/pull/27150#discussion_r365640741 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/analysis/TypeCoer

[GitHub] [spark] SparkQA commented on issue #27157: [SPARK-30475][SQL] File source V2: Push data filters for file listing

SparkQA commented on issue #27157: [SPARK-30475][SQL] File source V2: Push data filters for file listing URL: https://github.com/apache/spark/pull/27157#issuecomment-573498816 **[Test build #116575 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/116575/test

[GitHub] [spark] AmplabJenkins removed a comment on issue #27151: [SPARK-26218][SQL][Follow up] Fix the corner case when casting float to Integer.

AmplabJenkins removed a comment on issue #27151: [SPARK-26218][SQL][Follow up] Fix the corner case when casting float to Integer. URL: https://github.com/apache/spark/pull/27151#issuecomment-573498417 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on issue #27151: [SPARK-26218][SQL][Follow up] Fix the corner case when casting float to Integer.

AmplabJenkins removed a comment on issue #27151: [SPARK-26218][SQL][Follow up] Fix the corner case when casting float to Integer. URL: https://github.com/apache/spark/pull/27151#issuecomment-573498415 Build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins commented on issue #27151: [SPARK-26218][SQL][Follow up] Fix the corner case when casting float to Integer.

AmplabJenkins commented on issue #27151: [SPARK-26218][SQL][Follow up] Fix the corner case when casting float to Integer. URL: https://github.com/apache/spark/pull/27151#issuecomment-573498417 Test PASSed. Refer to this link for build results (access rights to CI server needed): htt

[GitHub] [spark] AmplabJenkins commented on issue #27151: [SPARK-26218][SQL][Follow up] Fix the corner case when casting float to Integer.

AmplabJenkins commented on issue #27151: [SPARK-26218][SQL][Follow up] Fix the corner case when casting float to Integer. URL: https://github.com/apache/spark/pull/27151#issuecomment-573498415 Build finished. Test PASSed. Thi

[GitHub] [spark] SparkQA commented on issue #27151: [SPARK-26218][SQL][Follow up] Fix the corner case when casting float to Integer.

SparkQA commented on issue #27151: [SPARK-26218][SQL][Follow up] Fix the corner case when casting float to Integer. URL: https://github.com/apache/spark/pull/27151#issuecomment-573498205 **[Test build #116595 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/1

[GitHub] [spark] SparkQA commented on issue #27145: [SPARK-30457][ML] Use PeriodicRDDCheckpointer instead of NodeIdCache

SparkQA commented on issue #27145: [SPARK-30457][ML] Use PeriodicRDDCheckpointer instead of NodeIdCache URL: https://github.com/apache/spark/pull/27145#issuecomment-573498221 **[Test build #116596 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/116596/testRe

[GitHub] [spark] Ngone51 commented on a change in pull request #26881: [SPARK-30252][SQL] Disallow negative scale of Decimal under ansi mode

Ngone51 commented on a change in pull request #26881: [SPARK-30252][SQL] Disallow negative scale of Decimal under ansi mode URL: https://github.com/apache/spark/pull/26881#discussion_r365640171 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/types/Decimal.scala #

[GitHub] [spark] AmplabJenkins removed a comment on issue #26440: [SPARK-20628][CORE][K8S] Start to improve Spark decommissioning & preemption support

AmplabJenkins removed a comment on issue #26440: [SPARK-20628][CORE][K8S] Start to improve Spark decommissioning & preemption support URL: https://github.com/apache/spark/pull/26440#issuecomment-573497794 Test PASSed. Refer to this link for build results (access rights to CI server neede

[GitHub] [spark] AmplabJenkins removed a comment on issue #26440: [SPARK-20628][CORE][K8S] Start to improve Spark decommissioning & preemption support

AmplabJenkins removed a comment on issue #26440: [SPARK-20628][CORE][K8S] Start to improve Spark decommissioning & preemption support URL: https://github.com/apache/spark/pull/26440#issuecomment-573497789 Merged build finished. Test PASSed. -

[GitHub] [spark] AmplabJenkins commented on issue #26440: [SPARK-20628][CORE][K8S] Start to improve Spark decommissioning & preemption support

AmplabJenkins commented on issue #26440: [SPARK-20628][CORE][K8S] Start to improve Spark decommissioning & preemption support URL: https://github.com/apache/spark/pull/26440#issuecomment-573497789 Merged build finished. Test PASSed. -

[GitHub] [spark] AmplabJenkins commented on issue #26440: [SPARK-20628][CORE][K8S] Start to improve Spark decommissioning & preemption support

AmplabJenkins commented on issue #26440: [SPARK-20628][CORE][K8S] Start to improve Spark decommissioning & preemption support URL: https://github.com/apache/spark/pull/26440#issuecomment-573497794 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] Ngone51 commented on a change in pull request #26881: [SPARK-30252][SQL] Disallow negative scale of Decimal under ansi mode

Ngone51 commented on a change in pull request #26881: [SPARK-30252][SQL] Disallow negative scale of Decimal under ansi mode URL: https://github.com/apache/spark/pull/26881#discussion_r365639932 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/types/DecimalType.scala

[GitHub] [spark] AmplabJenkins removed a comment on issue #27151: [SPARK-26218][SQL][Follow up] Fix the corner case when casting float to Integer.

AmplabJenkins removed a comment on issue #27151: [SPARK-26218][SQL][Follow up] Fix the corner case when casting float to Integer. URL: https://github.com/apache/spark/pull/27151#issuecomment-573426194 Can one of the admins verify this patch?

[GitHub] [spark] cloud-fan commented on issue #27151: [SPARK-26218][SQL][Follow up] Fix the corner case when casting float to Integer.

cloud-fan commented on issue #27151: [SPARK-26218][SQL][Follow up] Fix the corner case when casting float to Integer. URL: https://github.com/apache/spark/pull/27151#issuecomment-573497689 ok to test This is an automated mess

[GitHub] [spark] cloud-fan commented on issue #27151: [SPARK-26218][SQL][Follow up] Fix the corner case when casting float to Integer.

cloud-fan commented on issue #27151: [SPARK-26218][SQL][Follow up] Fix the corner case when casting float to Integer. URL: https://github.com/apache/spark/pull/27151#issuecomment-573497718 @turboFei can you fix the conflicts?

[GitHub] [spark] SparkQA commented on issue #26440: [SPARK-20628][CORE][K8S] Start to improve Spark decommissioning & preemption support

SparkQA commented on issue #26440: [SPARK-20628][CORE][K8S] Start to improve Spark decommissioning & preemption support URL: https://github.com/apache/spark/pull/26440#issuecomment-573497517 **[Test build #116578 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuil

[GitHub] [spark] SparkQA removed a comment on issue #26440: [SPARK-20628][CORE][K8S] Start to improve Spark decommissioning & preemption support

SparkQA removed a comment on issue #26440: [SPARK-20628][CORE][K8S] Start to improve Spark decommissioning & preemption support URL: https://github.com/apache/spark/pull/26440#issuecomment-573479314 **[Test build #116578 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequ

[GitHub] [spark] AmplabJenkins removed a comment on issue #27145: [SPARK-30457][ML] Use PeriodicRDDCheckpointer instead of NodeIdCache

AmplabJenkins removed a comment on issue #27145: [SPARK-30457][ML] Use PeriodicRDDCheckpointer instead of NodeIdCache URL: https://github.com/apache/spark/pull/27145#issuecomment-573497305 Test PASSed. Refer to this link for build results (access rights to CI server needed): https:/

[GitHub] [spark] AmplabJenkins removed a comment on issue #27145: [SPARK-30457][ML] Use PeriodicRDDCheckpointer instead of NodeIdCache

AmplabJenkins removed a comment on issue #27145: [SPARK-30457][ML] Use PeriodicRDDCheckpointer instead of NodeIdCache URL: https://github.com/apache/spark/pull/27145#issuecomment-573497303 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins commented on issue #27145: [SPARK-30457][ML] Use PeriodicRDDCheckpointer instead of NodeIdCache

AmplabJenkins commented on issue #27145: [SPARK-30457][ML] Use PeriodicRDDCheckpointer instead of NodeIdCache URL: https://github.com/apache/spark/pull/27145#issuecomment-573497305 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.

[GitHub] [spark] AmplabJenkins commented on issue #27145: [SPARK-30457][ML] Use PeriodicRDDCheckpointer instead of NodeIdCache

AmplabJenkins commented on issue #27145: [SPARK-30457][ML] Use PeriodicRDDCheckpointer instead of NodeIdCache URL: https://github.com/apache/spark/pull/27145#issuecomment-573497303 Merged build finished. Test PASSed. This is

[GitHub] [spark] SparkQA commented on issue #27176: [WIP][SPIP]Support year-month and day-time interval types

SparkQA commented on issue #27176: [WIP][SPIP]Support year-month and day-time interval types URL: https://github.com/apache/spark/pull/27176#issuecomment-573497118 **[Test build #116594 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/116594/testReport)** fo

[GitHub] [spark] zhengruifeng commented on issue #27145: [SPARK-30457][ML] Use PeriodicRDDCheckpointer instead of NodeIdCache

zhengruifeng commented on issue #27145: [SPARK-30457][ML] Use PeriodicRDDCheckpointer instead of NodeIdCache URL: https://github.com/apache/spark/pull/27145#issuecomment-573497097 retest this please This is an automated messa

[GitHub] [spark] zhengruifeng commented on issue #27181: [SPARK-30493][PYTHON][ML] Remove OneVsRestModel setClassifier, setLabelCol and setWeightCol methods

zhengruifeng commented on issue #27181: [SPARK-30493][PYTHON][ML] Remove OneVsRestModel setClassifier, setLabelCol and setWeightCol methods URL: https://github.com/apache/spark/pull/27181#issuecomment-573496667 looks reasonably straightforward @huaxingao Seem we do not need those setter

[GitHub] [spark] cloud-fan commented on issue #20826: [SPARK-2489][SQL] Support Parquet's optional fixed_len_byte_array

cloud-fan commented on issue #20826: [SPARK-2489][SQL] Support Parquet's optional fixed_len_byte_array URL: https://github.com/apache/spark/pull/20826#issuecomment-573496378 Is anyone interested in this PR and want to take over?

[GitHub] [spark] AmplabJenkins removed a comment on issue #27176: [WIP][SPIP]Support year-month and day-time interval types

AmplabJenkins removed a comment on issue #27176: [WIP][SPIP]Support year-month and day-time interval types URL: https://github.com/apache/spark/pull/27176#issuecomment-573496166 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.

[GitHub] [spark] AmplabJenkins removed a comment on issue #26434: [SPARK-29544] [SQL] optimize skewed partition based on data size

AmplabJenkins removed a comment on issue #26434: [SPARK-29544] [SQL] optimize skewed partition based on data size URL: https://github.com/apache/spark/pull/26434#issuecomment-573496157 Merged build finished. Test PASSed. This

[GitHub] [spark] AmplabJenkins removed a comment on issue #26434: [SPARK-29544] [SQL] optimize skewed partition based on data size

AmplabJenkins removed a comment on issue #26434: [SPARK-29544] [SQL] optimize skewed partition based on data size URL: https://github.com/apache/spark/pull/26434#issuecomment-573496163 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amp

[GitHub] [spark] AmplabJenkins removed a comment on issue #27176: [WIP][SPIP]Support year-month and day-time interval types

AmplabJenkins removed a comment on issue #27176: [WIP][SPIP]Support year-month and day-time interval types URL: https://github.com/apache/spark/pull/27176#issuecomment-573496162 Merged build finished. Test PASSed. This is an

[GitHub] [spark] AmplabJenkins commented on issue #27176: [WIP][SPIP]Support year-month and day-time interval types

AmplabJenkins commented on issue #27176: [WIP][SPIP]Support year-month and day-time interval types URL: https://github.com/apache/spark/pull/27176#issuecomment-573496166 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley

[GitHub] [spark] AmplabJenkins commented on issue #26434: [SPARK-29544] [SQL] optimize skewed partition based on data size

AmplabJenkins commented on issue #26434: [SPARK-29544] [SQL] optimize skewed partition based on data size URL: https://github.com/apache/spark/pull/26434#issuecomment-573496157 Merged build finished. Test PASSed. This is an a

[GitHub] [spark] AmplabJenkins commented on issue #27176: [WIP][SPIP]Support year-month and day-time interval types

AmplabJenkins commented on issue #27176: [WIP][SPIP]Support year-month and day-time interval types URL: https://github.com/apache/spark/pull/27176#issuecomment-573496162 Merged build finished. Test PASSed. This is an automate

[GitHub] [spark] AmplabJenkins commented on issue #26434: [SPARK-29544] [SQL] optimize skewed partition based on data size

AmplabJenkins commented on issue #26434: [SPARK-29544] [SQL] optimize skewed partition based on data size URL: https://github.com/apache/spark/pull/26434#issuecomment-573496163 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.b

[GitHub] [spark] SparkQA commented on issue #26434: [SPARK-29544] [SQL] optimize skewed partition based on data size

SparkQA commented on issue #26434: [SPARK-29544] [SQL] optimize skewed partition based on data size URL: https://github.com/apache/spark/pull/26434#issuecomment-573495976 **[Test build #116593 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/116593/testReport

[GitHub] [spark] cloud-fan closed pull request #20599: [SPARK-23407][SQL] add a config to try to inline all mutable states during codegen

cloud-fan closed pull request #20599: [SPARK-23407][SQL] add a config to try to inline all mutable states during codegen URL: https://github.com/apache/spark/pull/20599 This is an automated message from the Apache Git Servic

[GitHub] [spark] SparkQA commented on issue #27176: [WIP][SPIP]Support year-month and day-time interval types

SparkQA commented on issue #27176: [WIP][SPIP]Support year-month and day-time interval types URL: https://github.com/apache/spark/pull/27176#issuecomment-573495958 **[Test build #116592 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/116592/testReport)** fo

[GitHub] [spark] cloud-fan commented on issue #26434: [SPARK-29544] [SQL] optimize skewed partition based on data size

cloud-fan commented on issue #26434: [SPARK-29544] [SQL] optimize skewed partition based on data size URL: https://github.com/apache/spark/pull/26434#issuecomment-573495873 retest this please This is an automated message from

[GitHub] [spark] AmplabJenkins removed a comment on issue #26440: [SPARK-20628][CORE][K8S] Start to improve Spark decommissioning & preemption support

AmplabJenkins removed a comment on issue #26440: [SPARK-20628][CORE][K8S] Start to improve Spark decommissioning & preemption support URL: https://github.com/apache/spark/pull/26440#issuecomment-573495311 Test PASSed. Refer to this link for build results (access rights to CI server neede

[GitHub] [spark] AmplabJenkins removed a comment on issue #26440: [SPARK-20628][CORE][K8S] Start to improve Spark decommissioning & preemption support

AmplabJenkins removed a comment on issue #26440: [SPARK-20628][CORE][K8S] Start to improve Spark decommissioning & preemption support URL: https://github.com/apache/spark/pull/26440#issuecomment-573495308 Merged build finished. Test PASSed. -

[GitHub] [spark] AmplabJenkins commented on issue #26440: [SPARK-20628][CORE][K8S] Start to improve Spark decommissioning & preemption support

AmplabJenkins commented on issue #26440: [SPARK-20628][CORE][K8S] Start to improve Spark decommissioning & preemption support URL: https://github.com/apache/spark/pull/26440#issuecomment-573495308 Merged build finished. Test PASSed. -

[GitHub] [spark] AmplabJenkins commented on issue #26440: [SPARK-20628][CORE][K8S] Start to improve Spark decommissioning & preemption support

AmplabJenkins commented on issue #26440: [SPARK-20628][CORE][K8S] Start to improve Spark decommissioning & preemption support URL: https://github.com/apache/spark/pull/26440#issuecomment-573495311 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] SparkQA commented on issue #26440: [SPARK-20628][CORE][K8S] Start to improve Spark decommissioning & preemption support

SparkQA commented on issue #26440: [SPARK-20628][CORE][K8S] Start to improve Spark decommissioning & preemption support URL: https://github.com/apache/spark/pull/26440#issuecomment-573495045 **[Test build #116577 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuil

[GitHub] [spark] SparkQA removed a comment on issue #26440: [SPARK-20628][CORE][K8S] Start to improve Spark decommissioning & preemption support

SparkQA removed a comment on issue #26440: [SPARK-20628][CORE][K8S] Start to improve Spark decommissioning & preemption support URL: https://github.com/apache/spark/pull/26440#issuecomment-573478595 **[Test build #116577 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequ

[GitHub] [spark] AmplabJenkins removed a comment on issue #24936: [SPARK-24634][SS] Add a new metric regarding number of rows later than watermark plus allowed delay

AmplabJenkins removed a comment on issue #24936: [SPARK-24634][SS] Add a new metric regarding number of rows later than watermark plus allowed delay URL: https://github.com/apache/spark/pull/24936#issuecomment-573494137 Test FAILed. Refer to this link for build results (access rights to

[GitHub] [spark] AmplabJenkins removed a comment on issue #24936: [SPARK-24634][SS] Add a new metric regarding number of rows later than watermark plus allowed delay

AmplabJenkins removed a comment on issue #24936: [SPARK-24634][SS] Add a new metric regarding number of rows later than watermark plus allowed delay URL: https://github.com/apache/spark/pull/24936#issuecomment-573494133 Merged build finished. Test FAILed. --

[GitHub] [spark] SparkQA removed a comment on issue #24936: [SPARK-24634][SS] Add a new metric regarding number of rows later than watermark plus allowed delay

SparkQA removed a comment on issue #24936: [SPARK-24634][SS] Add a new metric regarding number of rows later than watermark plus allowed delay URL: https://github.com/apache/spark/pull/24936#issuecomment-573492648 **[Test build #116589 has started](https://amplab.cs.berkeley.edu/jenkins/jo

[GitHub] [spark] AmplabJenkins commented on issue #24936: [SPARK-24634][SS] Add a new metric regarding number of rows later than watermark plus allowed delay

AmplabJenkins commented on issue #24936: [SPARK-24634][SS] Add a new metric regarding number of rows later than watermark plus allowed delay URL: https://github.com/apache/spark/pull/24936#issuecomment-573494133 Merged build finished. Test FAILed. --

[GitHub] [spark] AmplabJenkins commented on issue #24936: [SPARK-24634][SS] Add a new metric regarding number of rows later than watermark plus allowed delay

AmplabJenkins commented on issue #24936: [SPARK-24634][SS] Add a new metric regarding number of rows later than watermark plus allowed delay URL: https://github.com/apache/spark/pull/24936#issuecomment-573494137 Test FAILed. Refer to this link for build results (access rights to CI serve

[GitHub] [spark] SparkQA commented on issue #24936: [SPARK-24634][SS] Add a new metric regarding number of rows later than watermark plus allowed delay

SparkQA commented on issue #24936: [SPARK-24634][SS] Add a new metric regarding number of rows later than watermark plus allowed delay URL: https://github.com/apache/spark/pull/24936#issuecomment-573494121 **[Test build #116589 has finished](https://amplab.cs.berkeley.edu/jenkins/job/Spark

[GitHub] [spark] AmplabJenkins commented on issue #27176: [WIP][SPIP]Support year-month and day-time interval types

AmplabJenkins commented on issue #27176: [WIP][SPIP]Support year-month and day-time interval types URL: https://github.com/apache/spark/pull/27176#issuecomment-573493827 Merged build finished. Test PASSed. This is an automate

[GitHub] [spark] AmplabJenkins removed a comment on issue #27176: [WIP][SPIP]Support year-month and day-time interval types

AmplabJenkins removed a comment on issue #27176: [WIP][SPIP]Support year-month and day-time interval types URL: https://github.com/apache/spark/pull/27176#issuecomment-573493831 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.

[GitHub] [spark] AmplabJenkins commented on issue #27176: [WIP][SPIP]Support year-month and day-time interval types

AmplabJenkins commented on issue #27176: [WIP][SPIP]Support year-month and day-time interval types URL: https://github.com/apache/spark/pull/27176#issuecomment-573493831 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley

[GitHub] [spark] AmplabJenkins removed a comment on issue #27176: [WIP][SPIP]Support year-month and day-time interval types

AmplabJenkins removed a comment on issue #27176: [WIP][SPIP]Support year-month and day-time interval types URL: https://github.com/apache/spark/pull/27176#issuecomment-573493827 Merged build finished. Test PASSed. This is an

[GitHub] [spark] SparkQA commented on issue #27176: [WIP][SPIP]Support year-month and day-time interval types

SparkQA commented on issue #27176: [WIP][SPIP]Support year-month and day-time interval types URL: https://github.com/apache/spark/pull/27176#issuecomment-573493653 **[Test build #116591 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/116591/testReport)** fo

[GitHub] [spark] cloud-fan commented on issue #27077: [SPARK-30408][SQL] Should not remove orderBy in sortBy clause in Optimizer

cloud-fan commented on issue #27077: [SPARK-30408][SQL] Should not remove orderBy in sortBy clause in Optimizer URL: https://github.com/apache/spark/pull/27077#issuecomment-573493537 I think it's about the sort semantic. `df.sort('a)` means the result should be sorted by column `a`. But ho

[GitHub] [spark] AmplabJenkins removed a comment on issue #24173: [SPARK-27237][SS] Introduce State schema validation among query restart

AmplabJenkins removed a comment on issue #24173: [SPARK-27237][SS] Introduce State schema validation among query restart URL: https://github.com/apache/spark/pull/24173#issuecomment-573492816 Test PASSed. Refer to this link for build results (access rights to CI server needed): http

[GitHub] [spark] AmplabJenkins removed a comment on issue #24936: [SPARK-24634][SS] Add a new metric regarding number of rows later than watermark plus allowed delay

AmplabJenkins removed a comment on issue #24936: [SPARK-24634][SS] Add a new metric regarding number of rows later than watermark plus allowed delay URL: https://github.com/apache/spark/pull/24936#issuecomment-573492820 Test PASSed. Refer to this link for build results (access rights to

[GitHub] [spark] AmplabJenkins removed a comment on issue #24936: [SPARK-24634][SS] Add a new metric regarding number of rows later than watermark plus allowed delay

AmplabJenkins removed a comment on issue #24936: [SPARK-24634][SS] Add a new metric regarding number of rows later than watermark plus allowed delay URL: https://github.com/apache/spark/pull/24936#issuecomment-573492817 Merged build finished. Test PASSed. --

[GitHub] [spark] AmplabJenkins removed a comment on issue #24173: [SPARK-27237][SS] Introduce State schema validation among query restart

AmplabJenkins removed a comment on issue #24173: [SPARK-27237][SS] Introduce State schema validation among query restart URL: https://github.com/apache/spark/pull/24173#issuecomment-573492812 Merged build finished. Test PASSed. --

[GitHub] [spark] AmplabJenkins commented on issue #24936: [SPARK-24634][SS] Add a new metric regarding number of rows later than watermark plus allowed delay

AmplabJenkins commented on issue #24936: [SPARK-24634][SS] Add a new metric regarding number of rows later than watermark plus allowed delay URL: https://github.com/apache/spark/pull/24936#issuecomment-573492817 Merged build finished. Test PASSed. --

[GitHub] [spark] AmplabJenkins commented on issue #24936: [SPARK-24634][SS] Add a new metric regarding number of rows later than watermark plus allowed delay

AmplabJenkins commented on issue #24936: [SPARK-24634][SS] Add a new metric regarding number of rows later than watermark plus allowed delay URL: https://github.com/apache/spark/pull/24936#issuecomment-573492820 Test PASSed. Refer to this link for build results (access rights to CI serve

[GitHub] [spark] AmplabJenkins commented on issue #24173: [SPARK-27237][SS] Introduce State schema validation among query restart

AmplabJenkins commented on issue #24173: [SPARK-27237][SS] Introduce State schema validation among query restart URL: https://github.com/apache/spark/pull/24173#issuecomment-573492816 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://ampl

[GitHub] [spark] AmplabJenkins commented on issue #24173: [SPARK-27237][SS] Introduce State schema validation among query restart

AmplabJenkins commented on issue #24173: [SPARK-27237][SS] Introduce State schema validation among query restart URL: https://github.com/apache/spark/pull/24173#issuecomment-573492812 Merged build finished. Test PASSed. This

[GitHub] [spark] SparkQA commented on issue #27164: [SPARK-30479][SQL] Apply compaction of event log to SQL events

SparkQA commented on issue #27164: [SPARK-30479][SQL] Apply compaction of event log to SQL events URL: https://github.com/apache/spark/pull/27164#issuecomment-573492646 **[Test build #116585 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/116585/testReport)*

[GitHub] [spark] SparkQA commented on issue #24936: [SPARK-24634][SS] Add a new metric regarding number of rows later than watermark plus allowed delay

SparkQA commented on issue #24936: [SPARK-24634][SS] Add a new metric regarding number of rows later than watermark plus allowed delay URL: https://github.com/apache/spark/pull/24936#issuecomment-573492648 **[Test build #116589 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkP

[GitHub] [spark] SparkQA commented on issue #24173: [SPARK-27237][SS] Introduce State schema validation among query restart

SparkQA commented on issue #24173: [SPARK-27237][SS] Introduce State schema validation among query restart URL: https://github.com/apache/spark/pull/24173#issuecomment-573492660 **[Test build #116590 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/116590/tes

[GitHub] [spark] SparkQA commented on issue #25965: [SPARK-26425][SS] Add more constraint checks in file streaming source to avoid checkpoint corruption

SparkQA commented on issue #25965: [SPARK-26425][SS] Add more constraint checks in file streaming source to avoid checkpoint corruption URL: https://github.com/apache/spark/pull/25965#issuecomment-573492649 **[Test build #116587 has started](https://amplab.cs.berkeley.edu/jenkins/job/Spark

[GitHub] [spark] SparkQA commented on issue #24990: [SPARK-28191][SS] New data source - state - reader part

SparkQA commented on issue #24990: [SPARK-28191][SS] New data source - state - reader part URL: https://github.com/apache/spark/pull/24990#issuecomment-573492657 **[Test build #116588 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/116588/testReport)** for

[GitHub] [spark] SparkQA commented on issue #25987: [SPARK-29314][SS] Don't overwrite the metric "updated" of state operator to 0 if empty batch is run

SparkQA commented on issue #25987: [SPARK-29314][SS] Don't overwrite the metric "updated" of state operator to 0 if empty batch is run URL: https://github.com/apache/spark/pull/25987#issuecomment-573492644 **[Test build #116586 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkP

[GitHub] [spark] AmplabJenkins removed a comment on issue #27164: [SPARK-30479][SQL] Apply compaction of event log to SQL events

AmplabJenkins removed a comment on issue #27164: [SPARK-30479][SQL] Apply compaction of event log to SQL events URL: https://github.com/apache/spark/pull/27164#issuecomment-573491843 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://ampla

[GitHub] [spark] AmplabJenkins removed a comment on issue #27164: [SPARK-30479][SQL] Apply compaction of event log to SQL events

AmplabJenkins removed a comment on issue #27164: [SPARK-30479][SQL] Apply compaction of event log to SQL events URL: https://github.com/apache/spark/pull/27164#issuecomment-573491838 Merged build finished. Test PASSed. This i

[GitHub] [spark] AmplabJenkins commented on issue #27164: [SPARK-30479][SQL] Apply compaction of event log to SQL events

AmplabJenkins commented on issue #27164: [SPARK-30479][SQL] Apply compaction of event log to SQL events URL: https://github.com/apache/spark/pull/27164#issuecomment-573491843 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.ber

[GitHub] [spark] HeartSaVioR commented on issue #24173: [SPARK-27237][SS] Introduce State schema validation among query restart

HeartSaVioR commented on issue #24173: [SPARK-27237][SS] Introduce State schema validation among query restart URL: https://github.com/apache/spark/pull/24173#issuecomment-573491845 retest this, please This is an automated me

[GitHub] [spark] HeartSaVioR commented on issue #25987: [SPARK-29314][SS] Don't overwrite the metric "updated" of state operator to 0 if empty batch is run

HeartSaVioR commented on issue #25987: [SPARK-29314][SS] Don't overwrite the metric "updated" of state operator to 0 if empty batch is run URL: https://github.com/apache/spark/pull/25987#issuecomment-573491759 retest this, please

[GitHub] [spark] AmplabJenkins commented on issue #27164: [SPARK-30479][SQL] Apply compaction of event log to SQL events

AmplabJenkins commented on issue #27164: [SPARK-30479][SQL] Apply compaction of event log to SQL events URL: https://github.com/apache/spark/pull/27164#issuecomment-573491838 Merged build finished. Test PASSed. This is an aut

[GitHub] [spark] HeartSaVioR commented on issue #24990: [SPARK-28191][SS] New data source - state - reader part

HeartSaVioR commented on issue #24990: [SPARK-28191][SS] New data source - state - reader part URL: https://github.com/apache/spark/pull/24990#issuecomment-573491804 retest this, please This is an automated message from the A

[GitHub] [spark] HeartSaVioR commented on issue #25965: [SPARK-26425][SS] Add more constraint checks in file streaming source to avoid checkpoint corruption

HeartSaVioR commented on issue #25965: [SPARK-26425][SS] Add more constraint checks in file streaming source to avoid checkpoint corruption URL: https://github.com/apache/spark/pull/25965#issuecomment-573491778 retest this, please ---

[GitHub] [spark] HeartSaVioR commented on issue #24936: [SPARK-24634][SS] Add a new metric regarding number of rows later than watermark plus allowed delay

HeartSaVioR commented on issue #24936: [SPARK-24634][SS] Add a new metric regarding number of rows later than watermark plus allowed delay URL: https://github.com/apache/spark/pull/24936#issuecomment-573491827 retest this, please

[GitHub] [spark] HeartSaVioR commented on issue #27164: [SPARK-30479][SQL] Apply compaction of event log to SQL events

HeartSaVioR commented on issue #27164: [SPARK-30479][SQL] Apply compaction of event log to SQL events URL: https://github.com/apache/spark/pull/27164#issuecomment-573491696 retest this, please This is an automated message fro

[GitHub] [spark] AmplabJenkins removed a comment on issue #27180: [SPARK-30409][TEST][FOLLOWUP][HOTFIX] Remove dangling JSONBenchmark-jdk11-results.txt

AmplabJenkins removed a comment on issue #27180: [SPARK-30409][TEST][FOLLOWUP][HOTFIX] Remove dangling JSONBenchmark-jdk11-results.txt URL: https://github.com/apache/spark/pull/27180#issuecomment-573490149 Test PASSed. Refer to this link for build results (access rights to CI server nee

[GitHub] [spark] AmplabJenkins removed a comment on issue #27180: [SPARK-30409][TEST][FOLLOWUP][HOTFIX] Remove dangling JSONBenchmark-jdk11-results.txt

AmplabJenkins removed a comment on issue #27180: [SPARK-30409][TEST][FOLLOWUP][HOTFIX] Remove dangling JSONBenchmark-jdk11-results.txt URL: https://github.com/apache/spark/pull/27180#issuecomment-573490146 Merged build finished. Test PASSed. ---

[GitHub] [spark] AmplabJenkins commented on issue #27180: [SPARK-30409][TEST][FOLLOWUP][HOTFIX] Remove dangling JSONBenchmark-jdk11-results.txt

AmplabJenkins commented on issue #27180: [SPARK-30409][TEST][FOLLOWUP][HOTFIX] Remove dangling JSONBenchmark-jdk11-results.txt URL: https://github.com/apache/spark/pull/27180#issuecomment-573490149 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #27180: [SPARK-30409][TEST][FOLLOWUP][HOTFIX] Remove dangling JSONBenchmark-jdk11-results.txt

AmplabJenkins commented on issue #27180: [SPARK-30409][TEST][FOLLOWUP][HOTFIX] Remove dangling JSONBenchmark-jdk11-results.txt URL: https://github.com/apache/spark/pull/27180#issuecomment-573490146 Merged build finished. Test PASSed.

[GitHub] [spark] SparkQA removed a comment on issue #27180: [SPARK-30409][TEST][FOLLOWUP][HOTFIX] Remove dangling JSONBenchmark-jdk11-results.txt

SparkQA removed a comment on issue #27180: [SPARK-30409][TEST][FOLLOWUP][HOTFIX] Remove dangling JSONBenchmark-jdk11-results.txt URL: https://github.com/apache/spark/pull/27180#issuecomment-573466134 **[Test build #116573 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRe

[GitHub] [spark] SparkQA commented on issue #27180: [SPARK-30409][TEST][FOLLOWUP][HOTFIX] Remove dangling JSONBenchmark-jdk11-results.txt

SparkQA commented on issue #27180: [SPARK-30409][TEST][FOLLOWUP][HOTFIX] Remove dangling JSONBenchmark-jdk11-results.txt URL: https://github.com/apache/spark/pull/27180#issuecomment-573489966 **[Test build #116573 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBui

[GitHub] [spark] AmplabJenkins removed a comment on issue #27146: [SPARK-21869][SS][DOCS][FOLLOWUP] Document Kafka producer pool configuration

AmplabJenkins removed a comment on issue #27146: [SPARK-21869][SS][DOCS][FOLLOWUP] Document Kafka producer pool configuration URL: https://github.com/apache/spark/pull/27146#issuecomment-573489141 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on issue #27146: [SPARK-21869][SS][DOCS][FOLLOWUP] Document Kafka producer pool configuration

AmplabJenkins removed a comment on issue #27146: [SPARK-21869][SS][DOCS][FOLLOWUP] Document Kafka producer pool configuration URL: https://github.com/apache/spark/pull/27146#issuecomment-573489134 Merged build finished. Test PASSed. -

[GitHub] [spark] AmplabJenkins removed a comment on issue #26711: [SPARK-30069][CORE][YARN] Clean up non-shuffle disk block manager files following executor exists on YARN

AmplabJenkins removed a comment on issue #26711: [SPARK-30069][CORE][YARN] Clean up non-shuffle disk block manager files following executor exists on YARN URL: https://github.com/apache/spark/pull/26711#issuecomment-573488992 Test PASSed. Refer to this link for build results (access righ

[GitHub] [spark] AmplabJenkins removed a comment on issue #26711: [SPARK-30069][CORE][YARN] Clean up non-shuffle disk block manager files following executor exists on YARN

AmplabJenkins removed a comment on issue #26711: [SPARK-30069][CORE][YARN] Clean up non-shuffle disk block manager files following executor exists on YARN URL: https://github.com/apache/spark/pull/26711#issuecomment-573488989 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins commented on issue #27146: [SPARK-21869][SS][DOCS][FOLLOWUP] Document Kafka producer pool configuration

AmplabJenkins commented on issue #27146: [SPARK-21869][SS][DOCS][FOLLOWUP] Document Kafka producer pool configuration URL: https://github.com/apache/spark/pull/27146#issuecomment-573489141 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://

[GitHub] [spark] AmplabJenkins commented on issue #27146: [SPARK-21869][SS][DOCS][FOLLOWUP] Document Kafka producer pool configuration

AmplabJenkins commented on issue #27146: [SPARK-21869][SS][DOCS][FOLLOWUP] Document Kafka producer pool configuration URL: https://github.com/apache/spark/pull/27146#issuecomment-573489134 Merged build finished. Test PASSed.

[GitHub] [spark] SparkQA removed a comment on issue #27146: [SPARK-21869][SS][DOCS][FOLLOWUP] Document Kafka producer pool configuration

SparkQA removed a comment on issue #27146: [SPARK-21869][SS][DOCS][FOLLOWUP] Document Kafka producer pool configuration URL: https://github.com/apache/spark/pull/27146#issuecomment-573487753 **[Test build #116584 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuild

[GitHub] [spark] SparkQA commented on issue #27146: [SPARK-21869][SS][DOCS][FOLLOWUP] Document Kafka producer pool configuration

SparkQA commented on issue #27146: [SPARK-21869][SS][DOCS][FOLLOWUP] Document Kafka producer pool configuration URL: https://github.com/apache/spark/pull/27146#issuecomment-573489089 **[Test build #116584 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/1165

[GitHub] [spark] AmplabJenkins commented on issue #26711: [SPARK-30069][CORE][YARN] Clean up non-shuffle disk block manager files following executor exists on YARN

AmplabJenkins commented on issue #26711: [SPARK-30069][CORE][YARN] Clean up non-shuffle disk block manager files following executor exists on YARN URL: https://github.com/apache/spark/pull/26711#issuecomment-573488989 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins commented on issue #26711: [SPARK-30069][CORE][YARN] Clean up non-shuffle disk block manager files following executor exists on YARN

AmplabJenkins commented on issue #26711: [SPARK-30069][CORE][YARN] Clean up non-shuffle disk block manager files following executor exists on YARN URL: https://github.com/apache/spark/pull/26711#issuecomment-573488992 Test PASSed. Refer to this link for build results (access rights to CI

[GitHub] [spark] HyukjinKwon commented on issue #27181: [SPARK-30493][PYTHON][ML] Remove OneVsRestModel setClassifier, setLabelCol and setWeightCol methods

HyukjinKwon commented on issue #27181: [SPARK-30493][PYTHON][ML] Remove OneVsRestModel setClassifier, setLabelCol and setWeightCol methods URL: https://github.com/apache/spark/pull/27181#issuecomment-573488500 @zero323, please keep and follow the PR template - https://github.com/apache/spa

[GitHub] [spark] dongjoon-hyun commented on issue #27077: [SPARK-30408][SQL] Should not remove orderBy in sortBy clause in Optimizer

dongjoon-hyun commented on issue #27077: [SPARK-30408][SQL] Should not remove orderBy in sortBy clause in Optimizer URL: https://github.com/apache/spark/pull/27077#issuecomment-573487854 I'll close this PR and JIRA issue. We can continue to discuss and reopen this if needed, @apapi .

<    1   2   3   4   5   6   7   8   9   10   >