[GitHub] [spark] AmplabJenkins removed a comment on pull request #25965: [SPARK-26425][SS] Add more constraint checks to avoid checkpoint corruption

2020-05-26 Thread GitBox
AmplabJenkins removed a comment on pull request #25965: URL: https://github.com/apache/spark/pull/25965#issuecomment-634438431 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on pull request #25965: [SPARK-26425][SS] Add more constraint checks to avoid checkpoint corruption

2020-05-26 Thread GitBox
AmplabJenkins removed a comment on pull request #25965: URL: https://github.com/apache/spark/pull/25965#issuecomment-634438426 Merged build finished. Test FAILed. This is an automated message from the Apache Git Service. To

[GitHub] [spark] SparkQA commented on pull request #25965: [SPARK-26425][SS] Add more constraint checks to avoid checkpoint corruption

2020-05-26 Thread GitBox
SparkQA commented on pull request #25965: URL: https://github.com/apache/spark/pull/25965#issuecomment-634438282 **[Test build #123157 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/123157/testReport)** for PR 25965 at commit

[GitHub] [spark] AmplabJenkins commented on pull request #25965: [SPARK-26425][SS] Add more constraint checks to avoid checkpoint corruption

2020-05-26 Thread GitBox
AmplabJenkins commented on pull request #25965: URL: https://github.com/apache/spark/pull/25965#issuecomment-634438426 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] SparkQA removed a comment on pull request #25965: [SPARK-26425][SS] Add more constraint checks to avoid checkpoint corruption

2020-05-26 Thread GitBox
SparkQA removed a comment on pull request #25965: URL: https://github.com/apache/spark/pull/25965#issuecomment-634387900 **[Test build #123157 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/123157/testReport)** for PR 25965 at commit

[GitHub] [spark] kiszk commented on a change in pull request #28593: [SPARK-31710][SQL] Fail casting numeric to timestamp by default

2020-05-26 Thread GitBox
kiszk commented on a change in pull request #28593: URL: https://github.com/apache/spark/pull/28593#discussion_r430862928 ## File path: sql/catalyst/src/test/scala/org/apache/spark/sql/catalyst/expressions/CastSuite.scala ## @@ -1311,6 +1311,27 @@ class CastSuite extends

[GitHub] [spark] SparkQA commented on pull request #28650: [SPARK-31830][SQL] Consistent error handling for datetime formatting functions

2020-05-26 Thread GitBox
SparkQA commented on pull request #28650: URL: https://github.com/apache/spark/pull/28650#issuecomment-634434966 **[Test build #123165 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/123165/testReport)** for PR 28650 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28650: [SPARK-31830][SQL] Consistent error handling for datetime formatting functions

2020-05-26 Thread GitBox
AmplabJenkins removed a comment on pull request #28650: URL: https://github.com/apache/spark/pull/28650#issuecomment-634433042 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] kiszk commented on a change in pull request #28593: [SPARK-31710][SQL] Fail casting numeric to timestamp by default

2020-05-26 Thread GitBox
kiszk commented on a change in pull request #28593: URL: https://github.com/apache/spark/pull/28593#discussion_r430861312 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/Cast.scala ## @@ -266,7 +266,15 @@ abstract class CastBase extends

[GitHub] [spark] AmplabJenkins commented on pull request #28650: [SPARK-31830][SQL] Consistent error handling for datetime formatting functions

2020-05-26 Thread GitBox
AmplabJenkins commented on pull request #28650: URL: https://github.com/apache/spark/pull/28650#issuecomment-634433042 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28650: [SPARK-31830][SQL] Consistent error handling for datetime formatting functions

2020-05-26 Thread GitBox
AmplabJenkins removed a comment on pull request #28650: URL: https://github.com/apache/spark/pull/28650#issuecomment-634414043 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on pull request #27694: [SPARK-30946][SS] Serde entry with UnsafeRow on FileStream(Source/Sink)Log with LZ4 compression

2020-05-26 Thread GitBox
AmplabJenkins commented on pull request #27694: URL: https://github.com/apache/spark/pull/27694#issuecomment-634432819 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins removed a comment on pull request #27694: [SPARK-30946][SS] Serde entry with UnsafeRow on FileStream(Source/Sink)Log with LZ4 compression

2020-05-26 Thread GitBox
AmplabJenkins removed a comment on pull request #27694: URL: https://github.com/apache/spark/pull/27694#issuecomment-634432819 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] yaooqinn commented on pull request #28650: [SPARK-31830][SQL] Consistent error handling for datetime formatting functions

2020-05-26 Thread GitBox
yaooqinn commented on pull request #28650: URL: https://github.com/apache/spark/pull/28650#issuecomment-634432602 retest this please This is an automated message from the Apache Git Service. To respond to the message, please

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28425: [SPARK-31480][SQL] Improve the EXPLAIN FORMATTED's output for DSV2's Scan Node

2020-05-26 Thread GitBox
AmplabJenkins removed a comment on pull request #28425: URL: https://github.com/apache/spark/pull/28425#issuecomment-634432338 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins commented on pull request #28425: [SPARK-31480][SQL] Improve the EXPLAIN FORMATTED's output for DSV2's Scan Node

2020-05-26 Thread GitBox
AmplabJenkins commented on pull request #28425: URL: https://github.com/apache/spark/pull/28425#issuecomment-634432338 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] SparkQA removed a comment on pull request #27694: [SPARK-30946][SS] Serde entry with UnsafeRow on FileStream(Source/Sink)Log with LZ4 compression

2020-05-26 Thread GitBox
SparkQA removed a comment on pull request #27694: URL: https://github.com/apache/spark/pull/27694#issuecomment-634380448 **[Test build #123156 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/123156/testReport)** for PR 27694 at commit

[GitHub] [spark] SparkQA commented on pull request #27694: [SPARK-30946][SS] Serde entry with UnsafeRow on FileStream(Source/Sink)Log with LZ4 compression

2020-05-26 Thread GitBox
SparkQA commented on pull request #27694: URL: https://github.com/apache/spark/pull/27694#issuecomment-634432090 **[Test build #123156 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/123156/testReport)** for PR 27694 at commit

[GitHub] [spark] SparkQA removed a comment on pull request #28425: [SPARK-31480][SQL] Improve the EXPLAIN FORMATTED's output for DSV2's Scan Node

2020-05-26 Thread GitBox
SparkQA removed a comment on pull request #28425: URL: https://github.com/apache/spark/pull/28425#issuecomment-634338287 **[Test build #123153 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/123153/testReport)** for PR 28425 at commit

[GitHub] [spark] SparkQA commented on pull request #28425: [SPARK-31480][SQL] Improve the EXPLAIN FORMATTED's output for DSV2's Scan Node

2020-05-26 Thread GitBox
SparkQA commented on pull request #28425: URL: https://github.com/apache/spark/pull/28425#issuecomment-634431700 **[Test build #123153 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/123153/testReport)** for PR 28425 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #27620: [SPARK-30866][SS] FileStreamSource: Cache fetched list of files beyond maxFilesPerTrigger as unread files

2020-05-26 Thread GitBox
AmplabJenkins removed a comment on pull request #27620: URL: https://github.com/apache/spark/pull/27620#issuecomment-634421948 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins removed a comment on pull request #24173: [SPARK-27237][SS] Introduce State schema validation among query restart

2020-05-26 Thread GitBox
AmplabJenkins removed a comment on pull request #24173: URL: https://github.com/apache/spark/pull/24173#issuecomment-634422030 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins commented on pull request #27333: [SPARK-29438][SS][FOLLOWUP] Add regression tests for Streaming Aggregation and flatMapGroupsWithState

2020-05-26 Thread GitBox
AmplabJenkins commented on pull request #27333: URL: https://github.com/apache/spark/pull/27333#issuecomment-634422033 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins commented on pull request #24173: [SPARK-27237][SS] Introduce State schema validation among query restart

2020-05-26 Thread GitBox
AmplabJenkins commented on pull request #24173: URL: https://github.com/apache/spark/pull/24173#issuecomment-634422030 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28422: [SPARK-17604][SS] FileStreamSource: provide a new option to have retention on input files

2020-05-26 Thread GitBox
AmplabJenkins removed a comment on pull request #28422: URL: https://github.com/apache/spark/pull/28422#issuecomment-634421967 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins removed a comment on pull request #27333: [SPARK-29438][SS][FOLLOWUP] Add regression tests for Streaming Aggregation and flatMapGroupsWithState

2020-05-26 Thread GitBox
AmplabJenkins removed a comment on pull request #27333: URL: https://github.com/apache/spark/pull/27333#issuecomment-634422033 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins commented on pull request #27620: [SPARK-30866][SS] FileStreamSource: Cache fetched list of files beyond maxFilesPerTrigger as unread files

2020-05-26 Thread GitBox
AmplabJenkins commented on pull request #27620: URL: https://github.com/apache/spark/pull/27620#issuecomment-634421948 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins commented on pull request #28422: [SPARK-17604][SS] FileStreamSource: provide a new option to have retention on input files

2020-05-26 Thread GitBox
AmplabJenkins commented on pull request #28422: URL: https://github.com/apache/spark/pull/28422#issuecomment-634421967 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] SparkQA commented on pull request #27620: [SPARK-30866][SS] FileStreamSource: Cache fetched list of files beyond maxFilesPerTrigger as unread files

2020-05-26 Thread GitBox
SparkQA commented on pull request #27620: URL: https://github.com/apache/spark/pull/27620#issuecomment-634421710 **[Test build #123162 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/123162/testReport)** for PR 27620 at commit

[GitHub] [spark] SparkQA commented on pull request #28422: [SPARK-17604][SS] FileStreamSource: provide a new option to have retention on input files

2020-05-26 Thread GitBox
SparkQA commented on pull request #28422: URL: https://github.com/apache/spark/pull/28422#issuecomment-634421709 **[Test build #123161 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/123161/testReport)** for PR 28422 at commit

[GitHub] [spark] SparkQA commented on pull request #24173: [SPARK-27237][SS] Introduce State schema validation among query restart

2020-05-26 Thread GitBox
SparkQA commented on pull request #24173: URL: https://github.com/apache/spark/pull/24173#issuecomment-634421696 **[Test build #123164 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/123164/testReport)** for PR 24173 at commit

[GitHub] [spark] SparkQA commented on pull request #27333: [SPARK-29438][SS][FOLLOWUP] Add regression tests for Streaming Aggregation and flatMapGroupsWithState

2020-05-26 Thread GitBox
SparkQA commented on pull request #27333: URL: https://github.com/apache/spark/pull/27333#issuecomment-634421671 **[Test build #123163 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/123163/testReport)** for PR 27333 at commit

[GitHub] [spark] HeartSaVioR commented on pull request #24173: [SPARK-27237][SS] Introduce State schema validation among query restart

2020-05-26 Thread GitBox
HeartSaVioR commented on pull request #24173: URL: https://github.com/apache/spark/pull/24173#issuecomment-634421224 retest this, please This is an automated message from the Apache Git Service. To respond to the message,

[GitHub] [spark] HeartSaVioR commented on pull request #28422: [SPARK-17604][SS] FileStreamSource: provide a new option to have retention on input files

2020-05-26 Thread GitBox
HeartSaVioR commented on pull request #28422: URL: https://github.com/apache/spark/pull/28422#issuecomment-634421190 retest this, please This is an automated message from the Apache Git Service. To respond to the message,

[GitHub] [spark] HeartSaVioR commented on pull request #27620: [SPARK-30866][SS] FileStreamSource: Cache fetched list of files beyond maxFilesPerTrigger as unread files

2020-05-26 Thread GitBox
HeartSaVioR commented on pull request #27620: URL: https://github.com/apache/spark/pull/27620#issuecomment-634420718 retest this, please This is an automated message from the Apache Git Service. To respond to the message,

[GitHub] [spark] HeartSaVioR commented on pull request #27333: [SPARK-29438][SS][FOLLOWUP] Add regression tests for Streaming Aggregation and flatMapGroupsWithState

2020-05-26 Thread GitBox
HeartSaVioR commented on pull request #27333: URL: https://github.com/apache/spark/pull/27333#issuecomment-634420114 retest this, please This is an automated message from the Apache Git Service. To respond to the message,

[GitHub] [spark] AmplabJenkins removed a comment on pull request #27694: [SPARK-30946][SS] Serde entry with UnsafeRow on FileStream(Source/Sink)Log with LZ4 compression

2020-05-26 Thread GitBox
AmplabJenkins removed a comment on pull request #27694: URL: https://github.com/apache/spark/pull/27694#issuecomment-634323950 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins commented on pull request #26935: [SPARK-30294][SS] Explicitly defines read-only StateStore and optimize for HDFSBackedStateStore

2020-05-26 Thread GitBox
AmplabJenkins commented on pull request #26935: URL: https://github.com/apache/spark/pull/26935#issuecomment-634417466 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] SparkQA commented on pull request #28593: [SPARK-31710][SQL] Fail casting numeric to timestamp by default

2020-05-26 Thread GitBox
SparkQA commented on pull request #28593: URL: https://github.com/apache/spark/pull/28593#issuecomment-634318498 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and

[GitHub] [spark] SparkQA commented on pull request #28650: [SPARK-31830][SQL] Consistent error handling for datetime formatting functions

2020-05-26 Thread GitBox
SparkQA commented on pull request #28650: URL: https://github.com/apache/spark/pull/28650#issuecomment-634413806 **[Test build #123160 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/123160/testReport)** for PR 28650 at commit

[GitHub] [spark] SparkQA removed a comment on pull request #28593: [SPARK-31710][SQL] Fail casting numeric to timestamp by default

2020-05-26 Thread GitBox
SparkQA removed a comment on pull request #28593: URL: https://github.com/apache/spark/pull/28593#issuecomment-634410085 **[Test build #123159 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/123159/testReport)** for PR 28593 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #26935: [SPARK-30294][SS] Explicitly defines read-only StateStore and optimize for HDFSBackedStateStore

2020-05-26 Thread GitBox
AmplabJenkins removed a comment on pull request #26935: URL: https://github.com/apache/spark/pull/26935#issuecomment-634417466 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins commented on pull request #28650: [SPARK-31830][SQL] Consistent error handling for datetime formatting functions

2020-05-26 Thread GitBox
AmplabJenkins commented on pull request #28650: URL: https://github.com/apache/spark/pull/28650#issuecomment-634414035 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] SparkQA commented on pull request #26935: [SPARK-30294][SS] Explicitly defines read-only StateStore and optimize for HDFSBackedStateStore

2020-05-26 Thread GitBox
SparkQA commented on pull request #26935: URL: https://github.com/apache/spark/pull/26935#issuecomment-634416943 **[Test build #123145 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/123145/testReport)** for PR 26935 at commit

[GitHub] [spark] AmplabJenkins commented on pull request #28593: [SPARK-31710][SQL] Fail casting numeric to timestamp by default

2020-05-26 Thread GitBox
AmplabJenkins commented on pull request #28593: URL: https://github.com/apache/spark/pull/28593#issuecomment-634410315 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] SparkQA removed a comment on pull request #28648: [SPARK-31788][CORE][DSTREAM][PYTHON] Recover the support of union for different types of RDD and DStreams

2020-05-26 Thread GitBox
SparkQA removed a comment on pull request #28648: URL: https://github.com/apache/spark/pull/28648#issuecomment-634392776 **[Test build #123158 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/123158/testReport)** for PR 28648 at commit

[GitHub] [spark] SparkQA removed a comment on pull request #28647: [SPARK-31828][SQL] Retain table properties at CreateTableLikeCommand

2020-05-26 Thread GitBox
SparkQA removed a comment on pull request #28647: URL: https://github.com/apache/spark/pull/28647#issuecomment-634369436 **[Test build #123155 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/123155/testReport)** for PR 28647 at commit

[GitHub] [spark] yaooqinn opened a new pull request #28650: [SPARK-31830][SQL] Consistent error handling for datetime formatting functions

2020-05-26 Thread GitBox
yaooqinn opened a new pull request #28650: URL: https://github.com/apache/spark/pull/28650 ### What changes were proposed in this pull request? Currently, `date_format` and `from_unixtime` have different exception handling behavior for formatting datetime values. In

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28593: [SPARK-31710][SQL] Fail casting numeric to timestamp by default

2020-05-26 Thread GitBox
AmplabJenkins removed a comment on pull request #28593: URL: https://github.com/apache/spark/pull/28593#issuecomment-634415789 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28650: [SPARK-31830][SQL] Consistent error handling for datetime formatting functions

2020-05-26 Thread GitBox
AmplabJenkins removed a comment on pull request #28650: URL: https://github.com/apache/spark/pull/28650#issuecomment-634414035 Merged build finished. Test FAILed. This is an automated message from the Apache Git Service. To

[GitHub] [spark] zhining-lu opened a new pull request #28644: Merge pull request #1 from apache/master

2020-05-26 Thread GitBox
zhining-lu opened a new pull request #28644: URL: https://github.com/apache/spark/pull/28644 pull request 001 ### What changes were proposed in this pull request? ### Why are the changes needed? ### Does this PR introduce _any_ user-facing

[GitHub] [spark] SparkQA removed a comment on pull request #26935: [SPARK-30294][SS] Explicitly defines read-only StateStore and optimize for HDFSBackedStateStore

2020-05-26 Thread GitBox
SparkQA removed a comment on pull request #26935: URL: https://github.com/apache/spark/pull/26935#issuecomment-634306992 **[Test build #123145 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/123145/testReport)** for PR 26935 at commit

[GitHub] [spark] srowen commented on pull request #28553: [SPARK-31734][ML][PySpark] Add weight support in ClusteringEvaluator

2020-05-26 Thread GitBox
srowen commented on pull request #28553: URL: https://github.com/apache/spark/pull/28553#issuecomment-633594334 Merged to master. You may want to further change the nonnegativity check in your other PR to use the new method you introduced there.

[GitHub] [spark] cloud-fan commented on pull request #28639: [SPARK-31820][SQL][TESTS] Fix flaky JavaBeanDeserializationSuite

2020-05-26 Thread GitBox
cloud-fan commented on pull request #28639: URL: https://github.com/apache/spark/pull/28639#issuecomment-633986761 thanks, merging to master/3.0! This is an automated message from the Apache Git Service. To respond to the

[GitHub] [spark] AmplabJenkins removed a comment on pull request #26935: [SPARK-30294][SS] Explicitly defines read-only StateStore and optimize for HDFSBackedStateStore

2020-05-26 Thread GitBox
AmplabJenkins removed a comment on pull request #26935: URL: https://github.com/apache/spark/pull/26935#issuecomment-634307568 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] SparkQA removed a comment on pull request #28422: [SPARK-17604][SS] FileStreamSource: provide a new option to have retention on input files

2020-05-26 Thread GitBox
SparkQA removed a comment on pull request #28422: URL: https://github.com/apache/spark/pull/28422#issuecomment-634306965 **[Test build #123141 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/123141/testReport)** for PR 28422 at commit

[GitHub] [spark] SparkQA removed a comment on pull request #28641: [SPARK-31824][CORE][TESTS] DAGSchedulerSuite: Improve and reuse completeShuffleMapStageSuccessfully

2020-05-26 Thread GitBox
SparkQA removed a comment on pull request #28641: URL: https://github.com/apache/spark/pull/28641#issuecomment-633922057 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] SparkQA commented on pull request #28425: [SPARK-31480][SQL] Improve the EXPLAIN FORMATTED's output for DSV2's Scan Node

2020-05-26 Thread GitBox
SparkQA commented on pull request #28425: URL: https://github.com/apache/spark/pull/28425#issuecomment-633787704 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28636: [SPARK-31818][SQL][test-hive1.2] Fix pushing down filters with `java.time.Instant` values in ORC

2020-05-26 Thread GitBox
AmplabJenkins removed a comment on pull request #28636: URL: https://github.com/apache/spark/pull/28636#issuecomment-633588483 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] dongjoon-hyun commented on pull request #28638: [SPARK-31819][K8S][DOCS][TESTS] Add a workaround for Java 8u251+ and update integration test cases

2020-05-26 Thread GitBox
dongjoon-hyun commented on pull request #28638: URL: https://github.com/apache/spark/pull/28638#issuecomment-633831799 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] SparkQA removed a comment on pull request #28627: [SPARK-31756][WEBUI][test-maven] Add real headless browser support for UI test

2020-05-26 Thread GitBox
SparkQA removed a comment on pull request #28627: URL: https://github.com/apache/spark/pull/28627#issuecomment-633419679 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] SparkQA removed a comment on pull request #24173: [SPARK-27237][SS] Introduce State schema validation among query restart

2020-05-26 Thread GitBox
SparkQA removed a comment on pull request #24173: URL: https://github.com/apache/spark/pull/24173#issuecomment-634307006 **[Test build #123146 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/123146/testReport)** for PR 24173 at commit

[GitHub] [spark] keypointt commented on a change in pull request #28595: [SPARK-31781][ML][PySpark] Move param k (number of clusters) to shared params

2020-05-26 Thread GitBox
keypointt commented on a change in pull request #28595: URL: https://github.com/apache/spark/pull/28595#discussion_r430155232 ## File path: mllib/src/main/scala/org/apache/spark/ml/param/shared/sharedParams.scala ## @@ -562,4 +562,20 @@ trait HasBlockSize extends Params {

[GitHub] [spark] AmplabJenkins commented on pull request #28645: [SPARK-31826][SQL] Support composed type of case class for typed Scala UDF

2020-05-26 Thread GitBox
AmplabJenkins commented on pull request #28645: URL: https://github.com/apache/spark/pull/28645#issuecomment-634034635 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28583: [SPARK-31764][CORE] JsonProtocol doesn't write RDDInfo#isBarrier

2020-05-26 Thread GitBox
AmplabJenkins removed a comment on pull request #28583: URL: https://github.com/apache/spark/pull/28583#issuecomment-634274631 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] HeartSaVioR commented on pull request #28363: [SPARK-27188][SS] FileStreamSink: provide a new option to have retention on output files

2020-05-26 Thread GitBox
HeartSaVioR commented on pull request #28363: URL: https://github.com/apache/spark/pull/28363#issuecomment-633890605 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub

[GitHub] [spark] AmplabJenkins commented on pull request #28528: [SPARK-31711][CORE] Register the executor source with the metrics system when running in local mode.

2020-05-26 Thread GitBox
AmplabJenkins commented on pull request #28528: URL: https://github.com/apache/spark/pull/28528#issuecomment-633772093 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] SparkQA removed a comment on pull request #28645: [SPARK-31826][SQL] Support composed type of case class for typed Scala UDF

2020-05-26 Thread GitBox
SparkQA removed a comment on pull request #28645: URL: https://github.com/apache/spark/pull/28645#issuecomment-634033907 **[Test build #123125 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/123125/testReport)** for PR 28645 at commit

[GitHub] [spark] AmplabJenkins commented on pull request #28331: [WIP][SPARK-20629][CORE] Copy shuffle data when nodes are being shutdown

2020-05-26 Thread GitBox
AmplabJenkins commented on pull request #28331: URL: https://github.com/apache/spark/pull/28331#issuecomment-634336369 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] seanli-rallyhealth commented on a change in pull request #28635: [SPARK-31337][SQL]Support MS SQL Kerberos login in JDBC connector

2020-05-26 Thread GitBox
seanli-rallyhealth commented on a change in pull request #28635: URL: https://github.com/apache/spark/pull/28635#discussion_r429982799 ## File path: sql/core/src/test/scala/org/apache/spark/sql/execution/datasources/jdbc/connection/MSSQLConnectionProviderSuite.scala ## @@

[GitHub] [spark] srowen commented on pull request #28621: [SPARK-31803][ML] Make sure instance weight is not negative

2020-05-26 Thread GitBox
srowen commented on pull request #28621: URL: https://github.com/apache/spark/pull/28621#issuecomment-633592952 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and

[GitHub] [spark] seanli-rallyhealth commented on a change in pull request #28616: [SPARK-31798][SHUFFLE][API] Shuffle Writer API changes to return custom map output metadata

2020-05-26 Thread GitBox
seanli-rallyhealth commented on a change in pull request #28616: URL: https://github.com/apache/spark/pull/28616#discussion_r429991433 ## File path: core/src/main/java/org/apache/spark/shuffle/api/ShuffleMapOutputWriter.java ## @@ -63,7 +64,7 @@ * The returned array

[GitHub] [spark] AmplabJenkins removed a comment on pull request #27649: [SPARK-30900][SS] FileStreamSource: Avoid reading compact metadata log twice if the query restarts from compact batch

2020-05-26 Thread GitBox
AmplabJenkins removed a comment on pull request #27649: URL: https://github.com/apache/spark/pull/27649#issuecomment-634307485 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28647: [SPARK-31828][SQL] Retain table properties at CreateTableLikeCommand

2020-05-26 Thread GitBox
AmplabJenkins removed a comment on pull request #28647: URL: https://github.com/apache/spark/pull/28647#issuecomment-634369793 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] dongjoon-hyun closed pull request #28633: [SPARK-31808][SQL] Makes struct function's output name and class name pretty

2020-05-26 Thread GitBox
dongjoon-hyun closed pull request #28633: URL: https://github.com/apache/spark/pull/28633 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to

[GitHub] [spark] gatorsmile commented on pull request #28485: [SPARK-31642] Add Pagination Support for Structured Streaming Page

2020-05-26 Thread GitBox
gatorsmile commented on pull request #28485: URL: https://github.com/apache/spark/pull/28485#issuecomment-634396656 > . I will add snapshots soon. @iRakson could you update the PR description with the screenshot.

[GitHub] [spark] MaxGekk commented on pull request #28630: [SPARK-31806][SQL][TESTS] Check reading date/timestamp from legacy parquet: dictionary encoding, w/o Spark version

2020-05-26 Thread GitBox
MaxGekk commented on pull request #28630: URL: https://github.com/apache/spark/pull/28630#issuecomment-633696780 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and

[GitHub] [spark] HyukjinKwon commented on pull request #28523: [SPARK-31706][SQL] add back the support of streaming update mode

2020-05-26 Thread GitBox
HyukjinKwon commented on pull request #28523: URL: https://github.com/apache/spark/pull/28523#issuecomment-633759255 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28584: [SPARK-31730][CORE][TEST] Fix flaky tests in BarrierTaskContextSuite

2020-05-26 Thread GitBox
AmplabJenkins removed a comment on pull request #28584: URL: https://github.com/apache/spark/pull/28584#issuecomment-633803017 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] SparkQA removed a comment on pull request #28619: [SPARK-21040][CORE] Speculate tasks which are running on decommission executors

2020-05-26 Thread GitBox
SparkQA removed a comment on pull request #28619: URL: https://github.com/apache/spark/pull/28619#issuecomment-633594567 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] HyukjinKwon edited a comment on pull request #28603: [SPARK-31788][CORE][PYTHON] Fix UnionRDD of PairRDDs

2020-05-26 Thread GitBox
HyukjinKwon edited a comment on pull request #28603: URL: https://github.com/apache/spark/pull/28603#issuecomment-634365472 Okay, I just noticed https://github.com/apache/spark/commit/f83fedc9f20869ab4c62bb07bac50113d921207f caused this problem, and this is a regression. I am going to

[GitHub] [spark] holdenk commented on a change in pull request #28331: [WIP][SPARK-20629][CORE] Copy shuffle data when nodes are being shutdown

2020-05-26 Thread GitBox
holdenk commented on a change in pull request #28331: URL: https://github.com/apache/spark/pull/28331#discussion_r430563960 ## File path: core/src/test/scala/org/apache/spark/storage/BlockManagerDecommissionSuite.scala ## @@ -69,36 +84,64 @@ class

[GitHub] [spark] SparkQA removed a comment on pull request #27649: [SPARK-30900][SS] FileStreamSource: Avoid reading compact metadata log twice if the query restarts from compact batch

2020-05-26 Thread GitBox
SparkQA removed a comment on pull request #27649: URL: https://github.com/apache/spark/pull/27649#issuecomment-634306966 **[Test build #123142 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/123142/testReport)** for PR 27649 at commit

[GitHub] [spark] igreenfield commented on a change in pull request #28629: [SPARK-31769] Add MDC support for driver threads

2020-05-26 Thread GitBox
igreenfield commented on a change in pull request #28629: URL: https://github.com/apache/spark/pull/28629#discussion_r430656349 ## File path: core/src/main/scala/org/apache/spark/util/ThreadUtils.scala ## @@ -32,6 +33,99 @@ import org.apache.spark.SparkException

[GitHub] [spark] jiangxb1987 commented on pull request #28583: [SPARK-31764][CORE] JsonProtocol doesn't write RDDInfo#isBarrier

2020-05-26 Thread GitBox
jiangxb1987 commented on pull request #28583: URL: https://github.com/apache/spark/pull/28583#issuecomment-634271797 retest this please This is an automated message from the Apache Git Service. To respond to the message,

[GitHub] [spark] SparkQA removed a comment on pull request #28621: [SPARK-31803][ML] Make sure instance weight is not negative

2020-05-26 Thread GitBox
SparkQA removed a comment on pull request #28621: URL: https://github.com/apache/spark/pull/28621#issuecomment-633594546 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins commented on pull request #27333: [SPARK-29438][SS][FOLLOWUP] Add regression tests for Streaming Aggregation and flatMapGroupsWithState

2020-05-26 Thread GitBox
AmplabJenkins commented on pull request #27333: URL: https://github.com/apache/spark/pull/27333#issuecomment-634307498 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28635: [SPARK-31337][SQL]Support MS SQL Kerberos login in JDBC connector

2020-05-26 Thread GitBox
AmplabJenkins removed a comment on pull request #28635: URL: https://github.com/apache/spark/pull/28635#issuecomment-633587738 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] dongjoon-hyun commented on a change in pull request #28528: [SPARK-31711][CORE] Register the executor source with the metrics system when running in local mode.

2020-05-26 Thread GitBox
dongjoon-hyun commented on a change in pull request #28528: URL: https://github.com/apache/spark/pull/28528#discussion_r430176730 ## File path: core/src/main/scala/org/apache/spark/executor/Executor.scala ## @@ -121,7 +121,7 @@ private[spark] class Executor( // create. The

[GitHub] [spark] HyukjinKwon closed pull request #28493: [SPARK-31673][SQL] QueryExection.debug.toFile() to take an addtional explain mode param

2020-05-26 Thread GitBox
HyukjinKwon closed pull request #28493: URL: https://github.com/apache/spark/pull/28493 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to

[GitHub] [spark] MaxGekk opened a new pull request #28639: [SPARK-31820][SQL][TESTS] Fix flaky JavaBeanDeserializationSuite

2020-05-26 Thread GitBox
MaxGekk opened a new pull request #28639: URL: https://github.com/apache/spark/pull/28639 ### What changes were proposed in this pull request? Modified formatting of expected timestamp strings in the test `JavaBeanDeserializationSuite`.`testSpark22000` to correctly format timestamps

[GitHub] [spark] prakharjain09 edited a comment on pull request #28634: [SPARK-31810][TEST] Fix AlterTableRecoverPartitions test using incorrect api to modify RDD_PARALLEL_LISTING_THRESHOLD

2020-05-26 Thread GitBox
prakharjain09 edited a comment on pull request #28634: URL: https://github.com/apache/spark/pull/28634#issuecomment-633481802 cc - @srowen @cloud-fan @Dooyoung-Hwang @holdenk This is an automated message from the Apache Git

[GitHub] [spark] SparkQA removed a comment on pull request #28646: [SPARK-31827][SQL] better error message for the JDK8 bug of stand-alone form

2020-05-26 Thread GitBox
SparkQA removed a comment on pull request #28646: URL: https://github.com/apache/spark/pull/28646#issuecomment-634099573 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] beliefer opened a new pull request #28641: [SPARK-31824][CORE][TESTS] DAGSchedulerSuite: Improve and reuse completeShuffleMapStageSuccessfully

2020-05-26 Thread GitBox
beliefer opened a new pull request #28641: URL: https://github.com/apache/spark/pull/28641 ### What changes were proposed in this pull request? `DAGSchedulerSuite `provides `completeShuffleMapStageSuccessfully `to make `ShuffleMapStage `successfully. But many test case uses complete

[GitHub] [spark] SparkQA commented on pull request #28528: [SPARK-31711][CORE] Register the executor source with the metrics system when running in local mode.

2020-05-26 Thread GitBox
SparkQA commented on pull request #28528: URL: https://github.com/apache/spark/pull/28528#issuecomment-633771897 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and

[GitHub] [spark] SparkQA removed a comment on pull request #28634: [SPARK-31810][TEST] Fix AlterTableRecoverPartitions test using incorrect api to modify RDD_PARALLEL_LISTING_THRESHOLD

2020-05-26 Thread GitBox
SparkQA removed a comment on pull request #28634: URL: https://github.com/apache/spark/pull/28634#issuecomment-633581100 **[Test build #123085 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/123085/testReport)** for PR 28634 at commit

[GitHub] [spark] SparkQA removed a comment on pull request #28607: [SPARK-24634][SS] Add a new metric regarding number of inputs later than watermark plus allowed delay

2020-05-26 Thread GitBox
SparkQA removed a comment on pull request #28607: URL: https://github.com/apache/spark/pull/28607#issuecomment-634306964 **[Test build #123140 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/123140/testReport)** for PR 28607 at commit

[GitHub] [spark] AmplabJenkins commented on pull request #28609: [SPARK-31792][DOCS] Introduce the structured streaming UI in the Web UI doc

2020-05-26 Thread GitBox
AmplabJenkins commented on pull request #28609: URL: https://github.com/apache/spark/pull/28609#issuecomment-633735386 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] dongjoon-hyun commented on pull request #28614: [SPARK-31791][CORE][TEST] Improve cache block migration test reliability

2020-05-26 Thread GitBox
dongjoon-hyun commented on pull request #28614: URL: https://github.com/apache/spark/pull/28614#issuecomment-633791726 +1, late LGTM. This is an automated message from the Apache Git Service. To respond to the message,

[GitHub] [spark] HeartSaVioR commented on pull request #27333: [SPARK-29438][SS][FOLLOWUP] Add regression tests for Streaming Aggregation and flatMapGroupsWithState

2020-05-26 Thread GitBox
HeartSaVioR commented on pull request #27333: URL: https://github.com/apache/spark/pull/27333#issuecomment-634305431 retest this, please This is an automated message from the Apache Git Service. To respond to the message,

  1   2   3   4   >