[GitHub] [spark] SparkQA commented on pull request #28650: [SPARK-31830][SQL] Consistent error handling for datetime formatting functions

2020-05-27 Thread GitBox
SparkQA commented on pull request #28650: URL: https://github.com/apache/spark/pull/28650#issuecomment-635130965 **[Test build #123213 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/123213/testReport)** for PR 28650 at commit [`33fedf8`](https://github.co

[GitHub] [spark] SparkQA removed a comment on pull request #28650: [SPARK-31830][SQL] Consistent error handling for datetime formatting functions

2020-05-27 Thread GitBox
SparkQA removed a comment on pull request #28650: URL: https://github.com/apache/spark/pull/28650#issuecomment-635118870 **[Test build #123213 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/123213/testReport)** for PR 28650 at commit [`33fedf8`](https://gi

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28650: [SPARK-31830][SQL] Consistent error handling for datetime formatting functions

2020-05-27 Thread GitBox
AmplabJenkins removed a comment on pull request #28650: URL: https://github.com/apache/spark/pull/28650#issuecomment-635131024 Merged build finished. Test FAILed. This is an automated message from the Apache Git Service. To r

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28650: [SPARK-31830][SQL] Consistent error handling for datetime formatting functions

2020-05-27 Thread GitBox
AmplabJenkins removed a comment on pull request #28650: URL: https://github.com/apache/spark/pull/28650#issuecomment-635131031 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/123

[GitHub] [spark] wangyum commented on pull request #28654: [SPARK-31834][SQL]Improve error message for incompatible data types

2020-05-27 Thread GitBox
wangyum commented on pull request #28654: URL: https://github.com/apache/spark/pull/28654#issuecomment-635132831 ok to test. This is an automated message from the Apache Git Service. To respond to the message, please log on t

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28654: [SPARK-31834][SQL]Improve error message for incompatible data types

2020-05-27 Thread GitBox
AmplabJenkins removed a comment on pull request #28654: URL: https://github.com/apache/spark/pull/28654#issuecomment-634606656 Can one of the admins verify this patch? This is an automated message from the Apache Git Service.

[GitHub] [spark] SparkQA commented on pull request #28654: [SPARK-31834][SQL]Improve error message for incompatible data types

2020-05-27 Thread GitBox
SparkQA commented on pull request #28654: URL: https://github.com/apache/spark/pull/28654#issuecomment-635133687 **[Test build #123216 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/123216/testReport)** for PR 28654 at commit [`46665cd`](https://github.com

[GitHub] [spark] AmplabJenkins commented on pull request #28654: [SPARK-31834][SQL]Improve error message for incompatible data types

2020-05-27 Thread GitBox
AmplabJenkins commented on pull request #28654: URL: https://github.com/apache/spark/pull/28654#issuecomment-635134194 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28654: [SPARK-31834][SQL]Improve error message for incompatible data types

2020-05-27 Thread GitBox
AmplabJenkins removed a comment on pull request #28654: URL: https://github.com/apache/spark/pull/28654#issuecomment-635134194 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] HyukjinKwon commented on pull request #28652: [SPARK-31763][PYSPARK] Add `inputFiles` method in PySpark DataFrame Class.

2020-05-27 Thread GitBox
HyukjinKwon commented on pull request #28652: URL: https://github.com/apache/spark/pull/28652#issuecomment-635134438 Technically this is a new API and we shouldn't backport it. This is an automated message from the Apache Git

[GitHub] [spark] viirya commented on a change in pull request #28661: [SPARK-31849][PYTHON][SQL] Make PySpark exceptions more Pythonic

2020-05-27 Thread GitBox
viirya commented on a change in pull request #28661: URL: https://github.com/apache/spark/pull/28661#discussion_r431603460 ## File path: python/pyspark/sql/utils.py ## @@ -75,21 +96,29 @@ class UnknownException(CapturedException): def convert_exception(e): s = e.toStrin

[GitHub] [spark] HyukjinKwon commented on a change in pull request #28661: [SPARK-31849][PYTHON][SQL] Make PySpark exceptions more Pythonic

2020-05-27 Thread GitBox
HyukjinKwon commented on a change in pull request #28661: URL: https://github.com/apache/spark/pull/28661#discussion_r431610928 ## File path: python/pyspark/sql/utils.py ## @@ -75,21 +96,29 @@ class UnknownException(CapturedException): def convert_exception(e): s = e.to

[GitHub] [spark] HyukjinKwon commented on a change in pull request #28661: [SPARK-31849][PYTHON][SQL] Make PySpark exceptions more Pythonic

2020-05-27 Thread GitBox
HyukjinKwon commented on a change in pull request #28661: URL: https://github.com/apache/spark/pull/28661#discussion_r431611653 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/internal/SQLConf.scala ## @@ -1784,6 +1784,15 @@ object SQLConf { .version("3.0

[GitHub] [spark] yaooqinn commented on a change in pull request #28650: [SPARK-31830][SQL] Consistent error handling for datetime formatting functions

2020-05-27 Thread GitBox
yaooqinn commented on a change in pull request #28650: URL: https://github.com/apache/spark/pull/28650#discussion_r431612532 ## File path: sql/catalyst/src/test/scala/org/apache/spark/sql/catalyst/expressions/DateExpressionsSuite.scala ## @@ -792,7 +791,7 @@ class DateExpressi

[GitHub] [spark] SparkQA commented on pull request #28650: [SPARK-31830][SQL] Consistent error handling for datetime formatting functions

2020-05-27 Thread GitBox
SparkQA commented on pull request #28650: URL: https://github.com/apache/spark/pull/28650#issuecomment-635139886 **[Test build #123217 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/123217/testReport)** for PR 28650 at commit [`82bb963`](https://github.com

[GitHub] [spark] yaooqinn commented on a change in pull request #28650: [SPARK-31830][SQL] Consistent error handling for datetime formatting functions

2020-05-27 Thread GitBox
yaooqinn commented on a change in pull request #28650: URL: https://github.com/apache/spark/pull/28650#discussion_r431613657 ## File path: sql/catalyst/src/test/scala/org/apache/spark/sql/catalyst/expressions/DateExpressionsSuite.scala ## @@ -777,8 +778,6 @@ class DateExpressi

[GitHub] [spark] yaooqinn commented on a change in pull request #28650: [SPARK-31830][SQL] Consistent error handling for datetime formatting functions

2020-05-27 Thread GitBox
yaooqinn commented on a change in pull request #28650: URL: https://github.com/apache/spark/pull/28650#discussion_r431613811 ## File path: sql/catalyst/src/test/scala/org/apache/spark/sql/catalyst/expressions/DateExpressionsSuite.scala ## @@ -920,10 +917,6 @@ class DateExpress

[GitHub] [spark] yaooqinn commented on a change in pull request #28650: [SPARK-31830][SQL] Consistent error handling for datetime formatting functions

2020-05-27 Thread GitBox
yaooqinn commented on a change in pull request #28650: URL: https://github.com/apache/spark/pull/28650#discussion_r431613731 ## File path: sql/catalyst/src/test/scala/org/apache/spark/sql/catalyst/expressions/DateExpressionsSuite.scala ## @@ -854,15 +853,13 @@ class DateExpres

[GitHub] [spark] AmplabJenkins commented on pull request #28650: [SPARK-31830][SQL] Consistent error handling for datetime formatting functions

2020-05-27 Thread GitBox
AmplabJenkins commented on pull request #28650: URL: https://github.com/apache/spark/pull/28650#issuecomment-635140395 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28650: [SPARK-31830][SQL] Consistent error handling for datetime formatting functions

2020-05-27 Thread GitBox
AmplabJenkins removed a comment on pull request #28650: URL: https://github.com/apache/spark/pull/28650#issuecomment-635140395 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] HyukjinKwon commented on a change in pull request #28661: [SPARK-31849][PYTHON][SQL] Make PySpark exceptions more Pythonic

2020-05-27 Thread GitBox
HyukjinKwon commented on a change in pull request #28661: URL: https://github.com/apache/spark/pull/28661#discussion_r431614778 ## File path: python/pyspark/sql/utils.py ## @@ -18,8 +18,19 @@ import py4j import sys +from pyspark import SparkContext + if sys.version_info.ma

[GitHub] [spark] HyukjinKwon commented on a change in pull request #28661: [SPARK-31849][PYTHON][SQL] Make PySpark exceptions more Pythonic

2020-05-27 Thread GitBox
HyukjinKwon commented on a change in pull request #28661: URL: https://github.com/apache/spark/pull/28661#discussion_r431614778 ## File path: python/pyspark/sql/utils.py ## @@ -18,8 +18,19 @@ import py4j import sys +from pyspark import SparkContext + if sys.version_info.ma

[GitHub] [spark] yaooqinn commented on a change in pull request #28650: [SPARK-31830][SQL] Consistent error handling for datetime formatting functions

2020-05-27 Thread GitBox
yaooqinn commented on a change in pull request #28650: URL: https://github.com/apache/spark/pull/28650#discussion_r431615518 ## File path: sql/core/src/test/resources/sql-tests/inputs/datetime.sql ## @@ -160,3 +156,83 @@ select from_json('{"time":"26/October/2015"}', 'time Tim

[GitHub] [spark] karuppayya closed pull request #28662: [SPARK-31850] Prevent DetermineTableStats from computing stats multiple times for same table

2020-05-27 Thread GitBox
karuppayya closed pull request #28662: URL: https://github.com/apache/spark/pull/28662 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go

[GitHub] [spark] HyukjinKwon commented on a change in pull request #28661: [SPARK-31849][PYTHON][SQL] Make PySpark exceptions more Pythonic

2020-05-27 Thread GitBox
HyukjinKwon commented on a change in pull request #28661: URL: https://github.com/apache/spark/pull/28661#discussion_r431614778 ## File path: python/pyspark/sql/utils.py ## @@ -18,8 +18,19 @@ import py4j import sys +from pyspark import SparkContext + if sys.version_info.ma

[GitHub] [spark] wangyum commented on pull request #28626: [SPARK-28481][SQL] More expressions should extend NullIntolerant

2020-05-27 Thread GitBox
wangyum commented on pull request #28626: URL: https://github.com/apache/spark/pull/28626#issuecomment-635143257 @gatorsmile @cloud-fan This is an automated message from the Apache Git Service. To respond to the message, ple

[GitHub] [spark] yaooqinn commented on a change in pull request #28650: [SPARK-31830][SQL] Consistent error handling for datetime formatting functions

2020-05-27 Thread GitBox
yaooqinn commented on a change in pull request #28650: URL: https://github.com/apache/spark/pull/28650#discussion_r431617628 ## File path: sql/core/src/test/resources/sql-tests/inputs/datetime.sql ## @@ -160,3 +156,83 @@ select from_json('{"time":"26/October/2015"}', 'time Tim

[GitHub] [spark] viirya commented on a change in pull request #28661: [SPARK-31849][PYTHON][SQL] Make PySpark exceptions more Pythonic

2020-05-27 Thread GitBox
viirya commented on a change in pull request #28661: URL: https://github.com/apache/spark/pull/28661#discussion_r431620818 ## File path: python/pyspark/sql/utils.py ## @@ -75,21 +96,29 @@ class UnknownException(CapturedException): def convert_exception(e): s = e.toStrin

[GitHub] [spark] cloud-fan commented on a change in pull request #28646: [SPARK-31827][SQL] better error message for the JDK8 bug of stand-alone form

2020-05-27 Thread GitBox
cloud-fan commented on a change in pull request #28646: URL: https://github.com/apache/spark/pull/28646#discussion_r430898129 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/util/DateTimeFormatterHelper.scala ## @@ -244,6 +250,12 @@ private object DateT

[GitHub] [spark] cloud-fan commented on a change in pull request #28646: [SPARK-31827][SQL] better error message for the JDK8 bug of stand-alone form

2020-05-27 Thread GitBox
cloud-fan commented on a change in pull request #28646: URL: https://github.com/apache/spark/pull/28646#discussion_r430898558 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/util/DateTimeFormatterHelper.scala ## @@ -244,6 +250,12 @@ private object DateT

[GitHub] [spark] viirya commented on a change in pull request #28629: [SPARK-31769] Add MDC support for driver threads

2020-05-27 Thread GitBox
viirya commented on a change in pull request #28629: URL: https://github.com/apache/spark/pull/28629#discussion_r430898595 ## File path: core/src/main/scala/org/apache/spark/util/ThreadUtils.scala ## @@ -130,7 +225,15 @@ private[spark] object ThreadUtils { */ def newDaem

[GitHub] [spark] cloud-fan commented on a change in pull request #28646: [SPARK-31827][SQL] better error message for the JDK8 bug of stand-alone form

2020-05-27 Thread GitBox
cloud-fan commented on a change in pull request #28646: URL: https://github.com/apache/spark/pull/28646#discussion_r430898558 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/util/DateTimeFormatterHelper.scala ## @@ -244,6 +250,12 @@ private object DateT

[GitHub] [spark] SparkQA commented on pull request #28422: [SPARK-17604][SS] FileStreamSource: provide a new option to have retention on input files

2020-05-27 Thread GitBox
SparkQA commented on pull request #28422: URL: https://github.com/apache/spark/pull/28422#issuecomment-634470901 **[Test build #123161 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/123161/testReport)** for PR 28422 at commit [`2af1df1`](https://github.co

[GitHub] [spark] SparkQA commented on pull request #27333: [SPARK-29438][SS][FOLLOWUP] Add regression tests for Streaming Aggregation and flatMapGroupsWithState

2020-05-27 Thread GitBox
SparkQA commented on pull request #27333: URL: https://github.com/apache/spark/pull/27333#issuecomment-634470896 **[Test build #123163 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/123163/testReport)** for PR 27333 at commit [`466363e`](https://github.co

[GitHub] [spark] SparkQA commented on pull request #28650: [SPARK-31830][SQL] Consistent error handling for datetime formatting functions

2020-05-27 Thread GitBox
SparkQA commented on pull request #28650: URL: https://github.com/apache/spark/pull/28650#issuecomment-634470894 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and

[GitHub] [spark] SparkQA commented on pull request #24173: [SPARK-27237][SS] Introduce State schema validation among query restart

2020-05-27 Thread GitBox
SparkQA commented on pull request #24173: URL: https://github.com/apache/spark/pull/24173#issuecomment-634470900 **[Test build #123164 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/123164/testReport)** for PR 24173 at commit [`1fcfff5`](https://github.co

[GitHub] [spark] SparkQA commented on pull request #27620: [SPARK-30866][SS] FileStreamSource: Cache fetched list of files beyond maxFilesPerTrigger as unread files

2020-05-27 Thread GitBox
SparkQA commented on pull request #27620: URL: https://github.com/apache/spark/pull/27620#issuecomment-634470899 **[Test build #123162 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/123162/testReport)** for PR 27620 at commit [`8251b74`](https://github.co

[GitHub] [spark] AmplabJenkins commented on pull request #28650: [SPARK-31830][SQL] Consistent error handling for datetime formatting functions

2020-05-27 Thread GitBox
AmplabJenkins commented on pull request #28650: URL: https://github.com/apache/spark/pull/28650#issuecomment-634471085 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [spark] AmplabJenkins commented on pull request #28650: [SPARK-31830][SQL] Consistent error handling for datetime formatting functions

2020-05-27 Thread GitBox
AmplabJenkins commented on pull request #28650: URL: https://github.com/apache/spark/pull/28650#issuecomment-634471191 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [spark] AmplabJenkins commented on pull request #28422: [SPARK-17604][SS] FileStreamSource: provide a new option to have retention on input files

2020-05-27 Thread GitBox
AmplabJenkins commented on pull request #28422: URL: https://github.com/apache/spark/pull/28422#issuecomment-634471108 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [spark] AmplabJenkins commented on pull request #27333: [SPARK-29438][SS][FOLLOWUP] Add regression tests for Streaming Aggregation and flatMapGroupsWithState

2020-05-27 Thread GitBox
AmplabJenkins commented on pull request #27333: URL: https://github.com/apache/spark/pull/27333#issuecomment-634471090 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [spark] AmplabJenkins commented on pull request #24173: [SPARK-27237][SS] Introduce State schema validation among query restart

2020-05-27 Thread GitBox
AmplabJenkins commented on pull request #24173: URL: https://github.com/apache/spark/pull/24173#issuecomment-634471166 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [spark] AmplabJenkins commented on pull request #27620: [SPARK-30866][SS] FileStreamSource: Cache fetched list of files beyond maxFilesPerTrigger as unread files

2020-05-27 Thread GitBox
AmplabJenkins commented on pull request #27620: URL: https://github.com/apache/spark/pull/27620#issuecomment-634471105 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28650: [SPARK-31830][SQL] Consistent error handling for datetime formatting functions

2020-05-27 Thread GitBox
AmplabJenkins removed a comment on pull request #28650: URL: https://github.com/apache/spark/pull/28650#issuecomment-634471085 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins removed a comment on pull request #27620: [SPARK-30866][SS] FileStreamSource: Cache fetched list of files beyond maxFilesPerTrigger as unread files

2020-05-27 Thread GitBox
AmplabJenkins removed a comment on pull request #27620: URL: https://github.com/apache/spark/pull/27620#issuecomment-634471105 Merged build finished. Test FAILed. This is an automated message from the Apache Git Service. To r

[GitHub] [spark] SparkQA removed a comment on pull request #28650: [SPARK-31830][SQL] Consistent error handling for datetime formatting functions

2020-05-27 Thread GitBox
SparkQA removed a comment on pull request #28650: URL: https://github.com/apache/spark/pull/28650#issuecomment-634413806 This is an automated message from the Apache Git Service. To respond to the message, please log on to Git

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28422: [SPARK-17604][SS] FileStreamSource: provide a new option to have retention on input files

2020-05-27 Thread GitBox
AmplabJenkins removed a comment on pull request #28422: URL: https://github.com/apache/spark/pull/28422#issuecomment-634471108 Merged build finished. Test FAILed. This is an automated message from the Apache Git Service. To r

[GitHub] [spark] SparkQA removed a comment on pull request #27333: [SPARK-29438][SS][FOLLOWUP] Add regression tests for Streaming Aggregation and flatMapGroupsWithState

2020-05-27 Thread GitBox
SparkQA removed a comment on pull request #27333: URL: https://github.com/apache/spark/pull/27333#issuecomment-634421671 **[Test build #123163 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/123163/testReport)** for PR 27333 at commit [`466363e`](https://gi

[GitHub] [spark] SparkQA removed a comment on pull request #27620: [SPARK-30866][SS] FileStreamSource: Cache fetched list of files beyond maxFilesPerTrigger as unread files

2020-05-27 Thread GitBox
SparkQA removed a comment on pull request #27620: URL: https://github.com/apache/spark/pull/27620#issuecomment-634421710 **[Test build #123162 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/123162/testReport)** for PR 27620 at commit [`8251b74`](https://gi

[GitHub] [spark] AmplabJenkins removed a comment on pull request #24173: [SPARK-27237][SS] Introduce State schema validation among query restart

2020-05-27 Thread GitBox
AmplabJenkins removed a comment on pull request #24173: URL: https://github.com/apache/spark/pull/24173#issuecomment-634471166 Merged build finished. Test FAILed. This is an automated message from the Apache Git Service. To r

[GitHub] [spark] AmplabJenkins removed a comment on pull request #27333: [SPARK-29438][SS][FOLLOWUP] Add regression tests for Streaming Aggregation and flatMapGroupsWithState

2020-05-27 Thread GitBox
AmplabJenkins removed a comment on pull request #27333: URL: https://github.com/apache/spark/pull/27333#issuecomment-634471090 Merged build finished. Test FAILed. This is an automated message from the Apache Git Service. To r

[GitHub] [spark] SparkQA removed a comment on pull request #28422: [SPARK-17604][SS] FileStreamSource: provide a new option to have retention on input files

2020-05-27 Thread GitBox
SparkQA removed a comment on pull request #28422: URL: https://github.com/apache/spark/pull/28422#issuecomment-634421709 **[Test build #123161 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/123161/testReport)** for PR 28422 at commit [`2af1df1`](https://gi

[GitHub] [spark] SparkQA removed a comment on pull request #24173: [SPARK-27237][SS] Introduce State schema validation among query restart

2020-05-27 Thread GitBox
SparkQA removed a comment on pull request #24173: URL: https://github.com/apache/spark/pull/24173#issuecomment-634421696 **[Test build #123164 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/123164/testReport)** for PR 24173 at commit [`1fcfff5`](https://gi

[GitHub] [spark] AmplabJenkins removed a comment on pull request #27333: [SPARK-29438][SS][FOLLOWUP] Add regression tests for Streaming Aggregation and flatMapGroupsWithState

2020-05-27 Thread GitBox
AmplabJenkins removed a comment on pull request #27333: URL: https://github.com/apache/spark/pull/27333#issuecomment-634471099 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/123

[GitHub] [spark] AmplabJenkins removed a comment on pull request #24173: [SPARK-27237][SS] Introduce State schema validation among query restart

2020-05-27 Thread GitBox
AmplabJenkins removed a comment on pull request #24173: URL: https://github.com/apache/spark/pull/24173#issuecomment-634471174 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/123

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28422: [SPARK-17604][SS] FileStreamSource: provide a new option to have retention on input files

2020-05-27 Thread GitBox
AmplabJenkins removed a comment on pull request #28422: URL: https://github.com/apache/spark/pull/28422#issuecomment-634471117 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/123

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28650: [SPARK-31830][SQL] Consistent error handling for datetime formatting functions

2020-05-27 Thread GitBox
AmplabJenkins removed a comment on pull request #28650: URL: https://github.com/apache/spark/pull/28650#issuecomment-634471197 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/123

[GitHub] [spark] AmplabJenkins removed a comment on pull request #27620: [SPARK-30866][SS] FileStreamSource: Cache fetched list of files beyond maxFilesPerTrigger as unread files

2020-05-27 Thread GitBox
AmplabJenkins removed a comment on pull request #27620: URL: https://github.com/apache/spark/pull/27620#issuecomment-634471113 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/123

[GitHub] [spark] igreenfield commented on a change in pull request #28629: [SPARK-31769] Add MDC support for driver threads

2020-05-27 Thread GitBox
igreenfield commented on a change in pull request #28629: URL: https://github.com/apache/spark/pull/28629#discussion_r430900652 ## File path: core/src/main/scala/org/apache/spark/util/ThreadUtils.scala ## @@ -130,7 +225,15 @@ private[spark] object ThreadUtils { */ def ne

[GitHub] [spark] igreenfield commented on a change in pull request #28629: [SPARK-31769] Add MDC support for driver threads

2020-05-27 Thread GitBox
igreenfield commented on a change in pull request #28629: URL: https://github.com/apache/spark/pull/28629#discussion_r430901217 ## File path: core/src/main/scala/org/apache/spark/util/ThreadUtils.scala ## @@ -130,7 +225,15 @@ private[spark] object ThreadUtils { */ def ne

[GitHub] [spark] AmplabJenkins commented on pull request #28593: [SPARK-31710][SQL] Fail casting numeric to timestamp by default

2020-05-27 Thread GitBox
AmplabJenkins commented on pull request #28593: URL: https://github.com/apache/spark/pull/28593#issuecomment-634472635 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28593: [SPARK-31710][SQL] Fail casting numeric to timestamp by default

2020-05-27 Thread GitBox
AmplabJenkins removed a comment on pull request #28593: URL: https://github.com/apache/spark/pull/28593#issuecomment-634472635 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] yaooqinn opened a new pull request #28651: [SPARK-31833][SQL] Set HiveThriftServer2 with actual port while configured 0

2020-05-27 Thread GitBox
yaooqinn opened a new pull request #28651: URL: https://github.com/apache/spark/pull/28651 ### What changes were proposed in this pull request? When I was developing some stuff based on the `DeveloperAPI ` `org.apache.spark.sql.hive.thriftserver.HiveThriftServer2#startWithContext

[GitHub] [spark] yaooqinn commented on pull request #28650: [SPARK-31830][SQL] Consistent error handling for datetime formatting functions

2020-05-27 Thread GitBox
yaooqinn commented on pull request #28650: URL: https://github.com/apache/spark/pull/28650#issuecomment-634474527 retest this please This is an automated message from the Apache Git Service. To respond to the message,

[GitHub] [spark] viirya commented on pull request #28556: [SPARK-31736][SQL] Nested column aliasing for RepartitionByExpression/Join

2020-05-27 Thread GitBox
viirya commented on pull request #28556: URL: https://github.com/apache/spark/pull/28556#issuecomment-634475545 retest this please This is an automated message from the Apache Git Service. To respond to the message, please lo

[GitHub] [spark] viirya commented on pull request #28560: [SPARK-27217][SQL] Nested column aliasing for more operators which can prune nested column

2020-05-27 Thread GitBox
viirya commented on pull request #28560: URL: https://github.com/apache/spark/pull/28560#issuecomment-634475657 retest this please This is an automated message from the Apache Git Service. To respond to the message, please lo

[GitHub] [spark] SparkQA commented on pull request #28651: [SPARK-31833][SQL] Set HiveThriftServer2 with actual port while configured 0

2020-05-27 Thread GitBox
SparkQA commented on pull request #28651: URL: https://github.com/apache/spark/pull/28651#issuecomment-634475792 **[Test build #123166 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/123166/testReport)** for PR 28651 at commit [`ea1f9dc`](https://github.com

[GitHub] [spark] SparkQA commented on pull request #28593: [SPARK-31710][SQL] Fail casting numeric to timestamp by default

2020-05-27 Thread GitBox
SparkQA commented on pull request #28593: URL: https://github.com/apache/spark/pull/28593#issuecomment-634475806 **[Test build #123167 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/123167/testReport)** for PR 28593 at commit [`bae99b1`](https://github.com

[GitHub] [spark] SparkQA commented on pull request #28556: [SPARK-31736][SQL] Nested column aliasing for RepartitionByExpression/Join

2020-05-27 Thread GitBox
SparkQA commented on pull request #28556: URL: https://github.com/apache/spark/pull/28556#issuecomment-634475825 **[Test build #123168 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/123168/testReport)** for PR 28556 at commit [`f720bdf`](https://github.com

[GitHub] [spark] AmplabJenkins commented on pull request #28560: [SPARK-27217][SQL] Nested column aliasing for more operators which can prune nested column

2020-05-27 Thread GitBox
AmplabJenkins commented on pull request #28560: URL: https://github.com/apache/spark/pull/28560#issuecomment-634476332 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28556: [SPARK-31736][SQL] Nested column aliasing for RepartitionByExpression/Join

2020-05-27 Thread GitBox
AmplabJenkins removed a comment on pull request #28556: URL: https://github.com/apache/spark/pull/28556#issuecomment-634476491 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins commented on pull request #28651: [SPARK-31833][SQL] Set HiveThriftServer2 with actual port while configured 0

2020-05-27 Thread GitBox
AmplabJenkins commented on pull request #28651: URL: https://github.com/apache/spark/pull/28651#issuecomment-634476480 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [spark] AmplabJenkins commented on pull request #28556: [SPARK-31736][SQL] Nested column aliasing for RepartitionByExpression/Join

2020-05-27 Thread GitBox
AmplabJenkins commented on pull request #28556: URL: https://github.com/apache/spark/pull/28556#issuecomment-634476491 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28651: [SPARK-31833][SQL] Set HiveThriftServer2 with actual port while configured 0

2020-05-27 Thread GitBox
AmplabJenkins removed a comment on pull request #28651: URL: https://github.com/apache/spark/pull/28651#issuecomment-634476480 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28560: [SPARK-27217][SQL] Nested column aliasing for more operators which can prune nested column

2020-05-27 Thread GitBox
AmplabJenkins removed a comment on pull request #28560: URL: https://github.com/apache/spark/pull/28560#issuecomment-634476332 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] kiszk commented on a change in pull request #28646: [SPARK-31827][SQL] better error message for the JDK8 bug of stand-alone form

2020-05-27 Thread GitBox
kiszk commented on a change in pull request #28646: URL: https://github.com/apache/spark/pull/28646#discussion_r430906934 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/util/DateTimeFormatterHelper.scala ## @@ -244,6 +250,12 @@ private object DateTimeF

[GitHub] [spark] yaooqinn commented on pull request #28651: [SPARK-31833][SQL] Set HiveThriftServer2 with actual port while configured 0

2020-05-27 Thread GitBox
yaooqinn commented on pull request #28651: URL: https://github.com/apache/spark/pull/28651#issuecomment-634477757 cc @cloud-fan @maropu @wangyum @dongjoon-hyun thanks very much. This is an automated message from the Apache Gi

[GitHub] [spark] SparkQA commented on pull request #28646: [SPARK-31827][SQL] better error message for the JDK8 bug of stand-alone form

2020-05-27 Thread GitBox
SparkQA commented on pull request #28646: URL: https://github.com/apache/spark/pull/28646#issuecomment-634479686 **[Test build #123169 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/123169/testReport)** for PR 28646 at commit [`fcb3e43`](https://github.com

[GitHub] [spark] SparkQA commented on pull request #28560: [SPARK-27217][SQL] Nested column aliasing for more operators which can prune nested column

2020-05-27 Thread GitBox
SparkQA commented on pull request #28560: URL: https://github.com/apache/spark/pull/28560#issuecomment-634479684 **[Test build #123170 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/123170/testReport)** for PR 28560 at commit [`b2e56d5`](https://github.com

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28646: [SPARK-31827][SQL] better error message for the JDK8 bug of stand-alone form

2020-05-27 Thread GitBox
AmplabJenkins removed a comment on pull request #28646: URL: https://github.com/apache/spark/pull/28646#issuecomment-634480552 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins commented on pull request #28646: [SPARK-31827][SQL] better error message for the JDK8 bug of stand-alone form

2020-05-27 Thread GitBox
AmplabJenkins commented on pull request #28646: URL: https://github.com/apache/spark/pull/28646#issuecomment-634480552 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [spark] yaooqinn commented on a change in pull request #28646: [SPARK-31827][SQL] better error message for the JDK8 bug of stand-alone form

2020-05-27 Thread GitBox
yaooqinn commented on a change in pull request #28646: URL: https://github.com/apache/spark/pull/28646#discussion_r430912333 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/util/DateTimeFormatterHelper.scala ## @@ -217,9 +217,18 @@ private object DateTi

[GitHub] [spark] kiszk commented on a change in pull request #28646: [SPARK-31827][SQL] better error message for the JDK8 bug of stand-alone form

2020-05-27 Thread GitBox
kiszk commented on a change in pull request #28646: URL: https://github.com/apache/spark/pull/28646#discussion_r430915019 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/util/DateTimeFormatterHelper.scala ## @@ -244,6 +250,12 @@ private object DateTimeF

[GitHub] [spark] gaborgsomogyi commented on pull request #28640: [SPARK-31821][BUILD] Remove mssql-jdbc dependencies from Hadoop 3.2 profile

2020-05-27 Thread GitBox
gaborgsomogyi commented on pull request #28640: URL: https://github.com/apache/spark/pull/28640#issuecomment-634489681 Just wanted to continue but already finished, thanks for the help @dongjoon-hyun ! This is an automated m

[GitHub] [spark] HeartSaVioR commented on pull request #24173: [SPARK-27237][SS] Introduce State schema validation among query restart

2020-05-27 Thread GitBox
HeartSaVioR commented on pull request #24173: URL: https://github.com/apache/spark/pull/24173#issuecomment-634491577 retest this, please This is an automated message from the Apache Git Service. To respond to the message, ple

[GitHub] [spark] HeartSaVioR commented on pull request #28422: [SPARK-17604][SS] FileStreamSource: provide a new option to have retention on input files

2020-05-27 Thread GitBox
HeartSaVioR commented on pull request #28422: URL: https://github.com/apache/spark/pull/28422#issuecomment-634491641 retest this, please This is an automated message from the Apache Git Service. To respond to the message, ple

[GitHub] [spark] HeartSaVioR commented on pull request #27333: [SPARK-29438][SS][FOLLOWUP] Add regression tests for Streaming Aggregation and flatMapGroupsWithState

2020-05-27 Thread GitBox
HeartSaVioR commented on pull request #27333: URL: https://github.com/apache/spark/pull/27333#issuecomment-634491784 retest this, please This is an automated message from the Apache Git Service. To respond to the message, ple

[GitHub] [spark] AmplabJenkins commented on pull request #27333: [SPARK-29438][SS][FOLLOWUP] Add regression tests for Streaming Aggregation and flatMapGroupsWithState

2020-05-27 Thread GitBox
AmplabJenkins commented on pull request #27333: URL: https://github.com/apache/spark/pull/27333#issuecomment-634492056 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [spark] SparkQA commented on pull request #28651: [SPARK-31833][SQL] Set HiveThriftServer2 with actual port while configured 0

2020-05-27 Thread GitBox
SparkQA commented on pull request #28651: URL: https://github.com/apache/spark/pull/28651#issuecomment-634492046 **[Test build #123166 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/123166/testReport)** for PR 28651 at commit [`ea1f9dc`](https://github.co

[GitHub] [spark] AmplabJenkins commented on pull request #24173: [SPARK-27237][SS] Introduce State schema validation among query restart

2020-05-27 Thread GitBox
AmplabJenkins commented on pull request #24173: URL: https://github.com/apache/spark/pull/24173#issuecomment-634492077 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [spark] AmplabJenkins removed a comment on pull request #24173: [SPARK-27237][SS] Introduce State schema validation among query restart

2020-05-27 Thread GitBox
AmplabJenkins removed a comment on pull request #24173: URL: https://github.com/apache/spark/pull/24173#issuecomment-634492077 Merged build finished. Test FAILed. This is an automated message from the Apache Git Service. To r

[GitHub] [spark] HeartSaVioR commented on pull request #27620: [SPARK-30866][SS] FileStreamSource: Cache fetched list of files beyond maxFilesPerTrigger as unread files

2020-05-27 Thread GitBox
HeartSaVioR commented on pull request #27620: URL: https://github.com/apache/spark/pull/27620#issuecomment-634491716 retest this, please This is an automated message from the Apache Git Service. To respond to the message, ple

[GitHub] [spark] AmplabJenkins removed a comment on pull request #27333: [SPARK-29438][SS][FOLLOWUP] Add regression tests for Streaming Aggregation and flatMapGroupsWithState

2020-05-27 Thread GitBox
AmplabJenkins removed a comment on pull request #27333: URL: https://github.com/apache/spark/pull/27333#issuecomment-634492056 Merged build finished. Test FAILed. This is an automated message from the Apache Git Service. To r

[GitHub] [spark] AmplabJenkins commented on pull request #28651: [SPARK-31833][SQL] Set HiveThriftServer2 with actual port while configured 0

2020-05-27 Thread GitBox
AmplabJenkins commented on pull request #28651: URL: https://github.com/apache/spark/pull/28651#issuecomment-634492272 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [spark] AmplabJenkins commented on pull request #28422: [SPARK-17604][SS] FileStreamSource: provide a new option to have retention on input files

2020-05-27 Thread GitBox
AmplabJenkins commented on pull request #28422: URL: https://github.com/apache/spark/pull/28422#issuecomment-634492294 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [spark] AmplabJenkins commented on pull request #27620: [SPARK-30866][SS] FileStreamSource: Cache fetched list of files beyond maxFilesPerTrigger as unread files

2020-05-27 Thread GitBox
AmplabJenkins commented on pull request #27620: URL: https://github.com/apache/spark/pull/27620#issuecomment-634492249 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28422: [SPARK-17604][SS] FileStreamSource: provide a new option to have retention on input files

2020-05-27 Thread GitBox
AmplabJenkins removed a comment on pull request #28422: URL: https://github.com/apache/spark/pull/28422#issuecomment-634492294 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins removed a comment on pull request #27620: [SPARK-30866][SS] FileStreamSource: Cache fetched list of files beyond maxFilesPerTrigger as unread files

2020-05-27 Thread GitBox
AmplabJenkins removed a comment on pull request #27620: URL: https://github.com/apache/spark/pull/27620#issuecomment-634492249 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] SparkQA removed a comment on pull request #28651: [SPARK-31833][SQL] Set HiveThriftServer2 with actual port while configured 0

2020-05-27 Thread GitBox
SparkQA removed a comment on pull request #28651: URL: https://github.com/apache/spark/pull/28651#issuecomment-634475792 **[Test build #123166 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/123166/testReport)** for PR 28651 at commit [`ea1f9dc`](https://gi

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28651: [SPARK-31833][SQL] Set HiveThriftServer2 with actual port while configured 0

2020-05-27 Thread GitBox
AmplabJenkins removed a comment on pull request #28651: URL: https://github.com/apache/spark/pull/28651#issuecomment-634492272 This is an automated message from the Apache Git Service. To respond to the message, please log on

  1   2   3   4   5   6   >