[GitHub] [spark] cloud-fan commented on a change in pull request #27498: [SPARK-30688][SQL] Week based dates not being parsed with TimestampFormatter

2020-05-19 Thread GitBox
cloud-fan commented on a change in pull request #27498: URL: https://github.com/apache/spark/pull/27498#discussion_r427056244 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/util/DateTimeFormatterHelper.scala ## @@ -99,12 +99,35 @@ private object

[GitHub] [spark] AmplabJenkins commented on pull request #28577: [SPARK-31399][CORE][2.4] Support indylambda Scala closure in ClosureCleaner

2020-05-19 Thread GitBox
AmplabJenkins commented on pull request #28577: URL: https://github.com/apache/spark/pull/28577#issuecomment-630609192 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28576: [SPARK-31755][SQL] allow missing year/hour when parsing date/timestamp string

2020-05-19 Thread GitBox
AmplabJenkins removed a comment on pull request #28576: URL: https://github.com/apache/spark/pull/28576#issuecomment-630608610 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] cloud-fan commented on pull request #28576: [SPARK-31755][SQL] allow missing year/hour when parsing date/timestamp string

2020-05-19 Thread GitBox
cloud-fan commented on pull request #28576: URL: https://github.com/apache/spark/pull/28576#issuecomment-630608989 cc @MaxGekk @xuanyuanking @HyukjinKwon This is an automated message from the Apache Git Service. To respond

[GitHub] [spark] AmplabJenkins commented on pull request #28576: [SPARK-31755][SQL] allow missing year/hour when parsing date/timestamp string

2020-05-19 Thread GitBox
AmplabJenkins commented on pull request #28576: URL: https://github.com/apache/spark/pull/28576#issuecomment-630608610 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] gengliangwang closed pull request #28208: [SPARK-31440][SQL] Improve SQL Rest API

2020-05-19 Thread GitBox
gengliangwang closed pull request #28208: URL: https://github.com/apache/spark/pull/28208 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to

[GitHub] [spark] cloud-fan commented on a change in pull request #28576: [SPARK-31755][SQL] allow missing year/hour when parsing date/timestamp string

2020-05-19 Thread GitBox
cloud-fan commented on a change in pull request #28576: URL: https://github.com/apache/spark/pull/28576#discussion_r427055167 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/util/DateTimeFormatterHelper.scala ## @@ -101,10 +119,6 @@ private object

[GitHub] [spark] gengliangwang commented on pull request #28208: [SPARK-31440][SQL] Improve SQL Rest API

2020-05-19 Thread GitBox
gengliangwang commented on pull request #28208: URL: https://github.com/apache/spark/pull/28208#issuecomment-630608284 Thanks, merging to master/3.0 This is an automated message from the Apache Git Service. To respond to the

[GitHub] [spark] SparkQA commented on pull request #28576: [SPARK-31755][SQL] allow missing year/hour when parsing date/timestamp string

2020-05-19 Thread GitBox
SparkQA commented on pull request #28576: URL: https://github.com/apache/spark/pull/28576#issuecomment-630608038 **[Test build #122832 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/122832/testReport)** for PR 28576 at commit

[GitHub] [spark] SparkQA commented on pull request #28577: [SPARK-31399][CORE][2.4] Support indylambda Scala closure in ClosureCleaner

2020-05-19 Thread GitBox
SparkQA commented on pull request #28577: URL: https://github.com/apache/spark/pull/28577#issuecomment-630608047 **[Test build #122831 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/122831/testReport)** for PR 28577 at commit

[GitHub] [spark] rednaxelafx opened a new pull request #28577: [SPARK-31399][CORE][2.4] Support indylambda Scala closure in ClosureCleaner

2020-05-19 Thread GitBox
rednaxelafx opened a new pull request #28577: URL: https://github.com/apache/spark/pull/28577 This is a backport of https://github.com/apache/spark/pull/28463 from Apache Spark master/3.0 to 2.4. Minor adaptation include: - Retain the Spark 2.4-specific behavior of skipping the

[GitHub] [spark] cloud-fan commented on a change in pull request #28576: [SPARK-31755][SQL] allow missing year/hour when parsing date/timestamp string

2020-05-19 Thread GitBox
cloud-fan commented on a change in pull request #28576: URL: https://github.com/apache/spark/pull/28576#discussion_r427054501 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/util/DateTimeFormatterHelper.scala ## @@ -72,18 +94,14 @@ trait

[GitHub] [spark] cloud-fan opened a new pull request #28576: [SPARK-31755][SQL] allow missing year/hour when parsing date/timestamp string

2020-05-19 Thread GitBox
cloud-fan opened a new pull request #28576: URL: https://github.com/apache/spark/pull/28576 ### What changes were proposed in this pull request? This PR allows missing year/hour fields when parsing date/timestamp string, with 1970 as the default value of year, and 0 as the

[GitHub] [spark] erenavsarogullari commented on a change in pull request #28208: [SPARK-31440][SQL] Improve SQL Rest API

2020-05-19 Thread GitBox
erenavsarogullari commented on a change in pull request #28208: URL: https://github.com/apache/spark/pull/28208#discussion_r427048060 ## File path: sql/core/src/main/scala/org/apache/spark/status/api/v1/sql/SqlResource.scala ## @@ -21,46 +21,55 @@ import java.util.Date

[GitHub] [spark] Ngone51 edited a comment on pull request #28370: [SPARK-20732][CORE] Decommission cache blocks to other executors when an executor is decommissioned

2020-05-19 Thread GitBox
Ngone51 edited a comment on pull request #28370: URL: https://github.com/apache/spark/pull/28370#issuecomment-630602162 It seems there's another guy who wants to take the JIRA. If there's no following updates from the guy before next week, I will take over then.

[GitHub] [spark] Ngone51 commented on pull request #28370: [SPARK-20732][CORE] Decommission cache blocks to other executors when an executor is decommissioned

2020-05-19 Thread GitBox
Ngone51 commented on pull request #28370: URL: https://github.com/apache/spark/pull/28370#issuecomment-630602162 It seems there's another guy wants to take the JIRA. This is an automated message from the Apache Git Service.

[GitHub] [spark] igreenfield commented on a change in pull request #26624: [SPARK-8981][CORE][test-hadoop3.2][test-java11] Add MDC support in Executor

2020-05-19 Thread GitBox
igreenfield commented on a change in pull request #26624: URL: https://github.com/apache/spark/pull/26624#discussion_r427049157 ## File path: docs/configuration.md ## @@ -2955,6 +2955,12 @@ Spark uses [log4j](http://logging.apache.org/log4j/) for logging. You can config

[GitHub] [spark] erenavsarogullari commented on a change in pull request #28208: [SPARK-31440][SQL] Improve SQL Rest API

2020-05-19 Thread GitBox
erenavsarogullari commented on a change in pull request #28208: URL: https://github.com/apache/spark/pull/28208#discussion_r427048060 ## File path: sql/core/src/main/scala/org/apache/spark/status/api/v1/sql/SqlResource.scala ## @@ -21,46 +21,55 @@ import java.util.Date

[GitHub] [spark] igreenfield commented on a change in pull request #26624: [SPARK-8981][CORE][test-hadoop3.2][test-java11] Add MDC support in Executor

2020-05-19 Thread GitBox
igreenfield commented on a change in pull request #26624: URL: https://github.com/apache/spark/pull/26624#discussion_r427048623 ## File path: core/src/main/scala/org/apache/spark/executor/Executor.scala ## @@ -395,6 +401,9 @@ private[spark] class Executor( }

[GitHub] [spark] igreenfield commented on a change in pull request #26624: [SPARK-8981][CORE][test-hadoop3.2][test-java11] Add MDC support in Executor

2020-05-19 Thread GitBox
igreenfield commented on a change in pull request #26624: URL: https://github.com/apache/spark/pull/26624#discussion_r427048438 ## File path: core/src/main/scala/org/apache/spark/executor/Executor.scala ## @@ -320,7 +321,12 @@ private[spark] class Executor( val taskId =

[GitHub] [spark] erenavsarogullari commented on a change in pull request #28208: [SPARK-31440][SQL] Improve SQL Rest API

2020-05-19 Thread GitBox
erenavsarogullari commented on a change in pull request #28208: URL: https://github.com/apache/spark/pull/28208#discussion_r427048060 ## File path: sql/core/src/main/scala/org/apache/spark/status/api/v1/sql/SqlResource.scala ## @@ -21,46 +21,55 @@ import java.util.Date

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28511: [SPARK-31684][SQL] Overwrite partition failed with 'WRONG FS' when the target partition is not belong to the filesystem as same

2020-05-19 Thread GitBox
AmplabJenkins removed a comment on pull request #28511: URL: https://github.com/apache/spark/pull/28511#issuecomment-630599911 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins commented on pull request #28511: [SPARK-31684][SQL] Overwrite partition failed with 'WRONG FS' when the target partition is not belong to the filesystem as same as the

2020-05-19 Thread GitBox
AmplabJenkins commented on pull request #28511: URL: https://github.com/apache/spark/pull/28511#issuecomment-630599911 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] igreenfield commented on a change in pull request #26624: [SPARK-8981][CORE][test-hadoop3.2][test-java11] Add MDC support in Executor

2020-05-19 Thread GitBox
igreenfield commented on a change in pull request #26624: URL: https://github.com/apache/spark/pull/26624#discussion_r427047772 ## File path: core/src/main/scala/org/apache/spark/util/ThreadUtils.scala ## @@ -133,6 +133,14 @@ private[spark] object ThreadUtils {

<    1   2   3   4   5   6