[GitHub] [spark] AmplabJenkins removed a comment on pull request #28967: [SPARK-32149][SHUFFLE] Improve file path name normalisation at block resolution within the external shuffle service

2020-07-11 Thread GitBox
AmplabJenkins removed a comment on pull request #28967: URL: https://github.com/apache/spark/pull/28967#issuecomment-657057568 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins commented on pull request #28967: [SPARK-32149][SHUFFLE] Improve file path name normalisation at block resolution within the external shuffle service

2020-07-11 Thread GitBox
AmplabJenkins commented on pull request #28967: URL: https://github.com/apache/spark/pull/28967#issuecomment-657057568 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] SparkQA removed a comment on pull request #28967: [SPARK-32149][SHUFFLE] Improve file path name normalisation at block resolution within the external shuffle service

2020-07-11 Thread GitBox
SparkQA removed a comment on pull request #28967: URL: https://github.com/apache/spark/pull/28967#issuecomment-657022401 **[Test build #125679 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125679/testReport)** for PR 28967 at commit

[GitHub] [spark] SparkQA commented on pull request #28967: [SPARK-32149][SHUFFLE] Improve file path name normalisation at block resolution within the external shuffle service

2020-07-11 Thread GitBox
SparkQA commented on pull request #28967: URL: https://github.com/apache/spark/pull/28967#issuecomment-657057282 **[Test build #125679 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125679/testReport)** for PR 28967 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28676: [SPARK-31869][SQL] BroadcastHashJoinExec can utilize the build side for its output partitioning

2020-07-11 Thread GitBox
AmplabJenkins removed a comment on pull request #28676: URL: https://github.com/apache/spark/pull/28676#issuecomment-657053580 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins commented on pull request #28676: [SPARK-31869][SQL] BroadcastHashJoinExec can utilize the build side for its output partitioning

2020-07-11 Thread GitBox
AmplabJenkins commented on pull request #28676: URL: https://github.com/apache/spark/pull/28676#issuecomment-657053580 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] SparkQA removed a comment on pull request #28676: [SPARK-31869][SQL] BroadcastHashJoinExec can utilize the build side for its output partitioning

2020-07-11 Thread GitBox
SparkQA removed a comment on pull request #28676: URL: https://github.com/apache/spark/pull/28676#issuecomment-657006017 **[Test build #125669 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125669/testReport)** for PR 28676 at commit

[GitHub] [spark] SparkQA commented on pull request #28676: [SPARK-31869][SQL] BroadcastHashJoinExec can utilize the build side for its output partitioning

2020-07-11 Thread GitBox
SparkQA commented on pull request #28676: URL: https://github.com/apache/spark/pull/28676#issuecomment-657053310 **[Test build #125669 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125669/testReport)** for PR 28676 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29054: [SPARK-32243][SQL]HiveSessionCatalog call super.makeFunctionExpression should show error message

2020-07-11 Thread GitBox
AmplabJenkins removed a comment on pull request #29054: URL: https://github.com/apache/spark/pull/29054#issuecomment-657049669 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AngersZhuuuu commented on pull request #29054: [SPARK-32243][SQL]HiveSessionCatalog call super.makeFunctionExpression should show error message

2020-07-11 Thread GitBox
AngersZh commented on pull request #29054: URL: https://github.com/apache/spark/pull/29054#issuecomment-657049877 @maropu How about current, I have updated to pr desc. This is an automated message from the Apache Git

[GitHub] [spark] AmplabJenkins commented on pull request #29054: [SPARK-32243][SQL]HiveSessionCatalog call super.makeFunctionExpression should show error message

2020-07-11 Thread GitBox
AmplabJenkins commented on pull request #29054: URL: https://github.com/apache/spark/pull/29054#issuecomment-657049669 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] SparkQA commented on pull request #29054: [SPARK-32243][SQL]HiveSessionCatalog call super.makeFunctionExpression should show error message

2020-07-11 Thread GitBox
SparkQA commented on pull request #29054: URL: https://github.com/apache/spark/pull/29054#issuecomment-657049418 **[Test build #125681 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125681/testReport)** for PR 29054 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29020: [SPARK-23431][CORE] Expose stage level peak executor metrics via REST API

2020-07-11 Thread GitBox
AmplabJenkins removed a comment on pull request #29020: URL: https://github.com/apache/spark/pull/29020#issuecomment-657047257 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins commented on pull request #29020: [SPARK-23431][CORE] Expose stage level peak executor metrics via REST API

2020-07-11 Thread GitBox
AmplabJenkins commented on pull request #29020: URL: https://github.com/apache/spark/pull/29020#issuecomment-657047257 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] SparkQA removed a comment on pull request #29020: [SPARK-23431][CORE] Expose stage level peak executor metrics via REST API

2020-07-11 Thread GitBox
SparkQA removed a comment on pull request #29020: URL: https://github.com/apache/spark/pull/29020#issuecomment-657013563 **[Test build #125671 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125671/testReport)** for PR 29020 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #27988: [SPARK-31226][CORE][TESTS] SizeBasedCoalesce logic will lose partition

2020-07-11 Thread GitBox
AmplabJenkins removed a comment on pull request #27988: URL: https://github.com/apache/spark/pull/27988#issuecomment-657046605 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] TJX2014 edited a comment on pull request #29043: [SPARK-32205][SQL] Writing timestamp to mysql should be datetime type

2020-07-11 Thread GitBox
TJX2014 edited a comment on pull request #29043: URL: https://github.com/apache/spark/pull/29043#issuecomment-657026639 > Yeah DATETIME is definitely not the same thing as TIMESTAMP. You need to start with a Spark date-time type, logically. Hi, @srowen Thank you for your

[GitHub] [spark] SparkQA commented on pull request #29020: [SPARK-23431][CORE] Expose stage level peak executor metrics via REST API

2020-07-11 Thread GitBox
SparkQA commented on pull request #29020: URL: https://github.com/apache/spark/pull/29020#issuecomment-657046771 **[Test build #125671 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125671/testReport)** for PR 29020 at commit

[GitHub] [spark] AmplabJenkins commented on pull request #27988: [SPARK-31226][CORE][TESTS] SizeBasedCoalesce logic will lose partition

2020-07-11 Thread GitBox
AmplabJenkins commented on pull request #27988: URL: https://github.com/apache/spark/pull/27988#issuecomment-657046605 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] SparkQA removed a comment on pull request #27988: [SPARK-31226][CORE][TESTS] SizeBasedCoalesce logic will lose partition

2020-07-11 Thread GitBox
SparkQA removed a comment on pull request #27988: URL: https://github.com/apache/spark/pull/27988#issuecomment-657012610 **[Test build #125670 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125670/testReport)** for PR 27988 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28969: [SPARK-32150][BUILD] Upgrade to ZStd 1.4.5-4

2020-07-11 Thread GitBox
AmplabJenkins removed a comment on pull request #28969: URL: https://github.com/apache/spark/pull/28969#issuecomment-657045945 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] SparkQA commented on pull request #27988: [SPARK-31226][CORE][TESTS] SizeBasedCoalesce logic will lose partition

2020-07-11 Thread GitBox
SparkQA commented on pull request #27988: URL: https://github.com/apache/spark/pull/27988#issuecomment-657046119 **[Test build #125670 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125670/testReport)** for PR 27988 at commit

[GitHub] [spark] AmplabJenkins commented on pull request #28969: [SPARK-32150][BUILD] Upgrade to ZStd 1.4.5-4

2020-07-11 Thread GitBox
AmplabJenkins commented on pull request #28969: URL: https://github.com/apache/spark/pull/28969#issuecomment-657045945 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] SparkQA removed a comment on pull request #28969: [SPARK-32150][BUILD] Upgrade to ZStd 1.4.5-4

2020-07-11 Thread GitBox
SparkQA removed a comment on pull request #28969: URL: https://github.com/apache/spark/pull/28969#issuecomment-657013584 **[Test build #125673 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125673/testReport)** for PR 28969 at commit

[GitHub] [spark] SparkQA commented on pull request #28969: [SPARK-32150][BUILD] Upgrade to ZStd 1.4.5-4

2020-07-11 Thread GitBox
SparkQA commented on pull request #28969: URL: https://github.com/apache/spark/pull/28969#issuecomment-657045517 **[Test build #125673 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125673/testReport)** for PR 28969 at commit

[GitHub] [spark] TJX2014 edited a comment on pull request #29043: [SPARK-32205][SQL] Writing timestamp to mysql should be datetime type

2020-07-11 Thread GitBox
TJX2014 edited a comment on pull request #29043: URL: https://github.com/apache/spark/pull/29043#issuecomment-657024230 @huaxingao Thank you for your detail response. Actually, `Timestamp` in spark has the range '0001-01-01T00:00:00.00Z, -12-31T23:59:59.99Z', see

[GitHub] [spark] TJX2014 edited a comment on pull request #29043: [SPARK-32205][SQL] Writing timestamp to mysql should be datetime type

2020-07-11 Thread GitBox
TJX2014 edited a comment on pull request #29043: URL: https://github.com/apache/spark/pull/29043#issuecomment-657024230 @huaxingao Thank you for your detail response. Actually, `Timestamp` in spark has the range '0001-01-01T00:00:00.00Z, -12-31T23:59:59.99Z', see

[GitHub] [spark] TJX2014 edited a comment on pull request #29043: [SPARK-32205][SQL] Writing timestamp to mysql should be datetime type

2020-07-11 Thread GitBox
TJX2014 edited a comment on pull request #29043: URL: https://github.com/apache/spark/pull/29043#issuecomment-657024230 @huaxingao Thank you for your detail response. Actually, `Timestamp` in spark has the range '0001-01-01T00:00:00.00Z, -12-31T23:59:59.99Z', see

[GitHub] [spark] TJX2014 edited a comment on pull request #29043: [SPARK-32205][SQL] Writing timestamp to mysql should be datetime type

2020-07-11 Thread GitBox
TJX2014 edited a comment on pull request #29043: URL: https://github.com/apache/spark/pull/29043#issuecomment-657024230 @huaxingao Thank you for your detail response. Actually, `Timestamp` in spark has the range '0001-01-01T00:00:00.00Z, -12-31T23:59:59.99Z', see

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29057: [SPARK-32245][INFRA] Run Spark tests in Github Actions

2020-07-11 Thread GitBox
AmplabJenkins removed a comment on pull request #29057: URL: https://github.com/apache/spark/pull/29057#issuecomment-657033762 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins commented on pull request #29057: [SPARK-32245][INFRA] Run Spark tests in Github Actions

2020-07-11 Thread GitBox
AmplabJenkins commented on pull request #29057: URL: https://github.com/apache/spark/pull/29057#issuecomment-657033762 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] SparkQA commented on pull request #29057: [SPARK-32245][INFRA] Run Spark tests in Github Actions

2020-07-11 Thread GitBox
SparkQA commented on pull request #29057: URL: https://github.com/apache/spark/pull/29057#issuecomment-657033454 **[Test build #125680 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125680/testReport)** for PR 29057 at commit

[GitHub] [spark] HyukjinKwon edited a comment on pull request #28957: [SPARK-32138] Drop Python 2.7, 3.4 and 3.5

2020-07-11 Thread GitBox
HyukjinKwon edited a comment on pull request #28957: URL: https://github.com/apache/spark/pull/28957#issuecomment-657028294 I'll merge GitHub actions one first, and fix the conflicts here. I need https://github.com/apache/spark/pull/29057/files#diff-0590ca852e0e565bc489272aee36167fR729

[GitHub] [spark] HeartSaVioR commented on pull request #29069: [SPARK-31831][SQL][TESTS] Use constructor for mock in HiveSessionImplSuite

2020-07-11 Thread GitBox
HeartSaVioR commented on pull request #29069: URL: https://github.com/apache/spark/pull/29069#issuecomment-657028624 I don't know about the details in mockito mock mechanism, but according to the error message and the stack trace, my bet for the problematic spot is

[GitHub] [spark] HyukjinKwon commented on pull request #28957: [SPARK-32138] Drop Python 2.7, 3.4 and 3.5

2020-07-11 Thread GitBox
HyukjinKwon commented on pull request #28957: URL: https://github.com/apache/spark/pull/28957#issuecomment-657028294 I'll merge GitHub actions one first, and fix the conflicts here This is an automated message from the

[GitHub] [spark] TJX2014 edited a comment on pull request #29043: [SPARK-32205][SQL] Writing timestamp to mysql should be datetime type

2020-07-11 Thread GitBox
TJX2014 edited a comment on pull request #29043: URL: https://github.com/apache/spark/pull/29043#issuecomment-657024230 @huaxingao Thank you for your detail response. Actually, `Timestamp` in spark has the range '0001-01-01T00:00:00.00Z, -12-31T23:59:59.99Z', see

[GitHub] [spark] TJX2014 edited a comment on pull request #29043: [SPARK-32205][SQL] Writing timestamp to mysql should be datetime type

2020-07-11 Thread GitBox
TJX2014 edited a comment on pull request #29043: URL: https://github.com/apache/spark/pull/29043#issuecomment-657024230 @huaxingao Thank you for your detail response. Actually, `Timestamp` in spark has the range '0001-01-01T00:00:00.00Z, -12-31T23:59:59.99Z', see

[GitHub] [spark] TJX2014 edited a comment on pull request #29043: [SPARK-32205][SQL] Writing timestamp to mysql should be datetime type

2020-07-11 Thread GitBox
TJX2014 edited a comment on pull request #29043: URL: https://github.com/apache/spark/pull/29043#issuecomment-657024230 @huaxingao Thank you for your detail response. Actually, `Timestamp` in spark has the range '0001-01-01T00:00:00.00Z, -12-31T23:59:59.99Z', see

[GitHub] [spark] TJX2014 commented on pull request #29043: [SPARK-32205][SQL] Writing timestamp to mysql should be datetime type

2020-07-11 Thread GitBox
TJX2014 commented on pull request #29043: URL: https://github.com/apache/spark/pull/29043#issuecomment-657026639 > Yeah DATETIME is definitely not the same thing as TIMESTAMP. You need to start with a Spark date-time type, logically. Hi, @srowen Thank you for your response.

[GitHub] [spark] TJX2014 edited a comment on pull request #29043: [SPARK-32205][SQL] Writing timestamp to mysql should be datetime type

2020-07-11 Thread GitBox
TJX2014 edited a comment on pull request #29043: URL: https://github.com/apache/spark/pull/29043#issuecomment-657026639 > Yeah DATETIME is definitely not the same thing as TIMESTAMP. You need to start with a Spark date-time type, logically. Hi, @srowen Thank you for your

[GitHub] [spark] TJX2014 edited a comment on pull request #29043: [SPARK-32205][SQL] Writing timestamp to mysql should be datetime type

2020-07-11 Thread GitBox
TJX2014 edited a comment on pull request #29043: URL: https://github.com/apache/spark/pull/29043#issuecomment-657024230 @huaxingao Thank you for your detail response. Actually, `Timestamp` in spark has the range '0001-01-01T00:00:00.00Z, -12-31T23:59:59.99Z', see

[GitHub] [spark] TJX2014 edited a comment on pull request #29043: [SPARK-32205][SQL] Writing timestamp to mysql should be datetime type

2020-07-11 Thread GitBox
TJX2014 edited a comment on pull request #29043: URL: https://github.com/apache/spark/pull/29043#issuecomment-657024230 @huaxingao Thank you for your detail response. Actually, `Timestamp` in spark has the range is '0001-01-01T00:00:00.00Z, -12-31T23:59:59.99Z', see

[GitHub] [spark] TJX2014 edited a comment on pull request #29043: [SPARK-32205][SQL] Writing timestamp to mysql should be datetime type

2020-07-11 Thread GitBox
TJX2014 edited a comment on pull request #29043: URL: https://github.com/apache/spark/pull/29043#issuecomment-657024230 @huaxingao Thank you for your detail response. Actually, `Timestamp` in spark has the range is '0001-01-01T00:00:00.00Z, -12-31T23:59:59.99Z', see

[GitHub] [spark] TJX2014 edited a comment on pull request #29043: [SPARK-32205][SQL] Writing timestamp to mysql should be datetime type

2020-07-11 Thread GitBox
TJX2014 edited a comment on pull request #29043: URL: https://github.com/apache/spark/pull/29043#issuecomment-657024230 @huaxingao Thank you for your detail response. Actually, `Timestamp` in spark has the range is '0001-01-01T00:00:00.00Z, -12-31T23:59:59.99Z', see

[GitHub] [spark] TJX2014 edited a comment on pull request #29043: [SPARK-32205][SQL] Writing timestamp to mysql should be datetime type

2020-07-11 Thread GitBox
TJX2014 edited a comment on pull request #29043: URL: https://github.com/apache/spark/pull/29043#issuecomment-657024230 @huaxingao Thank you for your detail response. Actually, `Timestamp` in spark has the range is '0001-01-01T00:00:00.00Z, -12-31T23:59:59.99Z', see

[GitHub] [spark] TJX2014 edited a comment on pull request #29043: [SPARK-32205][SQL] Writing timestamp to mysql should be datetime type

2020-07-11 Thread GitBox
TJX2014 edited a comment on pull request #29043: URL: https://github.com/apache/spark/pull/29043#issuecomment-657024230 @huaxingao Thank you for your detail response. Actually, `Timestamp` in spark has the range is '0001-01-01T00:00:00.00Z, -12-31T23:59:59.99Z', see

[GitHub] [spark] TJX2014 commented on pull request #29043: [SPARK-32205][SQL] Writing timestamp to mysql should be datetime type

2020-07-11 Thread GitBox
TJX2014 commented on pull request #29043: URL: https://github.com/apache/spark/pull/29043#issuecomment-657024230 @huaxingao Thank you for your detail response. Actually, `Timestamp` in spark has the range is '0001-01-01T00:00:00.00Z, -12-31T23:59:59.99Z', see

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28967: [SPARK-32149][SHUFFLE] Improve file path name normalisation at block resolution within the external shuffle service

2020-07-11 Thread GitBox
AmplabJenkins removed a comment on pull request #28967: URL: https://github.com/apache/spark/pull/28967#issuecomment-657022516 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins commented on pull request #28967: [SPARK-32149][SHUFFLE] Improve file path name normalisation at block resolution within the external shuffle service

2020-07-11 Thread GitBox
AmplabJenkins commented on pull request #28967: URL: https://github.com/apache/spark/pull/28967#issuecomment-657022516 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] SparkQA commented on pull request #28967: [SPARK-32149][SHUFFLE] Improve file path name normalisation at block resolution within the external shuffle service

2020-07-11 Thread GitBox
SparkQA commented on pull request #28967: URL: https://github.com/apache/spark/pull/28967#issuecomment-657022401 **[Test build #125679 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125679/testReport)** for PR 28967 at commit

[GitHub] [spark] HeartSaVioR commented on pull request #28967: [SPARK-32149][SHUFFLE] Improve file path name normalisation at block resolution within the external shuffle service

2020-07-11 Thread GitBox
HeartSaVioR commented on pull request #28967: URL: https://github.com/apache/spark/pull/28967#issuecomment-657021428 Retest this please This is an automated message from the Apache Git Service. To respond to the message,

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29069: [SPARK-31831][SQL][TESTS] Use constructor for mock in HiveSessionImplSuite

2020-07-11 Thread GitBox
AmplabJenkins removed a comment on pull request #29069: URL: https://github.com/apache/spark/pull/29069#issuecomment-656848901 Can one of the admins verify this patch? This is an automated message from the Apache Git

[GitHub] [spark] HeartSaVioR commented on pull request #29069: [SPARK-31831][SQL][TESTS] Use constructor for mock in HiveSessionImplSuite

2020-07-11 Thread GitBox
HeartSaVioR commented on pull request #29069: URL: https://github.com/apache/spark/pull/29069#issuecomment-657018147 ok to test This is an automated message from the Apache Git Service. To respond to the message, please log

[GitHub] [spark] dilipbiswal commented on pull request #28425: [SPARK-31480][SQL] Improve the EXPLAIN FORMATTED's output for DSV2's Scan Node

2020-07-11 Thread GitBox
dilipbiswal commented on pull request #28425: URL: https://github.com/apache/spark/pull/28425#issuecomment-657016813 @maropu Thanks. will do after the tests pass. This is an automated message from the Apache Git Service. To

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28998: [SPARK-32173][SQL] Deduplicate code in FromUTCTimestamp and ToUTCTimestamp

2020-07-11 Thread GitBox
AmplabJenkins removed a comment on pull request #28998: URL: https://github.com/apache/spark/pull/28998#issuecomment-657015499 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins commented on pull request #28998: [SPARK-32173][SQL] Deduplicate code in FromUTCTimestamp and ToUTCTimestamp

2020-07-11 Thread GitBox
AmplabJenkins commented on pull request #28998: URL: https://github.com/apache/spark/pull/28998#issuecomment-657015499 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] SparkQA commented on pull request #27366: [SPARK-30648][SQL] Support filters pushdown in JSON datasource

2020-07-11 Thread GitBox
SparkQA commented on pull request #27366: URL: https://github.com/apache/spark/pull/27366#issuecomment-657015343 **[Test build #125678 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125678/testReport)** for PR 27366 at commit

[GitHub] [spark] SparkQA commented on pull request #28998: [SPARK-32173][SQL] Deduplicate code in FromUTCTimestamp and ToUTCTimestamp

2020-07-11 Thread GitBox
SparkQA commented on pull request #28998: URL: https://github.com/apache/spark/pull/28998#issuecomment-657015340 **[Test build #125677 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125677/testReport)** for PR 28998 at commit

[GitHub] [spark] SaurabhChawla100 commented on a change in pull request #29045: [SPARK-32234][SQL] Spark sql commands are failing on selecting the orc tables

2020-07-11 Thread GitBox
SaurabhChawla100 commented on a change in pull request #29045: URL: https://github.com/apache/spark/pull/29045#discussion_r453171980 ## File path: sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/orc/OrcFileFormat.scala ## @@ -181,10 +183,19 @@ class

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29045: [SPARK-32234][SQL] Spark sql commands are failing on selecting the orc tables

2020-07-11 Thread GitBox
AmplabJenkins removed a comment on pull request #29045: URL: https://github.com/apache/spark/pull/29045#issuecomment-657014597 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29062: [SPARK-32237][SQL] Resolve hint in CTE

2020-07-11 Thread GitBox
AmplabJenkins removed a comment on pull request #29062: URL: https://github.com/apache/spark/pull/29062#issuecomment-657014625 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28425: [SPARK-31480][SQL] Improve the EXPLAIN FORMATTED's output for DSV2's Scan Node

2020-07-11 Thread GitBox
AmplabJenkins removed a comment on pull request #28425: URL: https://github.com/apache/spark/pull/28425#issuecomment-657014639 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins removed a comment on pull request #27366: [SPARK-30648][SQL] Support filters pushdown in JSON datasource

2020-07-11 Thread GitBox
AmplabJenkins removed a comment on pull request #27366: URL: https://github.com/apache/spark/pull/27366#issuecomment-657014670 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins commented on pull request #27366: [SPARK-30648][SQL] Support filters pushdown in JSON datasource

2020-07-11 Thread GitBox
AmplabJenkins commented on pull request #27366: URL: https://github.com/apache/spark/pull/27366#issuecomment-657014670 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins commented on pull request #29062: [SPARK-32237][SQL] Resolve hint in CTE

2020-07-11 Thread GitBox
AmplabJenkins commented on pull request #29062: URL: https://github.com/apache/spark/pull/29062#issuecomment-657014625 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins commented on pull request #29045: [SPARK-32234][SQL] Spark sql commands are failing on selecting the orc tables

2020-07-11 Thread GitBox
AmplabJenkins commented on pull request #29045: URL: https://github.com/apache/spark/pull/29045#issuecomment-657014597 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] MaxGekk commented on pull request #28998: [SPARK-32173][SQL] Deduplicate code in FromUTCTimestamp and ToUTCTimestamp

2020-07-11 Thread GitBox
MaxGekk commented on pull request #28998: URL: https://github.com/apache/spark/pull/28998#issuecomment-657014586 jenkins, retest this, please This is an automated message from the Apache Git Service. To respond to the

[GitHub] [spark] AmplabJenkins commented on pull request #28425: [SPARK-31480][SQL] Improve the EXPLAIN FORMATTED's output for DSV2's Scan Node

2020-07-11 Thread GitBox
AmplabJenkins commented on pull request #28425: URL: https://github.com/apache/spark/pull/28425#issuecomment-657014639 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] SparkQA commented on pull request #29062: [SPARK-32237][SQL] Resolve hint in CTE

2020-07-11 Thread GitBox
SparkQA commented on pull request #29062: URL: https://github.com/apache/spark/pull/29062#issuecomment-657014493 **[Test build #125674 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125674/testReport)** for PR 29062 at commit

[GitHub] [spark] SparkQA commented on pull request #29045: [SPARK-32234][SQL] Spark sql commands are failing on selecting the orc tables

2020-07-11 Thread GitBox
SparkQA commented on pull request #29045: URL: https://github.com/apache/spark/pull/29045#issuecomment-657014496 **[Test build #125675 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125675/testReport)** for PR 29045 at commit

[GitHub] [spark] MaxGekk commented on pull request #27366: [SPARK-30648][SQL] Support filters pushdown in JSON datasource

2020-07-11 Thread GitBox
MaxGekk commented on pull request #27366: URL: https://github.com/apache/spark/pull/27366#issuecomment-657014553 jenkins, retest this, please This is an automated message from the Apache Git Service. To respond to the

[GitHub] [spark] SparkQA commented on pull request #28425: [SPARK-31480][SQL] Improve the EXPLAIN FORMATTED's output for DSV2's Scan Node

2020-07-11 Thread GitBox
SparkQA commented on pull request #28425: URL: https://github.com/apache/spark/pull/28425#issuecomment-657014504 **[Test build #125676 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125676/testReport)** for PR 28425 at commit

[GitHub] [spark] SaurabhChawla100 commented on a change in pull request #29045: [SPARK-32234][SQL] Spark sql commands are failing on selecting the orc tables

2020-07-11 Thread GitBox
SaurabhChawla100 commented on a change in pull request #29045: URL: https://github.com/apache/spark/pull/29045#discussion_r453171512 ## File path: sql/core/src/test/scala/org/apache/spark/sql/execution/datasources/orc/OrcColumnarBatchReaderSuite.scala ## @@ -77,4 +77,43 @@

[GitHub] [spark] maropu edited a comment on pull request #28425: [SPARK-31480][SQL] Improve the EXPLAIN FORMATTED's output for DSV2's Scan Node

2020-07-11 Thread GitBox
maropu edited a comment on pull request #28425: URL: https://github.com/apache/spark/pull/28425#issuecomment-657013656 FYI: @gatorsmile @cloud-fan @dongjoon-hyun @gengliangwang This is an automated message from the Apache

[GitHub] [spark] SaurabhChawla100 commented on a change in pull request #29045: [SPARK-32234][SQL] Spark sql commands are failing on selecting the orc tables

2020-07-11 Thread GitBox
SaurabhChawla100 commented on a change in pull request #29045: URL: https://github.com/apache/spark/pull/29045#discussion_r453171504 ## File path: sql/core/src/test/scala/org/apache/spark/sql/execution/datasources/orc/OrcColumnarBatchReaderSuite.scala ## @@ -77,4 +77,43 @@

[GitHub] [spark] LantaoJin commented on pull request #29062: [SPARK-32237][SQL] Resolve hint in CTE

2020-07-11 Thread GitBox
LantaoJin commented on pull request #29062: URL: https://github.com/apache/spark/pull/29062#issuecomment-657013906 retest this please This is an automated message from the Apache Git Service. To respond to the message,

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28969: [SPARK-32150][BUILD] Upgrade to ZStd 1.4.5-4

2020-07-11 Thread GitBox
AmplabJenkins removed a comment on pull request #28969: URL: https://github.com/apache/spark/pull/28969#issuecomment-657013789 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28425: [SPARK-31480][SQL] Improve the EXPLAIN FORMATTED's output for DSV2's Scan Node

2020-07-11 Thread GitBox
AmplabJenkins removed a comment on pull request #28425: URL: https://github.com/apache/spark/pull/28425#issuecomment-657013806 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28979: [SPARK-32154][SQL] Use ExpressionEncoder for the return type of ScalaUDF to convert to catalyst type

2020-07-11 Thread GitBox
AmplabJenkins removed a comment on pull request #28979: URL: https://github.com/apache/spark/pull/28979#issuecomment-657013749 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29020: [SPARK-23431][CORE] Expose stage level peak executor metrics via REST API

2020-07-11 Thread GitBox
AmplabJenkins removed a comment on pull request #29020: URL: https://github.com/apache/spark/pull/29020#issuecomment-657013771 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins commented on pull request #29020: [SPARK-23431][CORE] Expose stage level peak executor metrics via REST API

2020-07-11 Thread GitBox
AmplabJenkins commented on pull request #29020: URL: https://github.com/apache/spark/pull/29020#issuecomment-657013771 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins commented on pull request #28425: [SPARK-31480][SQL] Improve the EXPLAIN FORMATTED's output for DSV2's Scan Node

2020-07-11 Thread GitBox
AmplabJenkins commented on pull request #28425: URL: https://github.com/apache/spark/pull/28425#issuecomment-657013806 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins commented on pull request #28969: [SPARK-32150][BUILD] Upgrade to ZStd 1.4.5-4

2020-07-11 Thread GitBox
AmplabJenkins commented on pull request #28969: URL: https://github.com/apache/spark/pull/28969#issuecomment-657013789 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins commented on pull request #28979: [SPARK-32154][SQL] Use ExpressionEncoder for the return type of ScalaUDF to convert to catalyst type

2020-07-11 Thread GitBox
AmplabJenkins commented on pull request #28979: URL: https://github.com/apache/spark/pull/28979#issuecomment-657013749 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] maropu commented on pull request #28425: [SPARK-31480][SQL] Improve the EXPLAIN FORMATTED's output for DSV2's Scan Node

2020-07-11 Thread GitBox
maropu commented on pull request #28425: URL: https://github.com/apache/spark/pull/28425#issuecomment-657013592 Yea, merging this into the master looks okay to me. If any problem, we can just revert it or do followup. Could you do for your practice?

[GitHub] [spark] maropu commented on pull request #28425: [SPARK-31480][SQL] Improve the EXPLAIN FORMATTED's output for DSV2's Scan Node

2020-07-11 Thread GitBox
maropu commented on pull request #28425: URL: https://github.com/apache/spark/pull/28425#issuecomment-657013656 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and

[GitHub] [spark] SparkQA commented on pull request #29020: [SPARK-23431][CORE] Expose stage level peak executor metrics via REST API

2020-07-11 Thread GitBox
SparkQA commented on pull request #29020: URL: https://github.com/apache/spark/pull/29020#issuecomment-657013563 **[Test build #125671 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125671/testReport)** for PR 29020 at commit

[GitHub] [spark] SparkQA commented on pull request #28979: [SPARK-32154][SQL] Use ExpressionEncoder for the return type of ScalaUDF to convert to catalyst type

2020-07-11 Thread GitBox
SparkQA commented on pull request #28979: URL: https://github.com/apache/spark/pull/28979#issuecomment-657013572 **[Test build #125672 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125672/testReport)** for PR 28979 at commit

[GitHub] [spark] SparkQA commented on pull request #28969: [SPARK-32150][BUILD] Upgrade to ZStd 1.4.5-4

2020-07-11 Thread GitBox
SparkQA commented on pull request #28969: URL: https://github.com/apache/spark/pull/28969#issuecomment-657013584 **[Test build #125673 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125673/testReport)** for PR 28969 at commit

[GitHub] [spark] maropu commented on pull request #28979: [SPARK-32154][SQL] Use ExpressionEncoder for the return type of ScalaUDF to convert to catalyst type

2020-07-11 Thread GitBox
maropu commented on pull request #28979: URL: https://github.com/apache/spark/pull/28979#issuecomment-657013054 retest this please This is an automated message from the Apache Git Service. To respond to the message, please

[GitHub] [spark] AmplabJenkins removed a comment on pull request #27988: [SPARK-31226][CORE][TESTS] SizeBasedCoalesce logic will lose partition

2020-07-11 Thread GitBox
AmplabJenkins removed a comment on pull request #27988: URL: https://github.com/apache/spark/pull/27988#issuecomment-657012774 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] imback82 commented on pull request #29020: [SPARK-23431][CORE] Expose stage level peak executor metrics via REST API

2020-07-11 Thread GitBox
imback82 commented on pull request #29020: URL: https://github.com/apache/spark/pull/29020#issuecomment-657012850 retest this please This is an automated message from the Apache Git Service. To respond to the message, please

[GitHub] [spark] AmplabJenkins commented on pull request #27988: [SPARK-31226][CORE][TESTS] SizeBasedCoalesce logic will lose partition

2020-07-11 Thread GitBox
AmplabJenkins commented on pull request #27988: URL: https://github.com/apache/spark/pull/27988#issuecomment-657012774 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] maropu commented on pull request #29070: [SPARK-32220][SQL][3.0]SHUFFLE_REPLICATE_NL Hint should not change Non-Cartesian Product join result

2020-07-11 Thread GitBox
maropu commented on pull request #29070: URL: https://github.com/apache/spark/pull/29070#issuecomment-657012758 > Hi @dongjoon-hyun , seems branch-2.4 don't have new join hints. so don't need to backport to branch-2.4? Yea, the features have been implemented in the release 3.0.

[GitHub] [spark] maropu commented on pull request #28969: [SPARK-32150][BUILD] Upgrade to ZStd 1.4.5-4

2020-07-11 Thread GitBox
maropu commented on pull request #28969: URL: https://github.com/apache/spark/pull/28969#issuecomment-657012845 retest this please This is an automated message from the Apache Git Service. To respond to the message, please

[GitHub] [spark] SparkQA commented on pull request #27988: [SPARK-31226][CORE][TESTS] SizeBasedCoalesce logic will lose partition

2020-07-11 Thread GitBox
SparkQA commented on pull request #27988: URL: https://github.com/apache/spark/pull/27988#issuecomment-657012610 **[Test build #125670 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125670/testReport)** for PR 27988 at commit

[GitHub] [spark] maropu commented on a change in pull request #29045: [SPARK-32234][SQL] Spark sql commands are failing on selecting the orc tables

2020-07-11 Thread GitBox
maropu commented on a change in pull request #29045: URL: https://github.com/apache/spark/pull/29045#discussion_r453170403 ## File path: sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/orc/OrcFileFormat.scala ## @@ -181,10 +183,19 @@ class OrcFileFormat

[GitHub] [spark] maropu commented on a change in pull request #29045: [SPARK-32234][SQL] Spark sql commands are failing on selecting the orc tables

2020-07-11 Thread GitBox
maropu commented on a change in pull request #29045: URL: https://github.com/apache/spark/pull/29045#discussion_r453170193 ## File path: sql/core/src/test/scala/org/apache/spark/sql/execution/datasources/orc/OrcColumnarBatchReaderSuite.scala ## @@ -77,4 +77,43 @@ class

[GitHub] [spark] maropu commented on a change in pull request #29045: [SPARK-32234][SQL] Spark sql commands are failing on selecting the orc tables

2020-07-11 Thread GitBox
maropu commented on a change in pull request #29045: URL: https://github.com/apache/spark/pull/29045#discussion_r453170133 ## File path: sql/core/src/test/scala/org/apache/spark/sql/execution/datasources/orc/OrcColumnarBatchReaderSuite.scala ## @@ -77,4 +77,43 @@ class

[GitHub] [spark] maropu commented on a change in pull request #29045: [SPARK-32234][SQL] Spark sql commands are failing on selecting the orc tables

2020-07-11 Thread GitBox
maropu commented on a change in pull request #29045: URL: https://github.com/apache/spark/pull/29045#discussion_r453170070 ## File path: sql/core/src/test/scala/org/apache/spark/sql/execution/datasources/orc/OrcColumnarBatchReaderSuite.scala ## @@ -77,4 +77,43 @@ class

<    1   2   3   4   5   >