[GitHub] [spark] AmplabJenkins removed a comment on pull request #28593: [SPARK-31710][SQL] Fail casting numeric to timestamp by default

2020-06-13 Thread GitBox
AmplabJenkins removed a comment on pull request #28593: URL: https://github.com/apache/spark/pull/28593#issuecomment-643683462 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] dilipbiswal edited a comment on pull request #28032: [SPARK-31264][SQL] Repartition by dynamic partition columns before insert partition table

2020-06-13 Thread GitBox
dilipbiswal edited a comment on pull request #28032: URL: https://github.com/apache/spark/pull/28032#issuecomment-643685320 @wangyum Question, if we have a repartition hint on p1 and p2 in the SELECT query would it have similar effect ?

[GitHub] [spark] dilipbiswal commented on pull request #28032: [SPARK-31264][SQL] Repartition by dynamic partition columns before insert partition table

2020-06-13 Thread GitBox
dilipbiswal commented on pull request #28032: URL: https://github.com/apache/spark/pull/28032#issuecomment-643685320 @wangyum Question, if we have a repartition hint on p1 and p2 would it have similar effect ? This is an

[GitHub] [spark] SparkQA removed a comment on pull request #28824: [SPARK-31984][SQL] Make micros rebasing functions via local timestamps pure

2020-06-13 Thread GitBox
SparkQA removed a comment on pull request #28824: URL: https://github.com/apache/spark/pull/28824#issuecomment-643665648 **[Test build #123982 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/123982/testReport)** for PR 28824 at commit

[GitHub] [spark] SparkQA commented on pull request #28824: [SPARK-31984][SQL] Make micros rebasing functions via local timestamps pure

2020-06-13 Thread GitBox
SparkQA commented on pull request #28824: URL: https://github.com/apache/spark/pull/28824#issuecomment-643693752 **[Test build #123982 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/123982/testReport)** for PR 28824 at commit

[GitHub] [spark] AmplabJenkins commented on pull request #28824: [SPARK-31984][SQL] Make micros rebasing functions via local timestamps pure

2020-06-13 Thread GitBox
AmplabJenkins commented on pull request #28824: URL: https://github.com/apache/spark/pull/28824#issuecomment-643693966 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28824: [SPARK-31984][SQL] Make micros rebasing functions via local timestamps pure

2020-06-13 Thread GitBox
AmplabJenkins removed a comment on pull request #28824: URL: https://github.com/apache/spark/pull/28824#issuecomment-643693966 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] agrawaldevesh commented on a change in pull request #28817: [WIP][SPARK-31197][CORE] Exit the executor once all tasks and migrations are finished built on top of on top of spark20629

2020-06-13 Thread GitBox
agrawaldevesh commented on a change in pull request #28817: URL: https://github.com/apache/spark/pull/28817#discussion_r439777235 ## File path: core/src/main/scala/org/apache/spark/executor/CoarseGrainedExecutorBackend.scala ## @@ -258,26 +262,65 @@ private[spark] class

[GitHub] [spark] agrawaldevesh commented on a change in pull request #28818: [WIP][SPARK-31198][CORE] Use graceful decommissioning as part of dynamic scaling

2020-06-13 Thread GitBox
agrawaldevesh commented on a change in pull request #28818: URL: https://github.com/apache/spark/pull/28818#discussion_r439775571 ## File path: core/src/main/scala/org/apache/spark/scheduler/cluster/CoarseGrainedSchedulerBackend.scala ## @@ -497,6 +453,70 @@ class

[GitHub] [spark] GuoPhilipse commented on pull request #28593: [SPARK-31710][SQL] Fail casting numeric to timestamp by default

2020-06-13 Thread GitBox
GuoPhilipse commented on pull request #28593: URL: https://github.com/apache/spark/pull/28593#issuecomment-643696161 @cloud-fan Test cases are improved . Could you please help review? This is an automated message from the

[GitHub] [spark] SparkQA commented on pull request #28708: [SPARK-20629][CORE][K8S] Copy shuffle data when nodes are being shutdown

2020-06-13 Thread GitBox
SparkQA commented on pull request #28708: URL: https://github.com/apache/spark/pull/28708#issuecomment-643579696 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/28586/

[GitHub] [spark] SparkQA removed a comment on pull request #28807: [WIP][SPARK-26905][SQL] Follow the SQL:2016 reserved keywords

2020-06-13 Thread GitBox
SparkQA removed a comment on pull request #28807: URL: https://github.com/apache/spark/pull/28807#issuecomment-643557325 **[Test build #123959 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/123959/testReport)** for PR 28807 at commit

[GitHub] [spark] SparkQA removed a comment on pull request #28123: [SPARK-31350][SQL] Coalesce bucketed tables for sort merge join if applicable

2020-06-13 Thread GitBox
SparkQA removed a comment on pull request #28123: URL: https://github.com/apache/spark/pull/28123#issuecomment-643570837 **[Test build #123963 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/123963/testReport)** for PR 28123 at commit

[GitHub] [spark] AmplabJenkins commented on pull request #28814: [SPARK-31968][SQL]Duplicate partition columns check when writing data

2020-06-13 Thread GitBox
AmplabJenkins commented on pull request #28814: URL: https://github.com/apache/spark/pull/28814#issuecomment-643582074 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] SparkQA commented on pull request #24525: [SPARK-27633][SQL] Remove redundant aliases in NestedColumnAliasing

2020-06-13 Thread GitBox
SparkQA commented on pull request #24525: URL: https://github.com/apache/spark/pull/24525#issuecomment-643581969 **[Test build #123950 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/123950/testReport)** for PR 24525 at commit

[GitHub] [spark] SparkQA commented on pull request #28814: [SPARK-31968][SQL]Duplicate partition columns check when writing data

2020-06-13 Thread GitBox
SparkQA commented on pull request #28814: URL: https://github.com/apache/spark/pull/28814#issuecomment-643581964 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and

[GitHub] [spark] AmplabJenkins commented on pull request #28803: [SPARK-31971][WEBUI] Add pagination support for all jobs timeline

2020-06-13 Thread GitBox
AmplabJenkins commented on pull request #28803: URL: https://github.com/apache/spark/pull/28803#issuecomment-643582013 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] SparkQA removed a comment on pull request #28814: [SPARK-31968][SQL]Duplicate partition columns check when writing data

2020-06-13 Thread GitBox
SparkQA removed a comment on pull request #28814: URL: https://github.com/apache/spark/pull/28814#issuecomment-643554228 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] SparkQA removed a comment on pull request #24525: [SPARK-27633][SQL] Remove redundant aliases in NestedColumnAliasing

2020-06-13 Thread GitBox
SparkQA removed a comment on pull request #24525: URL: https://github.com/apache/spark/pull/24525#issuecomment-643545811 **[Test build #123950 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/123950/testReport)** for PR 24525 at commit

[GitHub] [spark] SparkQA removed a comment on pull request #28803: [SPARK-31971][WEBUI] Add pagination support for all jobs timeline

2020-06-13 Thread GitBox
SparkQA removed a comment on pull request #28803: URL: https://github.com/apache/spark/pull/28803#issuecomment-643576740 **[Test build #123965 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/123965/testReport)** for PR 28803 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28814: [SPARK-31968][SQL]Duplicate partition columns check when writing data

2020-06-13 Thread GitBox
AmplabJenkins removed a comment on pull request #28814: URL: https://github.com/apache/spark/pull/28814#issuecomment-643582074 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28807: [WIP][SPARK-26905][SQL] Follow the SQL:2016 reserved keywords

2020-06-13 Thread GitBox
AmplabJenkins removed a comment on pull request #28807: URL: https://github.com/apache/spark/pull/28807#issuecomment-643582040 Merged build finished. Test FAILed. This is an automated message from the Apache Git Service. To

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28593: [SPARK-31710][SQL] Fail casting numeric to timestamp by default

2020-06-13 Thread GitBox
AmplabJenkins removed a comment on pull request #28593: URL: https://github.com/apache/spark/pull/28593#issuecomment-643582044 Merged build finished. Test FAILed. This is an automated message from the Apache Git Service. To

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28123: [SPARK-31350][SQL] Coalesce bucketed tables for sort merge join if applicable

2020-06-13 Thread GitBox
AmplabJenkins removed a comment on pull request #28123: URL: https://github.com/apache/spark/pull/28123#issuecomment-643582008 Merged build finished. Test FAILed. This is an automated message from the Apache Git Service. To

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28803: [SPARK-31971][WEBUI] Add pagination support for all jobs timeline

2020-06-13 Thread GitBox
AmplabJenkins removed a comment on pull request #28803: URL: https://github.com/apache/spark/pull/28803#issuecomment-643582013 Merged build finished. Test FAILed. This is an automated message from the Apache Git Service. To

[GitHub] [spark] SparkQA removed a comment on pull request #28593: [SPARK-31710][SQL] Fail casting numeric to timestamp by default

2020-06-13 Thread GitBox
SparkQA removed a comment on pull request #28593: URL: https://github.com/apache/spark/pull/28593#issuecomment-643561728 **[Test build #123961 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/123961/testReport)** for PR 28593 at commit

[GitHub] [spark] SparkQA commented on pull request #28593: [SPARK-31710][SQL] Fail casting numeric to timestamp by default

2020-06-13 Thread GitBox
SparkQA commented on pull request #28593: URL: https://github.com/apache/spark/pull/28593#issuecomment-643581971 **[Test build #123961 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/123961/testReport)** for PR 28593 at commit

[GitHub] [spark] SparkQA commented on pull request #28807: [WIP][SPARK-26905][SQL] Follow the SQL:2016 reserved keywords

2020-06-13 Thread GitBox
SparkQA commented on pull request #28807: URL: https://github.com/apache/spark/pull/28807#issuecomment-643581965 **[Test build #123959 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/123959/testReport)** for PR 28807 at commit

[GitHub] [spark] AmplabJenkins commented on pull request #28123: [SPARK-31350][SQL] Coalesce bucketed tables for sort merge join if applicable

2020-06-13 Thread GitBox
AmplabJenkins commented on pull request #28123: URL: https://github.com/apache/spark/pull/28123#issuecomment-643582008 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] SparkQA commented on pull request #28803: [SPARK-31971][WEBUI] Add pagination support for all jobs timeline

2020-06-13 Thread GitBox
SparkQA commented on pull request #28803: URL: https://github.com/apache/spark/pull/28803#issuecomment-643581962 **[Test build #123965 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/123965/testReport)** for PR 28803 at commit

[GitHub] [spark] AmplabJenkins commented on pull request #28708: [SPARK-20629][CORE][K8S] Copy shuffle data when nodes are being shutdown

2020-06-13 Thread GitBox
AmplabJenkins commented on pull request #28708: URL: https://github.com/apache/spark/pull/28708#issuecomment-643582017 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] SparkQA commented on pull request #28123: [SPARK-31350][SQL] Coalesce bucketed tables for sort merge join if applicable

2020-06-13 Thread GitBox
SparkQA commented on pull request #28123: URL: https://github.com/apache/spark/pull/28123#issuecomment-643581966 **[Test build #123963 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/123963/testReport)** for PR 28123 at commit

[GitHub] [spark] SparkQA commented on pull request #28708: [SPARK-20629][CORE][K8S] Copy shuffle data when nodes are being shutdown

2020-06-13 Thread GitBox
SparkQA commented on pull request #28708: URL: https://github.com/apache/spark/pull/28708#issuecomment-643581963 **[Test build #123964 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/123964/testReport)** for PR 28708 at commit

[GitHub] [spark] AmplabJenkins commented on pull request #28807: [WIP][SPARK-26905][SQL] Follow the SQL:2016 reserved keywords

2020-06-13 Thread GitBox
AmplabJenkins commented on pull request #28807: URL: https://github.com/apache/spark/pull/28807#issuecomment-643582040 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins commented on pull request #28593: [SPARK-31710][SQL] Fail casting numeric to timestamp by default

2020-06-13 Thread GitBox
AmplabJenkins commented on pull request #28593: URL: https://github.com/apache/spark/pull/28593#issuecomment-643582044 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28820: [SPARK-31632][CORE][WEBUI][FOLLOWUP] Enrich the exception message when application summary is unavailable

2020-06-13 Thread GitBox
AmplabJenkins removed a comment on pull request #28820: URL: https://github.com/apache/spark/pull/28820#issuecomment-643583302 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins commented on pull request #28803: [SPARK-31971][WEBUI] Add pagination support for all jobs timeline

2020-06-13 Thread GitBox
AmplabJenkins commented on pull request #28803: URL: https://github.com/apache/spark/pull/28803#issuecomment-643583329 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] maropu commented on pull request #27690: [SPARK-21514][SQL] Added a new option to use non-blobstore storage when writing into blobstore storage

2020-06-13 Thread GitBox
maropu commented on pull request #27690: URL: https://github.com/apache/spark/pull/27690#issuecomment-643583326 retest this please This is an automated message from the Apache Git Service. To respond to the message, please

[GitHub] [spark] AmplabJenkins commented on pull request #28820: [SPARK-31632][CORE][WEBUI][FOLLOWUP] Enrich the exception message when application summary is unavailable

2020-06-13 Thread GitBox
AmplabJenkins commented on pull request #28820: URL: https://github.com/apache/spark/pull/28820#issuecomment-643583302 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] holdenk commented on pull request #28708: [SPARK-20629][CORE][K8S] Copy shuffle data when nodes are being shutdown

2020-06-13 Thread GitBox
holdenk commented on pull request #28708: URL: https://github.com/apache/spark/pull/28708#issuecomment-643575581 Yeah so the plan is to trigger an exit as soon as migrations are completed. I think a good follow up to https://issues.apache.org/jira/browse/SPARK-31197 would be adding a

[GitHub] [spark] wangyum commented on pull request #28032: [SPARK-31264][SQL] Repartition by dynamic partition columns before insert partition table

2020-06-13 Thread GitBox
wangyum commented on pull request #28032: URL: https://github.com/apache/spark/pull/28032#issuecomment-643575562 Thank you @gengliangwang The root cause is repartition by dynamic partition columns can significantly reduce the number of files:

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28803: [SPARK-31971][WEBUI] Add pagination support for all jobs timeline

2020-06-13 Thread GitBox
AmplabJenkins removed a comment on pull request #28803: URL: https://github.com/apache/spark/pull/28803#issuecomment-643576860 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins commented on pull request #28803: [SPARK-31971][WEBUI] Add pagination support for all jobs timeline

2020-06-13 Thread GitBox
AmplabJenkins commented on pull request #28803: URL: https://github.com/apache/spark/pull/28803#issuecomment-643576860 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] SparkQA commented on pull request #28803: [SPARK-31971][WEBUI] Add pagination support for all jobs timeline

2020-06-13 Thread GitBox
SparkQA commented on pull request #28803: URL: https://github.com/apache/spark/pull/28803#issuecomment-643576740 **[Test build #123965 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/123965/testReport)** for PR 28803 at commit

[GitHub] [spark] sarutak opened a new pull request #28820: [SPARK-31632][CORE][WEBUI][FOLLOWUP] Enrich the exception message when application summary is unavailable

2020-06-13 Thread GitBox
sarutak opened a new pull request #28820: URL: https://github.com/apache/spark/pull/28820 ### What changes were proposed in this pull request? This PR enriches the exception message when application summary is not available. #28444 covers the case when application information is

[GitHub] [spark] sarutak commented on pull request #28820: [SPARK-31632][CORE][WEBUI][FOLLOWUP] Enrich the exception message when application summary is unavailable

2020-06-13 Thread GitBox
sarutak commented on pull request #28820: URL: https://github.com/apache/spark/pull/28820#issuecomment-643581183 The difference of error message format between this PR and #28444 is due to the version of Jetty. Jetty is upgraded in #28585 .

[GitHub] [spark] AmplabJenkins commented on pull request #28820: [SPARK-31632][CORE][WEBUI][FOLLOWUP] Enrich the exception message when application summary is unavailable

2020-06-13 Thread GitBox
AmplabJenkins commented on pull request #28820: URL: https://github.com/apache/spark/pull/28820#issuecomment-643581126 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] sarutak commented on pull request #28820: [SPARK-31632][CORE][WEBUI][FOLLOWUP] Enrich the exception message when application summary is unavailable

2020-06-13 Thread GitBox
sarutak commented on pull request #28820: URL: https://github.com/apache/spark/pull/28820#issuecomment-643582535 retest this please. This is an automated message from the Apache Git Service. To respond to the message, please

[GitHub] [spark] sarutak commented on pull request #28803: [SPARK-31971][WEBUI] Add pagination support for all jobs timeline

2020-06-13 Thread GitBox
sarutak commented on pull request #28803: URL: https://github.com/apache/spark/pull/28803#issuecomment-643582554 retest this please. This is an automated message from the Apache Git Service. To respond to the message, please

[GitHub] [spark] AmplabJenkins commented on pull request #28820: [SPARK-31632][CORE][WEBUI][FOLLOWUP] Enrich the exception message when application summary is unavailable

2020-06-13 Thread GitBox
AmplabJenkins commented on pull request #28820: URL: https://github.com/apache/spark/pull/28820#issuecomment-643582601 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins commented on pull request #28123: [SPARK-31350][SQL] Coalesce bucketed tables for sort merge join if applicable

2020-06-13 Thread GitBox
AmplabJenkins commented on pull request #28123: URL: https://github.com/apache/spark/pull/28123#issuecomment-643582636 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28820: [SPARK-31632][CORE][WEBUI][FOLLOWUP] Enrich the exception message when application summary is unavailable

2020-06-13 Thread GitBox
AmplabJenkins removed a comment on pull request #28820: URL: https://github.com/apache/spark/pull/28820#issuecomment-643582601 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28123: [SPARK-31350][SQL] Coalesce bucketed tables for sort merge join if applicable

2020-06-13 Thread GitBox
AmplabJenkins removed a comment on pull request #28123: URL: https://github.com/apache/spark/pull/28123#issuecomment-643582636 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] SparkQA commented on pull request #28820: [SPARK-31632][CORE][WEBUI][FOLLOWUP] Enrich the exception message when application summary is unavailable

2020-06-13 Thread GitBox
SparkQA commented on pull request #28820: URL: https://github.com/apache/spark/pull/28820#issuecomment-643583190 **[Test build #123968 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/123968/testReport)** for PR 28820 at commit

[GitHub] [spark] SparkQA commented on pull request #28803: [SPARK-31971][WEBUI] Add pagination support for all jobs timeline

2020-06-13 Thread GitBox
SparkQA commented on pull request #28803: URL: https://github.com/apache/spark/pull/28803#issuecomment-643583191 **[Test build #123969 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/123969/testReport)** for PR 28803 at commit

[GitHub] [spark] viirya commented on a change in pull request #28123: [SPARK-31350][SQL] Coalesce bucketed tables for sort merge join if applicable

2020-06-13 Thread GitBox
viirya commented on a change in pull request #28123: URL: https://github.com/apache/spark/pull/28123#discussion_r439714718 ## File path: sql/core/src/main/scala/org/apache/spark/sql/execution/bucketing/CoalesceBucketsInSortMergeJoin.scala ## @@ -0,0 +1,112 @@ +/* + * Licensed

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28808: [SPARK-31975][SQL] Throw user facing error when use WindowFunction directly

2020-06-13 Thread GitBox
AmplabJenkins removed a comment on pull request #28808: URL: https://github.com/apache/spark/pull/28808#issuecomment-643581694 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28820: [SPARK-31632][CORE][WEBUI][FOLLOWUP] Enrich the exception message when application summary is unavailable

2020-06-13 Thread GitBox
AmplabJenkins removed a comment on pull request #28820: URL: https://github.com/apache/spark/pull/28820#issuecomment-643581126 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins commented on pull request #28808: [SPARK-31975][SQL] Throw user facing error when use WindowFunction directly

2020-06-13 Thread GitBox
AmplabJenkins commented on pull request #28808: URL: https://github.com/apache/spark/pull/28808#issuecomment-643581694 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28708: [SPARK-20629][CORE][K8S] Copy shuffle data when nodes are being shutdown

2020-06-13 Thread GitBox
AmplabJenkins removed a comment on pull request #28708: URL: https://github.com/apache/spark/pull/28708#issuecomment-643581618 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] SparkQA commented on pull request #28820: [SPARK-31632][CORE][WEBUI][FOLLOWUP] Enrich the exception message when application summary is unavailable

2020-06-13 Thread GitBox
SparkQA commented on pull request #28820: URL: https://github.com/apache/spark/pull/28820#issuecomment-643581667 **[Test build #123966 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/123966/testReport)** for PR 28820 at commit

[GitHub] [spark] SparkQA commented on pull request #28708: [SPARK-20629][CORE][K8S] Copy shuffle data when nodes are being shutdown

2020-06-13 Thread GitBox
SparkQA commented on pull request #28708: URL: https://github.com/apache/spark/pull/28708#issuecomment-643581609 Kubernetes integration test status success URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/28586/

[GitHub] [spark] AmplabJenkins commented on pull request #28708: [SPARK-20629][CORE][K8S] Copy shuffle data when nodes are being shutdown

2020-06-13 Thread GitBox
AmplabJenkins commented on pull request #28708: URL: https://github.com/apache/spark/pull/28708#issuecomment-643581615 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] SparkQA removed a comment on pull request #28808: [SPARK-31975][SQL] Throw user facing error when use WindowFunction directly

2020-06-13 Thread GitBox
SparkQA removed a comment on pull request #28808: URL: https://github.com/apache/spark/pull/28808#issuecomment-643546611 **[Test build #123951 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/123951/testReport)** for PR 28808 at commit

[GitHub] [spark] iRakson commented on pull request #28752: [SPARK-31642][FOLLOWUP] Fix Sorting for duration column and make Status column sortable

2020-06-13 Thread GitBox
iRakson commented on pull request #28752: URL: https://github.com/apache/spark/pull/28752#issuecomment-643583639 > LGTM. Do you all have an opinion on back porting to branch-3.0? I think I would. > Yeah, it would be better. What do you think @iRakson ? Just to be clear, We are

[GitHub] [spark] maropu commented on pull request #28807: [WIP][SPARK-26905][SQL] Follow the SQL:2016 reserved keywords

2020-06-13 Thread GitBox
maropu commented on pull request #28807: URL: https://github.com/apache/spark/pull/28807#issuecomment-643583638 retest this please This is an automated message from the Apache Git Service. To respond to the message, please

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28803: [SPARK-31971][WEBUI] Add pagination support for all jobs timeline

2020-06-13 Thread GitBox
AmplabJenkins removed a comment on pull request #28803: URL: https://github.com/apache/spark/pull/28803#issuecomment-643583329 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] maropu commented on pull request #24525: [SPARK-27633][SQL] Remove redundant aliases in NestedColumnAliasing

2020-06-13 Thread GitBox
maropu commented on pull request #24525: URL: https://github.com/apache/spark/pull/24525#issuecomment-643583708 retest this please This is an automated message from the Apache Git Service. To respond to the message, please

[GitHub] [spark] maropu commented on pull request #28814: [SPARK-31968][SQL]Duplicate partition columns check when writing data

2020-06-13 Thread GitBox
maropu commented on pull request #28814: URL: https://github.com/apache/spark/pull/28814#issuecomment-643583675 retest this please This is an automated message from the Apache Git Service. To respond to the message, please

[GitHub] [spark] SparkQA commented on pull request #28708: [SPARK-20629][CORE][K8S] Copy shuffle data when nodes are being shutdown

2020-06-13 Thread GitBox
SparkQA commented on pull request #28708: URL: https://github.com/apache/spark/pull/28708#issuecomment-643577401 **[Test build #123958 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/123958/testReport)** for PR 28708 at commit

[GitHub] [spark] SparkQA commented on pull request #28808: [SPARK-31975][SQL] Throw user facing error when use WindowFunction directly

2020-06-13 Thread GitBox
SparkQA commented on pull request #28808: URL: https://github.com/apache/spark/pull/28808#issuecomment-643581499 **[Test build #123951 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/123951/testReport)** for PR 28808 at commit

[GitHub] [spark] sarutak commented on pull request #28803: [SPARK-31971][WEBUI] Add pagination support for all jobs timeline

2020-06-13 Thread GitBox
sarutak commented on pull request #28803: URL: https://github.com/apache/spark/pull/28803#issuecomment-643576377 > I think we should make the two pagination sections consistent The upper text fields are for timeline, while the lower ones are for the table so I think they should be

[GitHub] [spark] wangyum edited a comment on pull request #28032: [SPARK-31264][SQL] Repartition by dynamic partition columns before insert partition table

2020-06-13 Thread GitBox
wangyum edited a comment on pull request #28032: URL: https://github.com/apache/spark/pull/28032#issuecomment-643575562 Thank you @gengliangwang The root cause is it takes too much time to rename files:

[GitHub] [spark] sarutak edited a comment on pull request #28803: [SPARK-31971][WEBUI] Add pagination support for all jobs timeline

2020-06-13 Thread GitBox
sarutak edited a comment on pull request #28803: URL: https://github.com/apache/spark/pull/28803#issuecomment-643576377 > I think we should make the two pagination sections consistent The upper text fields are for timeline, while the lower ones are for the table so I think they

[GitHub] [spark] AmplabJenkins commented on pull request #28708: [SPARK-20629][CORE][K8S] Copy shuffle data when nodes are being shutdown

2020-06-13 Thread GitBox
AmplabJenkins commented on pull request #28708: URL: https://github.com/apache/spark/pull/28708#issuecomment-643577621 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28708: [SPARK-20629][CORE][K8S] Copy shuffle data when nodes are being shutdown

2020-06-13 Thread GitBox
AmplabJenkins removed a comment on pull request #28708: URL: https://github.com/apache/spark/pull/28708#issuecomment-643575378 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] SparkQA removed a comment on pull request #28708: [SPARK-20629][CORE][K8S] Copy shuffle data when nodes are being shutdown

2020-06-13 Thread GitBox
SparkQA removed a comment on pull request #28708: URL: https://github.com/apache/spark/pull/28708#issuecomment-643555962 **[Test build #123958 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/123958/testReport)** for PR 28708 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28708: [SPARK-20629][CORE][K8S] Copy shuffle data when nodes are being shutdown

2020-06-13 Thread GitBox
AmplabJenkins removed a comment on pull request #28708: URL: https://github.com/apache/spark/pull/28708#issuecomment-643577621 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins commented on pull request #28814: [SPARK-31968][SQL]Duplicate partition columns check when writing data

2020-06-13 Thread GitBox
AmplabJenkins commented on pull request #28814: URL: https://github.com/apache/spark/pull/28814#issuecomment-643582186 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28803: [SPARK-31971][WEBUI] Add pagination support for all jobs timeline

2020-06-13 Thread GitBox
AmplabJenkins removed a comment on pull request #28803: URL: https://github.com/apache/spark/pull/28803#issuecomment-643582014 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28593: [SPARK-31710][SQL] Fail casting numeric to timestamp by default

2020-06-13 Thread GitBox
AmplabJenkins removed a comment on pull request #28593: URL: https://github.com/apache/spark/pull/28593#issuecomment-643582048 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28814: [SPARK-31968][SQL]Duplicate partition columns check when writing data

2020-06-13 Thread GitBox
AmplabJenkins removed a comment on pull request #28814: URL: https://github.com/apache/spark/pull/28814#issuecomment-643582189 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on pull request #24525: [SPARK-27633][SQL] Remove redundant aliases in NestedColumnAliasing

2020-06-13 Thread GitBox
AmplabJenkins removed a comment on pull request #24525: URL: https://github.com/apache/spark/pull/24525#issuecomment-643582190 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28708: [SPARK-20629][CORE][K8S] Copy shuffle data when nodes are being shutdown

2020-06-13 Thread GitBox
AmplabJenkins removed a comment on pull request #28708: URL: https://github.com/apache/spark/pull/28708#issuecomment-643582022 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] imback82 commented on pull request #28123: [SPARK-31350][SQL] Coalesce bucketed tables for sort merge join if applicable

2020-06-13 Thread GitBox
imback82 commented on pull request #28123: URL: https://github.com/apache/spark/pull/28123#issuecomment-643582357 retest this please This is an automated message from the Apache Git Service. To respond to the message, please

[GitHub] [spark] SparkQA commented on pull request #28123: [SPARK-31350][SQL] Coalesce bucketed tables for sort merge join if applicable

2020-06-13 Thread GitBox
SparkQA commented on pull request #28123: URL: https://github.com/apache/spark/pull/28123#issuecomment-643582481 **[Test build #123967 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/123967/testReport)** for PR 28123 at commit

[GitHub] [spark] AmplabJenkins commented on pull request #24525: [SPARK-27633][SQL] Remove redundant aliases in NestedColumnAliasing

2020-06-13 Thread GitBox
AmplabJenkins commented on pull request #24525: URL: https://github.com/apache/spark/pull/24525#issuecomment-643582187 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28708: [SPARK-20629][CORE][K8S] Copy shuffle data when nodes are being shutdown

2020-06-13 Thread GitBox
AmplabJenkins removed a comment on pull request #28708: URL: https://github.com/apache/spark/pull/28708#issuecomment-643582017 Merged build finished. Test FAILed. This is an automated message from the Apache Git Service. To

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28807: [WIP][SPARK-26905][SQL] Follow the SQL:2016 reserved keywords

2020-06-13 Thread GitBox
AmplabJenkins removed a comment on pull request #28807: URL: https://github.com/apache/spark/pull/28807#issuecomment-643582041 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on pull request #24525: [SPARK-27633][SQL] Remove redundant aliases in NestedColumnAliasing

2020-06-13 Thread GitBox
AmplabJenkins removed a comment on pull request #24525: URL: https://github.com/apache/spark/pull/24525#issuecomment-643582187 Merged build finished. Test FAILed. This is an automated message from the Apache Git Service. To

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28123: [SPARK-31350][SQL] Coalesce bucketed tables for sort merge join if applicable

2020-06-13 Thread GitBox
AmplabJenkins removed a comment on pull request #28123: URL: https://github.com/apache/spark/pull/28123#issuecomment-643582011 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28814: [SPARK-31968][SQL]Duplicate partition columns check when writing data

2020-06-13 Thread GitBox
AmplabJenkins removed a comment on pull request #28814: URL: https://github.com/apache/spark/pull/28814#issuecomment-643582091 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] SparkQA removed a comment on pull request #28708: [SPARK-20629][CORE][K8S] Copy shuffle data when nodes are being shutdown

2020-06-13 Thread GitBox
SparkQA removed a comment on pull request #28708: URL: https://github.com/apache/spark/pull/28708#issuecomment-643575296 **[Test build #123964 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/123964/testReport)** for PR 28708 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #24525: [SPARK-27633][SQL] Remove redundant aliases in NestedColumnAliasing

2020-06-13 Thread GitBox
AmplabJenkins removed a comment on pull request #24525: URL: https://github.com/apache/spark/pull/24525#issuecomment-643584108 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28814: [SPARK-31968][SQL]Duplicate partition columns check when writing data

2020-06-13 Thread GitBox
AmplabJenkins removed a comment on pull request #28814: URL: https://github.com/apache/spark/pull/28814#issuecomment-643584092 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28807: [WIP][SPARK-26905][SQL] Follow the SQL:2016 reserved keywords

2020-06-13 Thread GitBox
AmplabJenkins removed a comment on pull request #28807: URL: https://github.com/apache/spark/pull/28807#issuecomment-643584110 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins removed a comment on pull request #27690: [SPARK-21514][SQL] Added a new option to use non-blobstore storage when writing into blobstore storage

2020-06-13 Thread GitBox
AmplabJenkins removed a comment on pull request #27690: URL: https://github.com/apache/spark/pull/27690#issuecomment-643584114 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] sarutak commented on pull request #28752: [SPARK-31642][FOLLOWUP] Fix Sorting for duration column and make Status column sortable

2020-06-13 Thread GitBox
sarutak commented on pull request #28752: URL: https://github.com/apache/spark/pull/28752#issuecomment-643584248 Pagination feature is not in `branch-3.0` so how about focusing the sorting issue? This is an automated

[GitHub] [spark] SparkQA commented on pull request #28593: [SPARK-31710][SQL] Fail casting numeric to timestamp by default

2020-06-13 Thread GitBox
SparkQA commented on pull request #28593: URL: https://github.com/apache/spark/pull/28593#issuecomment-643583943 **[Test build #123972 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/123972/testReport)** for PR 28593 at commit

[GitHub] [spark] SparkQA commented on pull request #28814: [SPARK-31968][SQL]Duplicate partition columns check when writing data

2020-06-13 Thread GitBox
SparkQA commented on pull request #28814: URL: https://github.com/apache/spark/pull/28814#issuecomment-643583925 **[Test build #123970 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/123970/testReport)** for PR 28814 at commit

  1   2   3   4   >