[GitHub] [spark] imback82 commented on pull request #29020: [SPARK-23431][CORE] Expose stage level peak executor metrics via REST API

2020-07-08 Thread GitBox
imback82 commented on pull request #29020: URL: https://github.com/apache/spark/pull/29020#issuecomment-655641955 Retest this please This is an automated message from the Apache Git Service. To respond to the message, please

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29020: [SPARK-23431][CORE] Expose stage level peak executor metrics via REST API

2020-07-08 Thread GitBox
AmplabJenkins removed a comment on pull request #29020: URL: https://github.com/apache/spark/pull/29020#issuecomment-655644729 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] SparkQA commented on pull request #28975: [SPARK-32148][SS] Fix stream-stream join issue on missing to copy reused unsafe row

2020-07-08 Thread GitBox
SparkQA commented on pull request #28975: URL: https://github.com/apache/spark/pull/28975#issuecomment-655650724 **[Test build #125352 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125352/testReport)** for PR 28975 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28975: [SPARK-32148][SS] Fix stream-stream join issue on missing to copy reused unsafe row

2020-07-08 Thread GitBox
AmplabJenkins removed a comment on pull request #28975: URL: https://github.com/apache/spark/pull/28975#issuecomment-655652599 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] SparkQA removed a comment on pull request #29022: [SPARK-32207][SQL] Support 'F'-suffixed Float Literals

2020-07-08 Thread GitBox
SparkQA removed a comment on pull request #29022: URL: https://github.com/apache/spark/pull/29022#issuecomment-655609594 **[Test build #125384 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125384/testReport)** for PR 29022 at commit

[GitHub] [spark] AmplabJenkins commented on pull request #29022: [SPARK-32207][SQL] Support 'F'-suffixed Float Literals

2020-07-08 Thread GitBox
AmplabJenkins commented on pull request #29022: URL: https://github.com/apache/spark/pull/29022#issuecomment-655653605 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29022: [SPARK-32207][SQL] Support 'F'-suffixed Float Literals

2020-07-08 Thread GitBox
AmplabJenkins removed a comment on pull request #29022: URL: https://github.com/apache/spark/pull/29022#issuecomment-655653605 Merged build finished. Test FAILed. This is an automated message from the Apache Git Service. To

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29041: [SPARK-20680][SQL][FOLLOW-UP] Revert NullType.simpleString from 'unknown' to 'null'

2020-07-08 Thread GitBox
AmplabJenkins removed a comment on pull request #29041: URL: https://github.com/apache/spark/pull/29041#issuecomment-655654934 Merged build finished. Test FAILed. This is an automated message from the Apache Git Service. To

[GitHub] [spark] mridulm commented on a change in pull request #28924: [SPARK-32091][CORE] Ignore timeout error when remove blocks on the lost executor

2020-07-08 Thread GitBox
mridulm commented on a change in pull request #28924: URL: https://github.com/apache/spark/pull/28924#discussion_r451717626 ## File path: core/src/main/scala/org/apache/spark/storage/BlockManagerMasterEndpoint.scala ## @@ -168,6 +177,37 @@ class BlockManagerMasterEndpoint(

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29022: [SPARK-32207][SQL] Support 'F'-suffixed Float Literals

2020-07-08 Thread GitBox
AmplabJenkins removed a comment on pull request #29022: URL: https://github.com/apache/spark/pull/29022#issuecomment-655667062 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] cloud-fan commented on pull request #29017: [SPARK-32233][TESTS] Disable SBT unidoc generation testing in Jenkins

2020-07-08 Thread GitBox
cloud-fan commented on pull request #29017: URL: https://github.com/apache/spark/pull/29017#issuecomment-655666929 +1 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] SparkQA commented on pull request #29022: [SPARK-32207][SQL] Support 'F'-suffixed Float Literals

2020-07-08 Thread GitBox
SparkQA commented on pull request #29022: URL: https://github.com/apache/spark/pull/29022#issuecomment-655666761 **[Test build #125388 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125388/testReport)** for PR 29022 at commit

[GitHub] [spark] AmplabJenkins commented on pull request #29022: [SPARK-32207][SQL] Support 'F'-suffixed Float Literals

2020-07-08 Thread GitBox
AmplabJenkins commented on pull request #29022: URL: https://github.com/apache/spark/pull/29022#issuecomment-655667062 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29020: [SPARK-23431][CORE] Expose stage level peak executor metrics via REST API

2020-07-08 Thread GitBox
AmplabJenkins removed a comment on pull request #29020: URL: https://github.com/apache/spark/pull/29020#issuecomment-655673977 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] dongjoon-hyun commented on pull request #28970: [SPARK-31723][CORE][TEST] Reenable one test case in HistoryServerSuite

2020-07-08 Thread GitBox
dongjoon-hyun commented on pull request #28970: URL: https://github.com/apache/spark/pull/28970#issuecomment-655674031 Retest this please. This is an automated message from the Apache Git Service. To respond to the message,

[GitHub] [spark] SparkQA commented on pull request #29020: [SPARK-23431][CORE] Expose stage level peak executor metrics via REST API

2020-07-08 Thread GitBox
SparkQA commented on pull request #29020: URL: https://github.com/apache/spark/pull/29020#issuecomment-655673884 **[Test build #125390 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125390/testReport)** for PR 29020 at commit

[GitHub] [spark] AmplabJenkins commented on pull request #29020: [SPARK-23431][CORE] Expose stage level peak executor metrics via REST API

2020-07-08 Thread GitBox
AmplabJenkins commented on pull request #29020: URL: https://github.com/apache/spark/pull/29020#issuecomment-655673977 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] SparkQA commented on pull request #28898: [SPARK-32059][SQL] Allow nested schema pruning thru window/sort/filter plans

2020-07-08 Thread GitBox
SparkQA commented on pull request #28898: URL: https://github.com/apache/spark/pull/28898#issuecomment-655680784 **[Test build #125392 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125392/testReport)** for PR 28898 at commit

[GitHub] [spark] AmplabJenkins commented on pull request #28898: [SPARK-32059][SQL] Allow nested schema pruning thru window/sort/filter plans

2020-07-08 Thread GitBox
AmplabJenkins commented on pull request #28898: URL: https://github.com/apache/spark/pull/28898#issuecomment-655680974 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28898: [SPARK-32059][SQL] Allow nested schema pruning thru window/sort/filter plans

2020-07-08 Thread GitBox
AmplabJenkins removed a comment on pull request #28898: URL: https://github.com/apache/spark/pull/28898#issuecomment-655633032 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] dongjoon-hyun commented on pull request #29042: [SPARK-32231][R][INFRA] Use Hadoop 3 winutils in AppVeyor build

2020-07-08 Thread GitBox
dongjoon-hyun commented on pull request #29042: URL: https://github.com/apache/spark/pull/29042#issuecomment-655682053 4 failures in `org.apache.hadoop.io.nativeio.NativeIO$POSIX.stat`. It seems Hadoop 3.0 bug on Windows OS. ``` == testthat results

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29038: [MINOR][INFRA][R] Show the installed packages in R in a prettier way

2020-07-08 Thread GitBox
AmplabJenkins removed a comment on pull request #29038: URL: https://github.com/apache/spark/pull/29038#issuecomment-655681627 Merged build finished. Test FAILed. This is an automated message from the Apache Git Service. To

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29038: [MINOR][INFRA][R] Show the installed packages in R in a prettier way

2020-07-08 Thread GitBox
AmplabJenkins removed a comment on pull request #29038: URL: https://github.com/apache/spark/pull/29038#issuecomment-655681637 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29036: [WIP][SPARK-XXXXX][SQL] CliSuite flakiness fix via differentiating cli driver bootup timeout and query execution timeout

2020-07-08 Thread GitBox
AmplabJenkins removed a comment on pull request #29036: URL: https://github.com/apache/spark/pull/29036#issuecomment-655688588 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] SparkQA commented on pull request #29039: [WIP][SPARK-XXXXX] HiveSessionImplSuite flakiness fix via mocking instances earlier than initializing HiveSessionImpl

2020-07-08 Thread GitBox
SparkQA commented on pull request #29039: URL: https://github.com/apache/spark/pull/29039#issuecomment-655694604 **[Test build #125368 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125368/testReport)** for PR 29039 at commit

[GitHub] [spark] SparkQA removed a comment on pull request #29039: [WIP][SPARK-XXXXX] HiveSessionImplSuite flakiness fix via mocking instances earlier than initializing HiveSessionImpl

2020-07-08 Thread GitBox
SparkQA removed a comment on pull request #29039: URL: https://github.com/apache/spark/pull/29039#issuecomment-655540008 **[Test build #125368 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125368/testReport)** for PR 29039 at commit

[GitHub] [spark] baohe-zhang commented on a change in pull request #28412: [SPARK-31608][CORE][WEBUI] Add a new type of KVStore to make loading UI faster

2020-07-08 Thread GitBox
baohe-zhang commented on a change in pull request #28412: URL: https://github.com/apache/spark/pull/28412#discussion_r451771981 ## File path: core/src/main/scala/org/apache/spark/deploy/history/HybridStore.scala ## @@ -0,0 +1,185 @@ +/* + * Licensed to the Apache Software

[GitHub] [spark] SparkQA commented on pull request #28804: [SPARK-31973][SQL] Add ability to disable Sort,Spill in Partial aggregation

2020-07-08 Thread GitBox
SparkQA commented on pull request #28804: URL: https://github.com/apache/spark/pull/28804#issuecomment-655707361 **[Test build #125393 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125393/testReport)** for PR 28804 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29040: [SPARK-32230][R][INFRA] Use Hadoop 2.7 profile in AppVeyor SparkR build

2020-07-08 Thread GitBox
AmplabJenkins removed a comment on pull request #29040: URL: https://github.com/apache/spark/pull/29040#issuecomment-655710198 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] SaurabhChawla100 opened a new pull request #29045: WIP: add the code change to fix the sql query

2020-07-08 Thread GitBox
SaurabhChawla100 opened a new pull request #29045: URL: https://github.com/apache/spark/pull/29045 ### What changes were proposed in this pull request? ### Why are the changes needed? ### Does this PR introduce _any_ user-facing change?

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29038: [MINOR][INFRA][R] Show the installed packages in R in a prettier way

2020-07-08 Thread GitBox
AmplabJenkins removed a comment on pull request #29038: URL: https://github.com/apache/spark/pull/29038#issuecomment-655724966 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29036: [WIP][SPARK-XXXXX][SQL] CliSuite flakiness fix via differentiating cli driver bootup timeout and query execution timeout

2020-07-08 Thread GitBox
AmplabJenkins removed a comment on pull request #29036: URL: https://github.com/apache/spark/pull/29036#issuecomment-655725018 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28804: [SPARK-31973][SQL] Add ability to disable Sort,Spill in Partial aggregation

2020-07-08 Thread GitBox
AmplabJenkins removed a comment on pull request #28804: URL: https://github.com/apache/spark/pull/28804#issuecomment-655725538 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins commented on pull request #29036: [WIP][SPARK-XXXXX][SQL] CliSuite flakiness fix via differentiating cli driver bootup timeout and query execution timeout

2020-07-08 Thread GitBox
AmplabJenkins commented on pull request #29036: URL: https://github.com/apache/spark/pull/29036#issuecomment-655727687 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins commented on pull request #28969: [SPARK-32150][BUILD] Upgrade to ZStd 1.4.5-4

2020-07-08 Thread GitBox
AmplabJenkins commented on pull request #28969: URL: https://github.com/apache/spark/pull/28969#issuecomment-655727689 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] mridulm commented on pull request #29002: [SPARK-32175][CORE] Fix the order between initialization for ExecutorPlugin and starting heartbeat thread

2020-07-08 Thread GitBox
mridulm commented on pull request #29002: URL: https://github.com/apache/spark/pull/29002#issuecomment-655731079 > This can be a reasonable compromise. Another solution can be to perform initialization before registering executors and then it's guaranteed that plugins are initialized when

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28983: [SPARK-32159][SQL] Fix integration between Aggregator[Array[_], _, _] and UnresolvedMapObjects

2020-07-08 Thread GitBox
AmplabJenkins removed a comment on pull request #28983: URL: https://github.com/apache/spark/pull/28983#issuecomment-655747658 Merged build finished. Test FAILed. This is an automated message from the Apache Git Service. To

[GitHub] [spark] SparkQA commented on pull request #29041: [SPARK-20680][SQL][FOLLOW-UP] Revert NullType.simpleString from 'unknown' to 'null'

2020-07-08 Thread GitBox
SparkQA commented on pull request #29041: URL: https://github.com/apache/spark/pull/29041#issuecomment-655753134 **[Test build #125395 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125395/testReport)** for PR 29041 at commit

[GitHub] [spark] SparkQA commented on pull request #28969: [SPARK-32150][BUILD] Upgrade to ZStd 1.4.5-4

2020-07-08 Thread GitBox
SparkQA commented on pull request #28969: URL: https://github.com/apache/spark/pull/28969#issuecomment-655753111 **[Test build #125396 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125396/testReport)** for PR 28969 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29034: [SPARK-32219][SQL] Add SHOW CACHED TABLES Command

2020-07-08 Thread GitBox
AmplabJenkins removed a comment on pull request #29034: URL: https://github.com/apache/spark/pull/29034#issuecomment-655751873 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] HeartSaVioR commented on pull request #28859: [SPARK-32024][WEBUI] Update ApplicationStoreInfo.size during HistoryServerDiskManager initializing

2020-07-08 Thread GitBox
HeartSaVioR commented on pull request #28859: URL: https://github.com/apache/spark/pull/28859#issuecomment-655752902 I'll submit a hotfix patch against master (can cherry-pick to broken branches) once I confirmed my fix works for branch-2.4 as well (it should work with master as well, as

[GitHub] [spark] dongjoon-hyun commented on pull request #28969: [SPARK-32150][BUILD] Upgrade to ZStd 1.4.5-4

2020-07-08 Thread GitBox
dongjoon-hyun commented on pull request #28969: URL: https://github.com/apache/spark/pull/28969#issuecomment-655752739 Retest this please. This is an automated message from the Apache Git Service. To respond to the message,

[GitHub] [spark] AmplabJenkins commented on pull request #28969: [SPARK-32150][BUILD] Upgrade to ZStd 1.4.5-4

2020-07-08 Thread GitBox
AmplabJenkins commented on pull request #28969: URL: https://github.com/apache/spark/pull/28969#issuecomment-655753682 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] dongjoon-hyun commented on pull request #29045: [SPARK-32234][SQL] Spark sql commands are failing on selecting the orc tables

2020-07-08 Thread GitBox
dongjoon-hyun commented on pull request #29045: URL: https://github.com/apache/spark/pull/29045#issuecomment-655758392 ok to test This is an automated message from the Apache Git Service. To respond to the message, please

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28983: [SPARK-32159][SQL] Fix integration between Aggregator[Array[_], _, _] and UnresolvedMapObjects

2020-07-08 Thread GitBox
AmplabJenkins removed a comment on pull request #28983: URL: https://github.com/apache/spark/pull/28983#issuecomment-655757469 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] SparkQA commented on pull request #28998: [SPARK-32173][SQL] Deduplicate code in FromUTCTimestamp and ToUTCTimestamp

2020-07-08 Thread GitBox
SparkQA commented on pull request #28998: URL: https://github.com/apache/spark/pull/28998#issuecomment-655763542 **[Test build #125399 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125399/testReport)** for PR 28998 at commit

[GitHub] [spark] AmplabJenkins commented on pull request #28998: [SPARK-32173][SQL] Deduplicate code in FromUTCTimestamp and ToUTCTimestamp

2020-07-08 Thread GitBox
AmplabJenkins commented on pull request #28998: URL: https://github.com/apache/spark/pull/28998#issuecomment-655764161 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] dongjoon-hyun commented on pull request #28859: [SPARK-32024][WEBUI] Update ApplicationStoreInfo.size during HistoryServerDiskManager initializing

2020-07-08 Thread GitBox
dongjoon-hyun commented on pull request #28859: URL: https://github.com/apache/spark/pull/28859#issuecomment-655768498 Thank you, @HeartSaVioR ! This is an automated message from the Apache Git Service. To respond to the

[GitHub] [spark] HeartSaVioR commented on a change in pull request #28975: [SPARK-32148][SS] Fix stream-stream join issue on missing to copy reused unsafe row

2020-07-08 Thread GitBox
HeartSaVioR commented on a change in pull request #28975: URL: https://github.com/apache/spark/pull/28975#discussion_r451836861 ## File path: sql/core/src/test/scala/org/apache/spark/sql/streaming/StreamingJoinSuite.scala ## @@ -996,4 +997,47 @@ class StreamingOuterJoinSuite

[GitHub] [spark] tgravescs commented on a change in pull request #28287: [SPARK-31418][SCHEDULER] Request more executors in case of dynamic allocation is enabled and a task becomes unschedulable due t

2020-07-08 Thread GitBox
tgravescs commented on a change in pull request #28287: URL: https://github.com/apache/spark/pull/28287#discussion_r451820344 ## File path: core/src/main/scala/org/apache/spark/scheduler/TaskSchedulerImpl.scala ## @@ -652,18 +652,26 @@ private[spark] class TaskSchedulerImpl(

[GitHub] [spark] SparkQA commented on pull request #29045: [SPARK-32234][SQL] Spark sql commands are failing on selecting the orc tables

2020-07-08 Thread GitBox
SparkQA commented on pull request #29045: URL: https://github.com/apache/spark/pull/29045#issuecomment-655779658 **[Test build #125398 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125398/testReport)** for PR 29045 at commit

[GitHub] [spark] AmplabJenkins commented on pull request #28970: [SPARK-31723][CORE][TEST] Reenable one test case in HistoryServerSuite

2020-07-08 Thread GitBox
AmplabJenkins commented on pull request #28970: URL: https://github.com/apache/spark/pull/28970#issuecomment-655782710 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28970: [SPARK-31723][CORE][TEST] Reenable one test case in HistoryServerSuite

2020-07-08 Thread GitBox
AmplabJenkins removed a comment on pull request #28970: URL: https://github.com/apache/spark/pull/28970#issuecomment-655782710 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins commented on pull request #28683: [SPARK-31875][SQL] Provide a option to disable user supplied Hints

2020-07-08 Thread GitBox
AmplabJenkins commented on pull request #28683: URL: https://github.com/apache/spark/pull/28683#issuecomment-655782381 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28683: [SPARK-31875][SQL] Provide a option to disable user supplied Hints

2020-07-08 Thread GitBox
AmplabJenkins removed a comment on pull request #28683: URL: https://github.com/apache/spark/pull/28683#issuecomment-655782381 Merged build finished. Test FAILed. This is an automated message from the Apache Git Service. To

[GitHub] [spark] SparkQA removed a comment on pull request #28683: [SPARK-31875][SQL] Provide a option to disable user supplied Hints

2020-07-08 Thread GitBox
SparkQA removed a comment on pull request #28683: URL: https://github.com/apache/spark/pull/28683#issuecomment-655544417 **[Test build #125370 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125370/testReport)** for PR 28683 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28683: [SPARK-31875][SQL] Provide a option to disable user supplied Hints

2020-07-08 Thread GitBox
AmplabJenkins removed a comment on pull request #28683: URL: https://github.com/apache/spark/pull/28683#issuecomment-655782386 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] SparkQA removed a comment on pull request #29019: [2.4][SPARK-32167][SQL] Fix GetArrayStructFields to respect inner field's nullability together

2020-07-08 Thread GitBox
SparkQA removed a comment on pull request #29019: URL: https://github.com/apache/spark/pull/29019#issuecomment-67391 **[Test build #125376 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125376/testReport)** for PR 29019 at commit

[GitHub] [spark] SparkQA commented on pull request #29019: [2.4][SPARK-32167][SQL] Fix GetArrayStructFields to respect inner field's nullability together

2020-07-08 Thread GitBox
SparkQA commented on pull request #29019: URL: https://github.com/apache/spark/pull/29019#issuecomment-655742087 **[Test build #125376 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125376/testReport)** for PR 29019 at commit

[GitHub] [spark] HeartSaVioR commented on pull request #28859: [SPARK-32024][WEBUI] Update ApplicationStoreInfo.size during HistoryServerDiskManager initializing

2020-07-08 Thread GitBox
HeartSaVioR commented on pull request #28859: URL: https://github.com/apache/spark/pull/28859#issuecomment-655744956 Thanks for sharing the test failure, @dongjoon-hyun . I took a quick look, and realized 245aee9fc85c22352bb946a8987229270ba6069f was landed only on master branch (as it's

[GitHub] [spark] AmplabJenkins commented on pull request #28983: [SPARK-32159][SQL] Fix integration between Aggregator[Array[_], _, _] and UnresolvedMapObjects

2020-07-08 Thread GitBox
AmplabJenkins commented on pull request #28983: URL: https://github.com/apache/spark/pull/28983#issuecomment-655747658 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] SparkQA commented on pull request #29034: [SPARK-32219][SQL] Add SHOW CACHED TABLES Command

2020-07-08 Thread GitBox
SparkQA commented on pull request #29034: URL: https://github.com/apache/spark/pull/29034#issuecomment-655750999 **[Test build #125372 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125372/testReport)** for PR 29034 at commit

[GitHub] [spark] SparkQA removed a comment on pull request #29034: [SPARK-32219][SQL] Add SHOW CACHED TABLES Command

2020-07-08 Thread GitBox
SparkQA removed a comment on pull request #29034: URL: https://github.com/apache/spark/pull/29034#issuecomment-655549681 **[Test build #125372 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125372/testReport)** for PR 29034 at commit

[GitHub] [spark] zhli1142015 commented on pull request #28859: [SPARK-32024][WEBUI] Update ApplicationStoreInfo.size during HistoryServerDiskManager initializing

2020-07-08 Thread GitBox
zhli1142015 commented on pull request #28859: URL: https://github.com/apache/spark/pull/28859#issuecomment-655751281 Thanks @HeartSaVioR and @dongjoon-hyun . i can reproduce it on branch 3.0 also, the cause is same as @HeartSaVioR mentioned, commit 245aee9 is not in branch 2.4 and 3.0.

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29034: [SPARK-32219][SQL] Add SHOW CACHED TABLES Command

2020-07-08 Thread GitBox
AmplabJenkins removed a comment on pull request #29034: URL: https://github.com/apache/spark/pull/29034#issuecomment-655634508 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] dongjoon-hyun commented on pull request #29041: [SPARK-20680][SQL][FOLLOW-UP] Revert NullType.simpleString from 'unknown' to 'null'

2020-07-08 Thread GitBox
dongjoon-hyun commented on pull request #29041: URL: https://github.com/apache/spark/pull/29041#issuecomment-655751060 Retest this please. This is an automated message from the Apache Git Service. To respond to the message,

[GitHub] [spark] SparkQA removed a comment on pull request #28998: [SPARK-32173][SQL] Deduplicate code in FromUTCTimestamp and ToUTCTimestamp

2020-07-08 Thread GitBox
SparkQA removed a comment on pull request #28998: URL: https://github.com/apache/spark/pull/28998#issuecomment-63489 **[Test build #125373 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125373/testReport)** for PR 28998 at commit

[GitHub] [spark] AmplabJenkins commented on pull request #28998: [SPARK-32173][SQL] Deduplicate code in FromUTCTimestamp and ToUTCTimestamp

2020-07-08 Thread GitBox
AmplabJenkins commented on pull request #28998: URL: https://github.com/apache/spark/pull/28998#issuecomment-655755704 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29045: [SPARK-32234][SQL] Spark sql commands are failing on selecting the orc tables

2020-07-08 Thread GitBox
AmplabJenkins removed a comment on pull request #29045: URL: https://github.com/apache/spark/pull/29045#issuecomment-655718245 Can one of the admins verify this patch? This is an automated message from the Apache Git

[GitHub] [spark] dongjoon-hyun commented on pull request #29017: [SPARK-32233][TESTS] Disable SBT unidoc generation testing in Jenkins

2020-07-08 Thread GitBox
dongjoon-hyun commented on pull request #29017: URL: https://github.com/apache/spark/pull/29017#issuecomment-655759374 Thank you all. Merged to master. This is an automated message from the Apache Git Service. To respond to

[GitHub] [spark] srowen commented on a change in pull request #29037: [SPARK-32224][CORE] Support pass 'spark.yarn.priority' through the SparkSubmit

2020-07-08 Thread GitBox
srowen commented on a change in pull request #29037: URL: https://github.com/apache/spark/pull/29037#discussion_r451838829 ## File path: core/src/main/scala/org/apache/spark/deploy/SparkSubmitArguments.scala ## @@ -562,6 +570,7 @@ private[deploy] class

[GitHub] [spark] srowen commented on pull request #29030: [SPARK-32093][BUILD] Add hadoop-ozone-filesystem jar to ozone profile.

2020-07-08 Thread GitBox
srowen commented on pull request #29030: URL: https://github.com/apache/spark/pull/29030#issuecomment-655770710 Why do we need this in Spark? This is an automated message from the Apache Git Service. To respond to the

[GitHub] [spark] SparkQA commented on pull request #29010: [SPARK-32192][SQL] Print column name when throws ClassCastException

2020-07-08 Thread GitBox
SparkQA commented on pull request #29010: URL: https://github.com/apache/spark/pull/29010#issuecomment-655772933 **[Test build #125400 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125400/testReport)** for PR 29010 at commit

[GitHub] [spark] AmplabJenkins commented on pull request #29010: [SPARK-32192][SQL] Print column name when throws ClassCastException

2020-07-08 Thread GitBox
AmplabJenkins commented on pull request #29010: URL: https://github.com/apache/spark/pull/29010#issuecomment-655773341 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] HeartSaVioR commented on pull request #28859: [SPARK-32024][WEBUI] Update ApplicationStoreInfo.size during HistoryServerDiskManager initializing

2020-07-08 Thread GitBox
HeartSaVioR commented on pull request #28859: URL: https://github.com/apache/spark/pull/28859#issuecomment-65577 OK confirmed the hotfix works in master and branch-2.4 as well. Will submit a hotfix soon. This is an

[GitHub] [spark] SparkQA commented on pull request #28971: [WIP][SPARK-29292][SPARK-30010][CORE] Let core compile for Scala 2.13

2020-07-08 Thread GitBox
SparkQA commented on pull request #28971: URL: https://github.com/apache/spark/pull/28971#issuecomment-655772947 **[Test build #125401 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125401/testReport)** for PR 28971 at commit

[GitHub] [spark] SparkQA removed a comment on pull request #29045: [SPARK-32234][SQL] Spark sql commands are failing on selecting the orc tables

2020-07-08 Thread GitBox
SparkQA removed a comment on pull request #29045: URL: https://github.com/apache/spark/pull/29045#issuecomment-655760002 **[Test build #125398 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125398/testReport)** for PR 29045 at commit

[GitHub] [spark] AmplabJenkins commented on pull request #29045: [SPARK-32234][SQL] Spark sql commands are failing on selecting the orc tables

2020-07-08 Thread GitBox
AmplabJenkins commented on pull request #29045: URL: https://github.com/apache/spark/pull/29045#issuecomment-655779846 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29045: [SPARK-32234][SQL] Spark sql commands are failing on selecting the orc tables

2020-07-08 Thread GitBox
AmplabJenkins removed a comment on pull request #29045: URL: https://github.com/apache/spark/pull/29045#issuecomment-655779846 Merged build finished. Test FAILed. This is an automated message from the Apache Git Service. To

[GitHub] [spark] HeartSaVioR commented on pull request #29046: [SPARK-32024][WEBUI][FOLLOWUP] Quick fix on test failure on missing when statements

2020-07-08 Thread GitBox
HeartSaVioR commented on pull request #29046: URL: https://github.com/apache/spark/pull/29046#issuecomment-655787056 cc. @dongjoon-hyun @gengliangwang @zhli1142015 This patch should be ported back to branch-3.0 / branch-2.4 as well. Please take a look. Thanks!

[GitHub] [spark] bharatviswa504 commented on a change in pull request #29030: [SPARK-32093][BUILD] Add hadoop-ozone-filesystem jar to ozone profile.

2020-07-08 Thread GitBox
bharatviswa504 commented on a change in pull request #29030: URL: https://github.com/apache/spark/pull/29030#discussion_r451855945 ## File path: pom.xml ## @@ -202,6 +202,9 @@ 0.15.1 org.fusesource.leveldbjni + + +0.5.0-beta Review comment:

[GitHub] [spark] HeartSaVioR opened a new pull request #29046: [SPARK-32024][WEBUI][FOLLOWUP] Quick fix on test failure on missing when statements

2020-07-08 Thread GitBox
HeartSaVioR opened a new pull request #29046: URL: https://github.com/apache/spark/pull/29046 ### What changes were proposed in this pull request? This patch fixes the test failure due to the missing when statements for destination path. Note that it didn't fail on master branch,

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28969: [SPARK-32150][BUILD] Upgrade to ZStd 1.4.5-4

2020-07-08 Thread GitBox
AmplabJenkins removed a comment on pull request #28969: URL: https://github.com/apache/spark/pull/28969#issuecomment-655727701 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28969: [SPARK-32150][BUILD] Upgrade to ZStd 1.4.5-4

2020-07-08 Thread GitBox
AmplabJenkins removed a comment on pull request #28969: URL: https://github.com/apache/spark/pull/28969#issuecomment-655727689 Merged build finished. Test FAILed. This is an automated message from the Apache Git Service. To

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29036: [WIP][SPARK-XXXXX][SQL] CliSuite flakiness fix via differentiating cli driver bootup timeout and query execution timeout

2020-07-08 Thread GitBox
AmplabJenkins removed a comment on pull request #29036: URL: https://github.com/apache/spark/pull/29036#issuecomment-655727687 Merged build finished. Test FAILed. This is an automated message from the Apache Git Service. To

[GitHub] [spark] AmplabJenkins commented on pull request #29036: [WIP][SPARK-XXXXX][SQL] CliSuite flakiness fix via differentiating cli driver bootup timeout and query execution timeout

2020-07-08 Thread GitBox
AmplabJenkins commented on pull request #29036: URL: https://github.com/apache/spark/pull/29036#issuecomment-655732187 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29036: [WIP][SPARK-XXXXX][SQL] CliSuite flakiness fix via differentiating cli driver bootup timeout and query execution timeout

2020-07-08 Thread GitBox
AmplabJenkins removed a comment on pull request #29036: URL: https://github.com/apache/spark/pull/29036#issuecomment-655732187 Merged build finished. Test FAILed. This is an automated message from the Apache Git Service. To

[GitHub] [spark] mridulm commented on pull request #28994: [SPARK-32170][CORE] Improve the speculation for the inefficient tasks by the task metrics.

2020-07-08 Thread GitBox
mridulm commented on pull request #28994: URL: https://github.com/apache/spark/pull/28994#issuecomment-655740354 @venkata91 You might be interested in this. This is an automated message from the Apache Git Service. To

[GitHub] [spark] dongjoon-hyun commented on pull request #29019: [2.4][SPARK-32167][SQL] Fix GetArrayStructFields to respect inner field's nullability together

2020-07-08 Thread GitBox
dongjoon-hyun commented on pull request #29019: URL: https://github.com/apache/spark/pull/29019#issuecomment-655740496 Merged to branch-2.4. Thank you, @cloud-fan and all. All UTs (including R) passed. Currently, R installation test (which is irrelevant to this PR) is running.

[GitHub] [spark] HeartSaVioR edited a comment on pull request #28859: [SPARK-32024][WEBUI] Update ApplicationStoreInfo.size during HistoryServerDiskManager initializing

2020-07-08 Thread GitBox
HeartSaVioR edited a comment on pull request #28859: URL: https://github.com/apache/spark/pull/28859#issuecomment-655744956 Thanks for sharing the test failure, @dongjoon-hyun . I took a quick look, and realized 245aee9fc85c22352bb946a8987229270ba6069f was landed only on master branch (as

[GitHub] [spark] HeartSaVioR commented on pull request #28859: [SPARK-32024][WEBUI] Update ApplicationStoreInfo.size during HistoryServerDiskManager initializing

2020-07-08 Thread GitBox
HeartSaVioR commented on pull request #28859: URL: https://github.com/apache/spark/pull/28859#issuecomment-655745634 Probably better to land the hotfix into master as well if we go with hotfix, as it looks to be safer assumption rather than depending on 245aee9.

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29034: [SPARK-32219][SQL] Add SHOW CACHED TABLES Command

2020-07-08 Thread GitBox
AmplabJenkins removed a comment on pull request #29034: URL: https://github.com/apache/spark/pull/29034#issuecomment-655751862 Merged build finished. Test FAILed. This is an automated message from the Apache Git Service. To

[GitHub] [spark] AmplabJenkins commented on pull request #29034: [SPARK-32219][SQL] Add SHOW CACHED TABLES Command

2020-07-08 Thread GitBox
AmplabJenkins commented on pull request #29034: URL: https://github.com/apache/spark/pull/29034#issuecomment-655751862 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins commented on pull request #28983: [SPARK-32159][SQL] Fix integration between Aggregator[Array[_], _, _] and UnresolvedMapObjects

2020-07-08 Thread GitBox
AmplabJenkins commented on pull request #28983: URL: https://github.com/apache/spark/pull/28983#issuecomment-655757469 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28983: [SPARK-32159][SQL] Fix integration between Aggregator[Array[_], _, _] and UnresolvedMapObjects

2020-07-08 Thread GitBox
AmplabJenkins removed a comment on pull request #28983: URL: https://github.com/apache/spark/pull/28983#issuecomment-655747668 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29045: [SPARK-32234][SQL] Spark sql commands are failing on selecting the orc tables

2020-07-08 Thread GitBox
AmplabJenkins removed a comment on pull request #29045: URL: https://github.com/apache/spark/pull/29045#issuecomment-655760759 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28998: [SPARK-32173][SQL] Deduplicate code in FromUTCTimestamp and ToUTCTimestamp

2020-07-08 Thread GitBox
AmplabJenkins removed a comment on pull request #28998: URL: https://github.com/apache/spark/pull/28998#issuecomment-655764161 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] baohe-zhang commented on a change in pull request #28412: [SPARK-31608][CORE][WEBUI] Add a new type of KVStore to make loading UI faster

2020-07-08 Thread GitBox
baohe-zhang commented on a change in pull request #28412: URL: https://github.com/apache/spark/pull/28412#discussion_r451838037 ## File path: core/src/main/scala/org/apache/spark/deploy/history/HybridStore.scala ## @@ -0,0 +1,185 @@ +/* + * Licensed to the Apache Software

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29010: [SPARK-32192][SQL] Print column name when throws ClassCastException

2020-07-08 Thread GitBox
AmplabJenkins removed a comment on pull request #29010: URL: https://github.com/apache/spark/pull/29010#issuecomment-655773341 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28971: [WIP][SPARK-29292][SPARK-30010][CORE] Let core compile for Scala 2.13

2020-07-08 Thread GitBox
AmplabJenkins removed a comment on pull request #28971: URL: https://github.com/apache/spark/pull/28971#issuecomment-655773685 This is an automated message from the Apache Git Service. To respond to the message, please log on

<    5   6   7   8   9   10   11   12   13   14   >