[GitHub] [spark] AmplabJenkins commented on pull request #29020: [SPARK-23431][CORE] Expose stage level peak executor metrics via REST API

2020-07-08 Thread GitBox
AmplabJenkins commented on pull request #29020: URL: https://github.com/apache/spark/pull/29020#issuecomment-655672318 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29026: [SPARK-28067][SPARK-32018] Fix decimal overflow issues

2020-07-08 Thread GitBox
AmplabJenkins removed a comment on pull request #29026: URL: https://github.com/apache/spark/pull/29026#issuecomment-655671432 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on pull request #28926: [SPARK-32133][SQL] Forbid time field steps for date start/end in Sequence

2020-07-08 Thread GitBox
AmplabJenkins commented on pull request #28926: URL: https://github.com/apache/spark/pull/28926#issuecomment-655677066 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] SparkQA commented on pull request #28970: [SPARK-31723][CORE][TEST] Reenable one test case in HistoryServerSuite

2020-07-08 Thread GitBox
SparkQA commented on pull request #28970: URL: https://github.com/apache/spark/pull/28970#issuecomment-655677553 **[Test build #125391 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125391/testReport)** for PR 28970 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28926: [SPARK-32133][SQL] Forbid time field steps for date start/end in Sequence

2020-07-08 Thread GitBox
AmplabJenkins removed a comment on pull request #28926: URL: https://github.com/apache/spark/pull/28926#issuecomment-655677066 Merged build finished. Test FAILed. This is an automated message from the Apache Git Service. To

[GitHub] [spark] AmplabJenkins commented on pull request #29038: [MINOR][INFRA][R] Show the installed packages in R in a prettier way

2020-07-08 Thread GitBox
AmplabJenkins commented on pull request #29038: URL: https://github.com/apache/spark/pull/29038#issuecomment-655681627 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28898: [SPARK-32059][SQL] Allow nested schema pruning thru window/sort/filter plans

2020-07-08 Thread GitBox
AmplabJenkins removed a comment on pull request #28898: URL: https://github.com/apache/spark/pull/28898#issuecomment-655680974 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28986: [SPARK-32160][CORE][PYSPARK] Disallow to create SparkContext in executors.

2020-07-08 Thread GitBox
AmplabJenkins removed a comment on pull request #28986: URL: https://github.com/apache/spark/pull/28986#issuecomment-655693003 Merged build finished. Test FAILed. This is an automated message from the Apache Git Service. To

[GitHub] [spark] AmplabJenkins commented on pull request #28986: [SPARK-32160][CORE][PYSPARK] Disallow to create SparkContext in executors.

2020-07-08 Thread GitBox
AmplabJenkins commented on pull request #28986: URL: https://github.com/apache/spark/pull/28986#issuecomment-655693003 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29039: [WIP][SPARK-XXXXX] HiveSessionImplSuite flakiness fix via mocking instances earlier than initializing HiveSessionImpl

2020-07-08 Thread GitBox
AmplabJenkins removed a comment on pull request #29039: URL: https://github.com/apache/spark/pull/29039#issuecomment-655696408 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28804: [SPARK-31973][SQL] Add ability to disable Sort,Spill in Partial aggregation

2020-07-08 Thread GitBox
AmplabJenkins removed a comment on pull request #28804: URL: https://github.com/apache/spark/pull/28804#issuecomment-655708568 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on pull request #29020: [SPARK-23431][CORE] Expose stage level peak executor metrics via REST API

2020-07-08 Thread GitBox
AmplabJenkins commented on pull request #29020: URL: https://github.com/apache/spark/pull/29020#issuecomment-655644729 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] SparkQA commented on pull request #29020: [SPARK-23431][CORE] Expose stage level peak executor metrics via REST API

2020-07-08 Thread GitBox
SparkQA commented on pull request #29020: URL: https://github.com/apache/spark/pull/29020#issuecomment-655645654 **[Test build #125387 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125387/testReport)** for PR 29020 at commit

[GitHub] [spark] mridulm commented on a change in pull request #28412: [SPARK-31608][CORE][WEBUI] Add a new type of KVStore to make loading UI faster

2020-07-08 Thread GitBox
mridulm commented on a change in pull request #28412: URL: https://github.com/apache/spark/pull/28412#discussion_r451705062 ## File path: core/src/main/scala/org/apache/spark/deploy/history/HybridStore.scala ## @@ -0,0 +1,185 @@ +/* + * Licensed to the Apache Software

[GitHub] [spark] mridulm commented on pull request #29002: [SPARK-32175][CORE] Fix the order between initialization for ExecutorPlugin and starting heartbeat thread

2020-07-08 Thread GitBox
mridulm commented on pull request #29002: URL: https://github.com/apache/spark/pull/29002#issuecomment-655659770 As soon as we heartbeat to driver, we will start getting task assignment, etc - how does the interact with a plugin which has not yet completed initialization ? Instead of

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29020: [SPARK-23431][CORE] Expose stage level peak executor metrics via REST API

2020-07-08 Thread GitBox
AmplabJenkins removed a comment on pull request #29020: URL: https://github.com/apache/spark/pull/29020#issuecomment-655672318 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] imback82 commented on pull request #29020: [SPARK-23431][CORE] Expose stage level peak executor metrics via REST API

2020-07-08 Thread GitBox
imback82 commented on pull request #29020: URL: https://github.com/apache/spark/pull/29020#issuecomment-655672452 retest this please This is an automated message from the Apache Git Service. To respond to the message, please

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28970: [SPARK-31723][CORE][TEST] Reenable one test case in HistoryServerSuite

2020-07-08 Thread GitBox
AmplabJenkins removed a comment on pull request #28970: URL: https://github.com/apache/spark/pull/28970#issuecomment-655677609 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins commented on pull request #28970: [SPARK-31723][CORE][TEST] Reenable one test case in HistoryServerSuite

2020-07-08 Thread GitBox
AmplabJenkins commented on pull request #28970: URL: https://github.com/apache/spark/pull/28970#issuecomment-655677609 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28926: [SPARK-32133][SQL] Forbid time field steps for date start/end in Sequence

2020-07-08 Thread GitBox
AmplabJenkins removed a comment on pull request #28926: URL: https://github.com/apache/spark/pull/28926#issuecomment-655677079 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] SparkQA commented on pull request #28986: [SPARK-32160][CORE][PYSPARK] Disallow to create SparkContext in executors.

2020-07-08 Thread GitBox
SparkQA commented on pull request #28986: URL: https://github.com/apache/spark/pull/28986#issuecomment-655690895 **[Test build #125357 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125357/testReport)** for PR 28986 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29039: [WIP][SPARK-XXXXX] HiveSessionImplSuite flakiness fix via mocking instances earlier than initializing HiveSessionImpl

2020-07-08 Thread GitBox
AmplabJenkins removed a comment on pull request #29039: URL: https://github.com/apache/spark/pull/29039#issuecomment-655696400 Merged build finished. Test FAILed. This is an automated message from the Apache Git Service. To

[GitHub] [spark] AmplabJenkins commented on pull request #29039: [WIP][SPARK-XXXXX] HiveSessionImplSuite flakiness fix via mocking instances earlier than initializing HiveSessionImpl

2020-07-08 Thread GitBox
AmplabJenkins commented on pull request #29039: URL: https://github.com/apache/spark/pull/29039#issuecomment-655696400 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] sarutak commented on pull request #29002: [SPARK-32175][CORE] Fix the order between initialization for ExecutorPlugin and starting heartbeat thread

2020-07-08 Thread GitBox
sarutak commented on pull request #29002: URL: https://github.com/apache/spark/pull/29002#issuecomment-655696048 @mridulm >As soon as we heartbeat to driver, we will start getting task assignment, etc - how does the interact with a plugin which has not yet completed initialization ?

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29040: [SPARK-32230][R][INFRA] Use Hadoop 2.7 profile in AppVeyor SparkR build

2020-07-08 Thread GitBox
AmplabJenkins removed a comment on pull request #29040: URL: https://github.com/apache/spark/pull/29040#issuecomment-655710187 Merged build finished. Test FAILed. This is an automated message from the Apache Git Service. To

[GitHub] [spark] AmplabJenkins commented on pull request #29040: [SPARK-32230][R][INFRA] Use Hadoop 2.7 profile in AppVeyor SparkR build

2020-07-08 Thread GitBox
AmplabJenkins commented on pull request #29040: URL: https://github.com/apache/spark/pull/29040#issuecomment-655710187 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] SparkQA commented on pull request #28804: [SPARK-31973][SQL] Add ability to disable Sort,Spill in Partial aggregation

2020-07-08 Thread GitBox
SparkQA commented on pull request #28804: URL: https://github.com/apache/spark/pull/28804#issuecomment-655725403 **[Test build #125394 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125394/testReport)** for PR 28804 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29036: [WIP][SPARK-XXXXX][SQL] CliSuite flakiness fix via differentiating cli driver bootup timeout and query execution timeout

2020-07-08 Thread GitBox
AmplabJenkins removed a comment on pull request #29036: URL: https://github.com/apache/spark/pull/29036#issuecomment-655725009 Merged build finished. Test FAILed. This is an automated message from the Apache Git Service. To

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29038: [MINOR][INFRA][R] Show the installed packages in R in a prettier way

2020-07-08 Thread GitBox
AmplabJenkins removed a comment on pull request #29038: URL: https://github.com/apache/spark/pull/29038#issuecomment-655724957 Merged build finished. Test FAILed. This is an automated message from the Apache Git Service. To

[GitHub] [spark] AmplabJenkins commented on pull request #28804: [SPARK-31973][SQL] Add ability to disable Sort,Spill in Partial aggregation

2020-07-08 Thread GitBox
AmplabJenkins commented on pull request #28804: URL: https://github.com/apache/spark/pull/28804#issuecomment-655725538 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] mridulm commented on a change in pull request #28287: [SPARK-31418][SCHEDULER] Request more executors in case of dynamic allocation is enabled and a task becomes unschedulable due to

2020-07-08 Thread GitBox
mridulm commented on a change in pull request #28287: URL: https://github.com/apache/spark/pull/28287#discussion_r451701402 ## File path: core/src/main/scala/org/apache/spark/ExecutorAllocationManager.scala ## @@ -829,12 +868,25 @@ private[spark] class

[GitHub] [spark] rdblue commented on a change in pull request #28993: [SPARK-32168][SQL] Fix hidden partitioning correctness bug in SQL overwrite

2020-07-08 Thread GitBox
rdblue commented on a change in pull request #28993: URL: https://github.com/apache/spark/pull/28993#discussion_r451701120 ## File path: sql/catalyst/src/test/scala/org/apache/spark/sql/connector/InMemoryTable.scala ## @@ -78,10 +92,44 @@ class InMemoryTable(

[GitHub] [spark] mridulm commented on a change in pull request #28287: [SPARK-31418][SCHEDULER] Request more executors in case of dynamic allocation is enabled and a task becomes unschedulable due to

2020-07-08 Thread GitBox
mridulm commented on a change in pull request #28287: URL: https://github.com/apache/spark/pull/28287#discussion_r451701402 ## File path: core/src/main/scala/org/apache/spark/ExecutorAllocationManager.scala ## @@ -829,12 +868,25 @@ private[spark] class

[GitHub] [spark] SparkQA removed a comment on pull request #29041: [SPARK-20680][SQL][FOLLOW-UP] Revert NullType.simpleString from 'unknown' to 'null'

2020-07-08 Thread GitBox
SparkQA removed a comment on pull request #29041: URL: https://github.com/apache/spark/pull/29041#issuecomment-655540157 **[Test build #125367 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125367/testReport)** for PR 29041 at commit

[GitHub] [spark] viirya commented on pull request #29017: [SPARK-32233][TESTS] Disable SBT unidoc generation testing in Jenkins

2020-07-08 Thread GitBox
viirya commented on pull request #29017: URL: https://github.com/apache/spark/pull/29017#issuecomment-655652266 Looks okay as Github Actions have documentation generation. This is an automated message from the Apache Git

[GitHub] [spark] SparkQA removed a comment on pull request #28975: [SPARK-32148][SS] Fix stream-stream join issue on missing to copy reused unsafe row

2020-07-08 Thread GitBox
SparkQA removed a comment on pull request #28975: URL: https://github.com/apache/spark/pull/28975#issuecomment-655464967 **[Test build #125352 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125352/testReport)** for PR 28975 at commit

[GitHub] [spark] SparkQA commented on pull request #29041: [SPARK-20680][SQL][FOLLOW-UP] Revert NullType.simpleString from 'unknown' to 'null'

2020-07-08 Thread GitBox
SparkQA commented on pull request #29041: URL: https://github.com/apache/spark/pull/29041#issuecomment-655651583 **[Test build #125367 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125367/testReport)** for PR 29041 at commit

[GitHub] [spark] AmplabJenkins commented on pull request #29041: [SPARK-20680][SQL][FOLLOW-UP] Revert NullType.simpleString from 'unknown' to 'null'

2020-07-08 Thread GitBox
AmplabJenkins commented on pull request #29041: URL: https://github.com/apache/spark/pull/29041#issuecomment-655654934 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29022: [SPARK-32207][SQL] Support 'F'-suffixed Float Literals

2020-07-08 Thread GitBox
AmplabJenkins removed a comment on pull request #29022: URL: https://github.com/apache/spark/pull/29022#issuecomment-655653612 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] cloud-fan commented on pull request #29022: [SPARK-32207][SQL] Support 'F'-suffixed Float Literals

2020-07-08 Thread GitBox
cloud-fan commented on pull request #29022: URL: https://github.com/apache/spark/pull/29022#issuecomment-655662517 retest this please This is an automated message from the Apache Git Service. To respond to the message,

[GitHub] [spark] cloud-fan commented on pull request #28975: [SPARK-32148][SS] Fix stream-stream join issue on missing to copy reused unsafe row

2020-07-08 Thread GitBox
cloud-fan commented on pull request #28975: URL: https://github.com/apache/spark/pull/28975#issuecomment-655662643 retest this please This is an automated message from the Apache Git Service. To respond to the message,

[GitHub] [spark] SparkQA commented on pull request #28975: [SPARK-32148][SS] Fix stream-stream join issue on missing to copy reused unsafe row

2020-07-08 Thread GitBox
SparkQA commented on pull request #28975: URL: https://github.com/apache/spark/pull/28975#issuecomment-655669114 **[Test build #125389 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125389/testReport)** for PR 28975 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29026: [SPARK-28067][SPARK-32018] Fix decimal overflow issues

2020-07-08 Thread GitBox
AmplabJenkins removed a comment on pull request #29026: URL: https://github.com/apache/spark/pull/29026#issuecomment-655671423 Merged build finished. Test FAILed. This is an automated message from the Apache Git Service. To

[GitHub] [spark] SparkQA removed a comment on pull request #29020: [SPARK-23431][CORE] Expose stage level peak executor metrics via REST API

2020-07-08 Thread GitBox
SparkQA removed a comment on pull request #29020: URL: https://github.com/apache/spark/pull/29020#issuecomment-655645654 **[Test build #125387 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125387/testReport)** for PR 29020 at commit

[GitHub] [spark] AmplabJenkins commented on pull request #29026: [SPARK-28067][SPARK-32018] Fix decimal overflow issues

2020-07-08 Thread GitBox
AmplabJenkins commented on pull request #29026: URL: https://github.com/apache/spark/pull/29026#issuecomment-655671423 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] SparkQA commented on pull request #29020: [SPARK-23431][CORE] Expose stage level peak executor metrics via REST API

2020-07-08 Thread GitBox
SparkQA commented on pull request #29020: URL: https://github.com/apache/spark/pull/29020#issuecomment-655671480 **[Test build #125387 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125387/testReport)** for PR 29020 at commit

[GitHub] [spark] SparkQA removed a comment on pull request #29026: [SPARK-28067][SPARK-32018] Fix decimal overflow issues

2020-07-08 Thread GitBox
SparkQA removed a comment on pull request #29026: URL: https://github.com/apache/spark/pull/29026#issuecomment-655610793 **[Test build #125383 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125383/testReport)** for PR 29026 at commit

[GitHub] [spark] SparkQA removed a comment on pull request #28926: [SPARK-32133][SQL] Forbid time field steps for date start/end in Sequence

2020-07-08 Thread GitBox
SparkQA removed a comment on pull request #28926: URL: https://github.com/apache/spark/pull/28926#issuecomment-655486625 **[Test build #125358 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125358/testReport)** for PR 28926 at commit

[GitHub] [spark] frankyin-factual commented on a change in pull request #28898: [SPARK-32059][SQL] Allow nested schema pruning thru window/sort/filter plans

2020-07-08 Thread GitBox
frankyin-factual commented on a change in pull request #28898: URL: https://github.com/apache/spark/pull/28898#discussion_r451738919 ## File path: sql/catalyst/src/test/scala/org/apache/spark/sql/catalyst/optimizer/NestedColumnAliasingSuite.scala ## @@ -493,6 +491,156 @@

[GitHub] [spark] SparkQA commented on pull request #29036: [WIP][SPARK-XXXXX][SQL] CliSuite flakiness fix via differentiating cli driver bootup timeout and query execution timeout

2020-07-08 Thread GitBox
SparkQA commented on pull request #29036: URL: https://github.com/apache/spark/pull/29036#issuecomment-655683380 **[Test build #125348 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125348/testReport)** for PR 29036 at commit

[GitHub] [spark] SparkQA removed a comment on pull request #29036: [WIP][SPARK-XXXXX][SQL] CliSuite flakiness fix via differentiating cli driver bootup timeout and query execution timeout

2020-07-08 Thread GitBox
SparkQA removed a comment on pull request #29036: URL: https://github.com/apache/spark/pull/29036#issuecomment-655451278 **[Test build #125348 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125348/testReport)** for PR 29036 at commit

[GitHub] [spark] SparkQA removed a comment on pull request #29020: [SPARK-23431][CORE] Expose stage level peak executor metrics via REST API

2020-07-08 Thread GitBox
SparkQA removed a comment on pull request #29020: URL: https://github.com/apache/spark/pull/29020#issuecomment-655673884 **[Test build #125390 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125390/testReport)** for PR 29020 at commit

[GitHub] [spark] AmplabJenkins commented on pull request #29020: [SPARK-23431][CORE] Expose stage level peak executor metrics via REST API

2020-07-08 Thread GitBox
AmplabJenkins commented on pull request #29020: URL: https://github.com/apache/spark/pull/29020#issuecomment-655687062 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] SparkQA commented on pull request #29020: [SPARK-23431][CORE] Expose stage level peak executor metrics via REST API

2020-07-08 Thread GitBox
SparkQA commented on pull request #29020: URL: https://github.com/apache/spark/pull/29020#issuecomment-655686919 **[Test build #125390 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125390/testReport)** for PR 29020 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29020: [SPARK-23431][CORE] Expose stage level peak executor metrics via REST API

2020-07-08 Thread GitBox
AmplabJenkins removed a comment on pull request #29020: URL: https://github.com/apache/spark/pull/29020#issuecomment-655687062 Merged build finished. Test FAILed. This is an automated message from the Apache Git Service. To

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29020: [SPARK-23431][CORE] Expose stage level peak executor metrics via REST API

2020-07-08 Thread GitBox
AmplabJenkins removed a comment on pull request #29020: URL: https://github.com/apache/spark/pull/29020#issuecomment-655687072 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28986: [SPARK-32160][CORE][PYSPARK] Disallow to create SparkContext in executors.

2020-07-08 Thread GitBox
AmplabJenkins removed a comment on pull request #28986: URL: https://github.com/apache/spark/pull/28986#issuecomment-655693008 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] dongjoon-hyun commented on pull request #28859: [SPARK-32024][WEBUI] Update ApplicationStoreInfo.size during HistoryServerDiskManager initializing

2020-07-08 Thread GitBox
dongjoon-hyun commented on pull request #28859: URL: https://github.com/apache/spark/pull/28859#issuecomment-655703992 If `branch-3.0` is broken, `master` branch also looks suspicious. This is an automated message from the

[GitHub] [spark] dongjoon-hyun removed a comment on pull request #28859: [SPARK-32024][WEBUI] Update ApplicationStoreInfo.size during HistoryServerDiskManager initializing

2020-07-08 Thread GitBox
dongjoon-hyun removed a comment on pull request #28859: URL: https://github.com/apache/spark/pull/28859#issuecomment-655703992 If `branch-3.0` is broken, `master` branch also looks suspicious. This is an automated message

[GitHub] [spark] SparkQA commented on pull request #29040: [SPARK-32230][R][INFRA] Use Hadoop 2.7 profile in AppVeyor SparkR build

2020-07-08 Thread GitBox
SparkQA commented on pull request #29040: URL: https://github.com/apache/spark/pull/29040#issuecomment-655707560 **[Test build #125362 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125362/testReport)** for PR 29040 at commit

[GitHub] [spark] SparkQA removed a comment on pull request #29040: [SPARK-32230][R][INFRA] Use Hadoop 2.7 profile in AppVeyor SparkR build

2020-07-08 Thread GitBox
SparkQA removed a comment on pull request #29040: URL: https://github.com/apache/spark/pull/29040#issuecomment-655500364 **[Test build #125362 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125362/testReport)** for PR 29040 at commit

[GitHub] [spark] AmplabJenkins commented on pull request #28804: [SPARK-31973][SQL] Add ability to disable Sort,Spill in Partial aggregation

2020-07-08 Thread GitBox
AmplabJenkins commented on pull request #28804: URL: https://github.com/apache/spark/pull/28804#issuecomment-655708033 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28979: [SPARK-32154][SQL] Use ExpressionEncoder for the return type of ScalaUDF to convert to catalyst type

2020-07-08 Thread GitBox
AmplabJenkins removed a comment on pull request #28979: URL: https://github.com/apache/spark/pull/28979#issuecomment-655718238 Merged build finished. Test FAILed. This is an automated message from the Apache Git Service. To

[GitHub] [spark] AmplabJenkins commented on pull request #28979: [SPARK-32154][SQL] Use ExpressionEncoder for the return type of ScalaUDF to convert to catalyst type

2020-07-08 Thread GitBox
AmplabJenkins commented on pull request #28979: URL: https://github.com/apache/spark/pull/28979#issuecomment-655718238 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins commented on pull request #29045: [SPARK-32234] Spark sql commands are failing on selecting the orc tables

2020-07-08 Thread GitBox
AmplabJenkins commented on pull request #29045: URL: https://github.com/apache/spark/pull/29045#issuecomment-655718245 Can one of the admins verify this patch? This is an automated message from the Apache Git Service. To

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29045: [SPARK-32234] Spark sql commands are failing on selecting the orc tables

2020-07-08 Thread GitBox
AmplabJenkins removed a comment on pull request #29045: URL: https://github.com/apache/spark/pull/29045#issuecomment-655717757 Can one of the admins verify this patch? This is an automated message from the Apache Git

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28979: [SPARK-32154][SQL] Use ExpressionEncoder for the return type of ScalaUDF to convert to catalyst type

2020-07-08 Thread GitBox
AmplabJenkins removed a comment on pull request #28979: URL: https://github.com/apache/spark/pull/28979#issuecomment-655718249 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28975: [SPARK-32148][SS] Fix stream-stream join issue on missing to copy reused unsafe row

2020-07-08 Thread GitBox
AmplabJenkins removed a comment on pull request #28975: URL: https://github.com/apache/spark/pull/28975#issuecomment-655652588 Merged build finished. Test FAILed. This is an automated message from the Apache Git Service. To

[GitHub] [spark] SparkQA commented on pull request #29022: [SPARK-32207][SQL] Support 'F'-suffixed Float Literals

2020-07-08 Thread GitBox
SparkQA commented on pull request #29022: URL: https://github.com/apache/spark/pull/29022#issuecomment-655652999 **[Test build #125384 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125384/testReport)** for PR 29022 at commit

[GitHub] [spark] AmplabJenkins commented on pull request #28975: [SPARK-32148][SS] Fix stream-stream join issue on missing to copy reused unsafe row

2020-07-08 Thread GitBox
AmplabJenkins commented on pull request #28975: URL: https://github.com/apache/spark/pull/28975#issuecomment-655652588 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] yaooqinn commented on pull request #29022: [SPARK-32207][SQL] Support 'F'-suffixed Float Literals

2020-07-08 Thread GitBox
yaooqinn commented on pull request #29022: URL: https://github.com/apache/spark/pull/29022#issuecomment-655663382 retest this please This is an automated message from the Apache Git Service. To respond to the message, please

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28975: [SPARK-32148][SS] Fix stream-stream join issue on missing to copy reused unsafe row

2020-07-08 Thread GitBox
AmplabJenkins removed a comment on pull request #28975: URL: https://github.com/apache/spark/pull/28975#issuecomment-655663226 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins commented on pull request #29022: [SPARK-32207][SQL] Support 'F'-suffixed Float Literals

2020-07-08 Thread GitBox
AmplabJenkins commented on pull request #29022: URL: https://github.com/apache/spark/pull/29022#issuecomment-655663298 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins commented on pull request #28975: [SPARK-32148][SS] Fix stream-stream join issue on missing to copy reused unsafe row

2020-07-08 Thread GitBox
AmplabJenkins commented on pull request #28975: URL: https://github.com/apache/spark/pull/28975#issuecomment-655663226 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] sarutak commented on pull request #29002: [SPARK-32175][CORE] Fix the order between initialization for ExecutorPlugin and starting heartbeat thread

2020-07-08 Thread GitBox
sarutak commented on pull request #29002: URL: https://github.com/apache/spark/pull/29002#issuecomment-655667994 @Ngone51 >Is this from a real issue? > >Shall we do the same thing for DriverPlugin or we already did? It happens not in the production but an environment for

[GitHub] [spark] sarutak edited a comment on pull request #29002: [SPARK-32175][CORE] Fix the order between initialization for ExecutorPlugin and starting heartbeat thread

2020-07-08 Thread GitBox
sarutak edited a comment on pull request #29002: URL: https://github.com/apache/spark/pull/29002#issuecomment-655667994 @Ngone51 >Is this from a real issue? > >Shall we do the same thing for DriverPlugin or we already did? It happens not in the production but an environment

[GitHub] [spark] onzo-mateuszzakarczemny commented on a change in pull request #29023: local_connect_and_auth takes 2 arguments, 3 given

2020-07-08 Thread GitBox
onzo-mateuszzakarczemny commented on a change in pull request #29023: URL: https://github.com/apache/spark/pull/29023#discussion_r451726044 ## File path: python/pyspark/rdd.py ## @@ -141,7 +141,9 @@ def _parse_memory(s): def _load_from_socket(sock_info, serializer): -

[GitHub] [spark] SparkQA commented on pull request #29026: [SPARK-28067][SPARK-32018] Fix decimal overflow issues

2020-07-08 Thread GitBox
SparkQA commented on pull request #29026: URL: https://github.com/apache/spark/pull/29026#issuecomment-655670872 **[Test build #125383 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125383/testReport)** for PR 29026 at commit

[GitHub] [spark] onzo-mateuszzakarczemny commented on a change in pull request #29023: local_connect_and_auth takes 2 arguments, 3 given

2020-07-08 Thread GitBox
onzo-mateuszzakarczemny commented on a change in pull request #29023: URL: https://github.com/apache/spark/pull/29023#discussion_r451734489 ## File path: python/pyspark/rdd.py ## @@ -141,7 +141,9 @@ def _parse_memory(s): def _load_from_socket(sock_info, serializer): -

[GitHub] [spark] SparkQA commented on pull request #28926: [SPARK-32133][SQL] Forbid time field steps for date start/end in Sequence

2020-07-08 Thread GitBox
SparkQA commented on pull request #28926: URL: https://github.com/apache/spark/pull/28926#issuecomment-655675946 **[Test build #125358 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125358/testReport)** for PR 28926 at commit

[GitHub] [spark] SparkQA commented on pull request #29038: [MINOR][INFRA][R] Show the installed packages in R in a prettier way

2020-07-08 Thread GitBox
SparkQA commented on pull request #29038: URL: https://github.com/apache/spark/pull/29038#issuecomment-655680007 **[Test build #125364 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125364/testReport)** for PR 29038 at commit

[GitHub] [spark] SparkQA removed a comment on pull request #29038: [MINOR][INFRA][R] Show the installed packages in R in a prettier way

2020-07-08 Thread GitBox
SparkQA removed a comment on pull request #29038: URL: https://github.com/apache/spark/pull/29038#issuecomment-655500319 **[Test build #125364 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125364/testReport)** for PR 29038 at commit

[GitHub] [spark] dongjoon-hyun edited a comment on pull request #29042: [SPARK-32231][R][INFRA] Use Hadoop 3 winutils in AppVeyor build

2020-07-08 Thread GitBox
dongjoon-hyun edited a comment on pull request #29042: URL: https://github.com/apache/spark/pull/29042#issuecomment-655682673 Hi, @steveloughran . Sorry but, do you know if there is a known issue about Hadoop 3.x on Windows? Does Hadoop support Windows still? Or, is it dropped?

[GitHub] [spark] dongjoon-hyun edited a comment on pull request #29042: [SPARK-32231][R][INFRA] Use Hadoop 3 winutils in AppVeyor build

2020-07-08 Thread GitBox
dongjoon-hyun edited a comment on pull request #29042: URL: https://github.com/apache/spark/pull/29042#issuecomment-655682673 Hi, @steveloughran . Sorry, but do you know if there is a known issue about Hadoop 3.x on Windows? Does Hadoop support Windows still? Or, is it dropped?

[GitHub] [spark] dongjoon-hyun commented on pull request #29042: [SPARK-32231][R][INFRA] Use Hadoop 3 winutils in AppVeyor build

2020-07-08 Thread GitBox
dongjoon-hyun commented on pull request #29042: URL: https://github.com/apache/spark/pull/29042#issuecomment-655682673 Hi, @steveloughran . Sorry but, do you know if there is a known issue about Hadoop 3.x on Windows? This

[GitHub] [spark] AmplabJenkins commented on pull request #29036: [WIP][SPARK-XXXXX][SQL] CliSuite flakiness fix via differentiating cli driver bootup timeout and query execution timeout

2020-07-08 Thread GitBox
AmplabJenkins commented on pull request #29036: URL: https://github.com/apache/spark/pull/29036#issuecomment-655688582 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29036: [WIP][SPARK-XXXXX][SQL] CliSuite flakiness fix via differentiating cli driver bootup timeout and query execution timeout

2020-07-08 Thread GitBox
AmplabJenkins removed a comment on pull request #29036: URL: https://github.com/apache/spark/pull/29036#issuecomment-655688582 Merged build finished. Test FAILed. This is an automated message from the Apache Git Service. To

[GitHub] [spark] SparkQA removed a comment on pull request #28986: [SPARK-32160][CORE][PYSPARK] Disallow to create SparkContext in executors.

2020-07-08 Thread GitBox
SparkQA removed a comment on pull request #28986: URL: https://github.com/apache/spark/pull/28986#issuecomment-655475388 **[Test build #125357 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125357/testReport)** for PR 28986 at commit

[GitHub] [spark] dongjoon-hyun commented on pull request #28859: [SPARK-32024][WEBUI] Update ApplicationStoreInfo.size during HistoryServerDiskManager initializing

2020-07-08 Thread GitBox
dongjoon-hyun commented on pull request #28859: URL: https://github.com/apache/spark/pull/28859#issuecomment-655702826 It turns out this breaks `branch-3.0`, too -

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28804: [SPARK-31973][SQL] Add ability to disable Sort,Spill in Partial aggregation

2020-07-08 Thread GitBox
AmplabJenkins removed a comment on pull request #28804: URL: https://github.com/apache/spark/pull/28804#issuecomment-655708560 Merged build finished. Test FAILed. This is an automated message from the Apache Git Service. To

[GitHub] [spark] SparkQA removed a comment on pull request #28804: [SPARK-31973][SQL] Add ability to disable Sort,Spill in Partial aggregation

2020-07-08 Thread GitBox
SparkQA removed a comment on pull request #28804: URL: https://github.com/apache/spark/pull/28804#issuecomment-655707361 **[Test build #125393 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125393/testReport)** for PR 28804 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28804: [SPARK-31973][SQL] Add ability to disable Sort,Spill in Partial aggregation

2020-07-08 Thread GitBox
AmplabJenkins removed a comment on pull request #28804: URL: https://github.com/apache/spark/pull/28804#issuecomment-655708033 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] SparkQA commented on pull request #28804: [SPARK-31973][SQL] Add ability to disable Sort,Spill in Partial aggregation

2020-07-08 Thread GitBox
SparkQA commented on pull request #28804: URL: https://github.com/apache/spark/pull/28804#issuecomment-655708553 **[Test build #125393 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125393/testReport)** for PR 28804 at commit

[GitHub] [spark] AmplabJenkins commented on pull request #28804: [SPARK-31973][SQL] Add ability to disable Sort,Spill in Partial aggregation

2020-07-08 Thread GitBox
AmplabJenkins commented on pull request #28804: URL: https://github.com/apache/spark/pull/28804#issuecomment-655708560 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] SparkQA commented on pull request #28979: [SPARK-32154][SQL] Use ExpressionEncoder for the return type of ScalaUDF to convert to catalyst type

2020-07-08 Thread GitBox
SparkQA commented on pull request #28979: URL: https://github.com/apache/spark/pull/28979#issuecomment-655717426 **[Test build #125386 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125386/testReport)** for PR 28979 at commit

[GitHub] [spark] AmplabJenkins commented on pull request #29045: [SPARK-32234] Spark sql commands are failing on selecting the orc tables

2020-07-08 Thread GitBox
AmplabJenkins commented on pull request #29045: URL: https://github.com/apache/spark/pull/29045#issuecomment-655717757 Can one of the admins verify this patch? This is an automated message from the Apache Git Service. To

[GitHub] [spark] SparkQA removed a comment on pull request #28979: [SPARK-32154][SQL] Use ExpressionEncoder for the return type of ScalaUDF to convert to catalyst type

2020-07-08 Thread GitBox
SparkQA removed a comment on pull request #28979: URL: https://github.com/apache/spark/pull/28979#issuecomment-655633176 **[Test build #125386 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125386/testReport)** for PR 28979 at commit

[GitHub] [spark] AmplabJenkins commented on pull request #29036: [WIP][SPARK-XXXXX][SQL] CliSuite flakiness fix via differentiating cli driver bootup timeout and query execution timeout

2020-07-08 Thread GitBox
AmplabJenkins commented on pull request #29036: URL: https://github.com/apache/spark/pull/29036#issuecomment-655725009 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins commented on pull request #29038: [MINOR][INFRA][R] Show the installed packages in R in a prettier way

2020-07-08 Thread GitBox
AmplabJenkins commented on pull request #29038: URL: https://github.com/apache/spark/pull/29038#issuecomment-655724957 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29020: [SPARK-23431][CORE] Expose stage level peak executor metrics via REST API

2020-07-08 Thread GitBox
AmplabJenkins removed a comment on pull request #29020: URL: https://github.com/apache/spark/pull/29020#issuecomment-655614445 Test FAILed. Refer to this link for build results (access rights to CI server needed):

<    4   5   6   7   8   9   10   11   12   13   >