[GitHub] [spark] AmplabJenkins removed a comment on pull request #29020: [SPARK-23431][CORE] Expose stage level peak executor metrics via REST API

2020-07-10 Thread GitBox
AmplabJenkins removed a comment on pull request #29020: URL: https://github.com/apache/spark/pull/29020#issuecomment-656904327 Merged build finished. Test FAILed. This is an automated message from the Apache Git Service. To

[GitHub] [spark] AmplabJenkins commented on pull request #29020: [SPARK-23431][CORE] Expose stage level peak executor metrics via REST API

2020-07-10 Thread GitBox
AmplabJenkins commented on pull request #29020: URL: https://github.com/apache/spark/pull/29020#issuecomment-656904327 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] SparkQA removed a comment on pull request #29020: [SPARK-23431][CORE] Expose stage level peak executor metrics via REST API

2020-07-10 Thread GitBox
SparkQA removed a comment on pull request #29020: URL: https://github.com/apache/spark/pull/29020#issuecomment-656854394 **[Test build #125636 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125636/testReport)** for PR 29020 at commit

[GitHub] [spark] SparkQA commented on pull request #29020: [SPARK-23431][CORE] Expose stage level peak executor metrics via REST API

2020-07-10 Thread GitBox
SparkQA commented on pull request #29020: URL: https://github.com/apache/spark/pull/29020#issuecomment-656903816 **[Test build #125636 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125636/testReport)** for PR 29020 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29067: [SPARK-32274] Make SQL cache serialization pluggable

2020-07-10 Thread GitBox
AmplabJenkins removed a comment on pull request #29067: URL: https://github.com/apache/spark/pull/29067#issuecomment-656900211 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins commented on pull request #29067: [SPARK-32274] Make SQL cache serialization pluggable

2020-07-10 Thread GitBox
AmplabJenkins commented on pull request #29067: URL: https://github.com/apache/spark/pull/29067#issuecomment-656900211 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] revans2 commented on pull request #29067: [SPARK-32274] Make SQL cache serialization pluggable

2020-07-10 Thread GitBox
revans2 commented on pull request #29067: URL: https://github.com/apache/spark/pull/29067#issuecomment-656899609 @tgravescs please take another look and let me know what you think This is an automated message from the Apache

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29057: [SPARK-32245][INFRA] Run Spark tests in Github Actions

2020-07-10 Thread GitBox
AmplabJenkins removed a comment on pull request #29057: URL: https://github.com/apache/spark/pull/29057#issuecomment-656889115 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29050: [SPARK-32238][SQL] Use Utils.getSimpleName to avoid hitting Malformed class name in ScalaUDF

2020-07-10 Thread GitBox
AmplabJenkins removed a comment on pull request #29050: URL: https://github.com/apache/spark/pull/29050#issuecomment-656889118 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins commented on pull request #29050: [SPARK-32238][SQL] Use Utils.getSimpleName to avoid hitting Malformed class name in ScalaUDF

2020-07-10 Thread GitBox
AmplabJenkins commented on pull request #29050: URL: https://github.com/apache/spark/pull/29050#issuecomment-656889118 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins commented on pull request #29057: [SPARK-32245][INFRA] Run Spark tests in Github Actions

2020-07-10 Thread GitBox
AmplabJenkins commented on pull request #29057: URL: https://github.com/apache/spark/pull/29057#issuecomment-656889115 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] SparkQA commented on pull request #29057: [SPARK-32245][INFRA] Run Spark tests in Github Actions

2020-07-10 Thread GitBox
SparkQA commented on pull request #29057: URL: https://github.com/apache/spark/pull/29057#issuecomment-656888602 **[Test build #125640 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125640/testReport)** for PR 29057 at commit

[GitHub] [spark] dongjoon-hyun commented on pull request #29057: [SPARK-32245][INFRA] Run Spark tests in Github Actions

2020-07-10 Thread GitBox
dongjoon-hyun commented on pull request #29057: URL: https://github.com/apache/spark/pull/29057#issuecomment-656888038 Retest this please. This is an automated message from the Apache Git Service. To respond to the message,

[GitHub] [spark] dongjoon-hyun commented on pull request #29050: [SPARK-32238][SQL] Use Utils.getSimpleName to avoid hitting Malformed class name in ScalaUDF

2020-07-10 Thread GitBox
dongjoon-hyun commented on pull request #29050: URL: https://github.com/apache/spark/pull/29050#issuecomment-656887863 Retest this please. This is an automated message from the Apache Git Service. To respond to the message,

[GitHub] [spark] dongjoon-hyun closed pull request #28931: [SPARK-32103][CORE] Support IPv6 host/port in core module

2020-07-10 Thread GitBox
dongjoon-hyun closed pull request #28931: URL: https://github.com/apache/spark/pull/28931 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to

[GitHub] [spark] AmplabJenkins commented on pull request #27366: [SPARK-30648][SQL] Support filters pushdown in JSON datasource

2020-07-10 Thread GitBox
AmplabJenkins commented on pull request #27366: URL: https://github.com/apache/spark/pull/27366#issuecomment-656885978 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28998: [SPARK-32173][SQL] Deduplicate code in FromUTCTimestamp and ToUTCTimestamp

2020-07-10 Thread GitBox
AmplabJenkins removed a comment on pull request #28998: URL: https://github.com/apache/spark/pull/28998#issuecomment-656885994 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins commented on pull request #28998: [SPARK-32173][SQL] Deduplicate code in FromUTCTimestamp and ToUTCTimestamp

2020-07-10 Thread GitBox
AmplabJenkins commented on pull request #28998: URL: https://github.com/apache/spark/pull/28998#issuecomment-656885994 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] SparkQA commented on pull request #27366: [SPARK-30648][SQL] Support filters pushdown in JSON datasource

2020-07-10 Thread GitBox
SparkQA commented on pull request #27366: URL: https://github.com/apache/spark/pull/27366#issuecomment-656885871 **[Test build #125639 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125639/testReport)** for PR 27366 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #27366: [SPARK-30648][SQL] Support filters pushdown in JSON datasource

2020-07-10 Thread GitBox
AmplabJenkins removed a comment on pull request #27366: URL: https://github.com/apache/spark/pull/27366#issuecomment-656885978 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] SparkQA commented on pull request #28998: [SPARK-32173][SQL] Deduplicate code in FromUTCTimestamp and ToUTCTimestamp

2020-07-10 Thread GitBox
SparkQA commented on pull request #28998: URL: https://github.com/apache/spark/pull/28998#issuecomment-656885364 **[Test build #125638 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125638/testReport)** for PR 28998 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29057: [SPARK-32245][INFRA] Run Spark tests in Github Actions

2020-07-10 Thread GitBox
AmplabJenkins removed a comment on pull request #29057: URL: https://github.com/apache/spark/pull/29057#issuecomment-656885061 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on pull request #29057: [SPARK-32245][INFRA] Run Spark tests in Github Actions

2020-07-10 Thread GitBox
AmplabJenkins commented on pull request #29057: URL: https://github.com/apache/spark/pull/29057#issuecomment-656885053 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29057: [SPARK-32245][INFRA] Run Spark tests in Github Actions

2020-07-10 Thread GitBox
AmplabJenkins removed a comment on pull request #29057: URL: https://github.com/apache/spark/pull/29057#issuecomment-656885053 Merged build finished. Test FAILed. This is an automated message from the Apache Git Service. To

[GitHub] [spark] SparkQA commented on pull request #29057: [SPARK-32245][INFRA] Run Spark tests in Github Actions

2020-07-10 Thread GitBox
SparkQA commented on pull request #29057: URL: https://github.com/apache/spark/pull/29057#issuecomment-656884190 **[Test build #125628 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125628/testReport)** for PR 29057 at commit

[GitHub] [spark] SparkQA removed a comment on pull request #29057: [SPARK-32245][INFRA] Run Spark tests in Github Actions

2020-07-10 Thread GitBox
SparkQA removed a comment on pull request #29057: URL: https://github.com/apache/spark/pull/29057#issuecomment-656770513 **[Test build #125628 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125628/testReport)** for PR 29057 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29057: [SPARK-32245][INFRA] Run Spark tests in Github Actions

2020-07-10 Thread GitBox
AmplabJenkins removed a comment on pull request #29057: URL: https://github.com/apache/spark/pull/29057#issuecomment-656772429 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] MaxGekk commented on pull request #27366: [SPARK-30648][SQL] Support filters pushdown in JSON datasource

2020-07-10 Thread GitBox
MaxGekk commented on pull request #27366: URL: https://github.com/apache/spark/pull/27366#issuecomment-656883790 jenkins, retest this, please This is an automated message from the Apache Git Service. To respond to the

[GitHub] [spark] MaxGekk commented on pull request #28998: [SPARK-32173][SQL] Deduplicate code in FromUTCTimestamp and ToUTCTimestamp

2020-07-10 Thread GitBox
MaxGekk commented on pull request #28998: URL: https://github.com/apache/spark/pull/28998#issuecomment-656883530 jenkins, retest this, please This is an automated message from the Apache Git Service. To respond to the

[GitHub] [spark] SparkQA commented on pull request #28287: [SPARK-31418][SCHEDULER] Request more executors in case of dynamic allocation is enabled and a task becomes unschedulable due to spark's blac

2020-07-10 Thread GitBox
SparkQA commented on pull request #28287: URL: https://github.com/apache/spark/pull/28287#issuecomment-656882557 **[Test build #125637 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125637/testReport)** for PR 28287 at commit

[GitHub] [spark] AmplabJenkins commented on pull request #28287: [SPARK-31418][SCHEDULER] Request more executors in case of dynamic allocation is enabled and a task becomes unschedulable due to spark'

2020-07-10 Thread GitBox
AmplabJenkins commented on pull request #28287: URL: https://github.com/apache/spark/pull/28287#issuecomment-656880529 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28287: [SPARK-31418][SCHEDULER] Request more executors in case of dynamic allocation is enabled and a task becomes unschedulable due t

2020-07-10 Thread GitBox
AmplabJenkins removed a comment on pull request #28287: URL: https://github.com/apache/spark/pull/28287#issuecomment-656880529 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] tgravescs commented on pull request #28287: [SPARK-31418][SCHEDULER] Request more executors in case of dynamic allocation is enabled and a task becomes unschedulable due to spark's bl

2020-07-10 Thread GitBox
tgravescs commented on pull request #28287: URL: https://github.com/apache/spark/pull/28287#issuecomment-656879502 test this please This is an automated message from the Apache Git Service. To respond to the message, please

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29065: [WIP][SPARK-32268][SQL] Bloom Filter Join

2020-07-10 Thread GitBox
AmplabJenkins removed a comment on pull request #29065: URL: https://github.com/apache/spark/pull/29065#issuecomment-656873810 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29065: [WIP][SPARK-32268][SQL] Bloom Filter Join

2020-07-10 Thread GitBox
AmplabJenkins removed a comment on pull request #29065: URL: https://github.com/apache/spark/pull/29065#issuecomment-656873796 Merged build finished. Test FAILed. This is an automated message from the Apache Git Service. To

[GitHub] [spark] AmplabJenkins commented on pull request #29065: [WIP][SPARK-32268][SQL] Bloom Filter Join

2020-07-10 Thread GitBox
AmplabJenkins commented on pull request #29065: URL: https://github.com/apache/spark/pull/29065#issuecomment-656873796 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] SparkQA removed a comment on pull request #29065: [WIP][SPARK-32268][SQL] Bloom Filter Join

2020-07-10 Thread GitBox
SparkQA removed a comment on pull request #29065: URL: https://github.com/apache/spark/pull/29065#issuecomment-656756847 **[Test build #125627 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125627/testReport)** for PR 29065 at commit

[GitHub] [spark] SparkQA commented on pull request #29065: [WIP][SPARK-32268][SQL] Bloom Filter Join

2020-07-10 Thread GitBox
SparkQA commented on pull request #29065: URL: https://github.com/apache/spark/pull/29065#issuecomment-656873082 **[Test build #125627 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125627/testReport)** for PR 29065 at commit

[GitHub] [spark] venkata91 commented on pull request #28287: [SPARK-31418][SCHEDULER] Request more executors in case of dynamic allocation is enabled and a task becomes unschedulable due to spark's bl

2020-07-10 Thread GitBox
venkata91 commented on pull request #28287: URL: https://github.com/apache/spark/pull/28287#issuecomment-656872295 > **[Test build #125613 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125613/testReport)** for PR 28287 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29050: [SPARK-32238][SQL] Use Utils.getSimpleName to avoid hitting Malformed class name in ScalaUDF

2020-07-10 Thread GitBox
AmplabJenkins removed a comment on pull request #29050: URL: https://github.com/apache/spark/pull/29050#issuecomment-656871395 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on pull request #29050: [SPARK-32238][SQL] Use Utils.getSimpleName to avoid hitting Malformed class name in ScalaUDF

2020-07-10 Thread GitBox
AmplabJenkins commented on pull request #29050: URL: https://github.com/apache/spark/pull/29050#issuecomment-656871382 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29050: [SPARK-32238][SQL] Use Utils.getSimpleName to avoid hitting Malformed class name in ScalaUDF

2020-07-10 Thread GitBox
AmplabJenkins removed a comment on pull request #29050: URL: https://github.com/apache/spark/pull/29050#issuecomment-656871382 Merged build finished. Test FAILed. This is an automated message from the Apache Git Service. To

[GitHub] [spark] tgravescs commented on a change in pull request #29067: [SPARK-32274] Make SQL cache serialization pluggable

2020-07-10 Thread GitBox
tgravescs commented on a change in pull request #29067: URL: https://github.com/apache/spark/pull/29067#discussion_r453009530 ## File path: sql/core/src/main/scala/org/apache/spark/sql/execution/columnar/InMemoryTableScanExec.scala ## @@ -79,46 +77,14 @@ case class

[GitHub] [spark] SparkQA removed a comment on pull request #29050: [SPARK-32238][SQL] Use Utils.getSimpleName to avoid hitting Malformed class name in ScalaUDF

2020-07-10 Thread GitBox
SparkQA removed a comment on pull request #29050: URL: https://github.com/apache/spark/pull/29050#issuecomment-656812490 **[Test build #125631 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125631/testReport)** for PR 29050 at commit

[GitHub] [spark] SparkQA commented on pull request #29050: [SPARK-32238][SQL] Use Utils.getSimpleName to avoid hitting Malformed class name in ScalaUDF

2020-07-10 Thread GitBox
SparkQA commented on pull request #29050: URL: https://github.com/apache/spark/pull/29050#issuecomment-656869941 **[Test build #125631 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125631/testReport)** for PR 29050 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #27366: [SPARK-30648][SQL] Support filters pushdown in JSON datasource

2020-07-10 Thread GitBox
AmplabJenkins removed a comment on pull request #27366: URL: https://github.com/apache/spark/pull/27366#issuecomment-656868790 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on pull request #27366: [SPARK-30648][SQL] Support filters pushdown in JSON datasource

2020-07-10 Thread GitBox
AmplabJenkins removed a comment on pull request #27366: URL: https://github.com/apache/spark/pull/27366#issuecomment-656868783 Merged build finished. Test FAILed. This is an automated message from the Apache Git Service. To

[GitHub] [spark] AmplabJenkins commented on pull request #27366: [SPARK-30648][SQL] Support filters pushdown in JSON datasource

2020-07-10 Thread GitBox
AmplabJenkins commented on pull request #27366: URL: https://github.com/apache/spark/pull/27366#issuecomment-656868783 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] SparkQA commented on pull request #27366: [SPARK-30648][SQL] Support filters pushdown in JSON datasource

2020-07-10 Thread GitBox
SparkQA commented on pull request #27366: URL: https://github.com/apache/spark/pull/27366#issuecomment-656868219 **[Test build #125618 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125618/testReport)** for PR 27366 at commit

[GitHub] [spark] SparkQA removed a comment on pull request #27366: [SPARK-30648][SQL] Support filters pushdown in JSON datasource

2020-07-10 Thread GitBox
SparkQA removed a comment on pull request #27366: URL: https://github.com/apache/spark/pull/27366#issuecomment-656702699 **[Test build #125618 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125618/testReport)** for PR 27366 at commit

[GitHub] [spark] viirya commented on a change in pull request #28996: [SPARK-29358][SQL] Make unionByName optionally fill missing columns with nulls

2020-07-10 Thread GitBox
viirya commented on a change in pull request #28996: URL: https://github.com/apache/spark/pull/28996#discussion_r453054212 ## File path: sql/core/src/main/scala/org/apache/spark/sql/Dataset.scala ## @@ -2030,7 +2030,25 @@ class Dataset[T] private[sql]( * @group typedrel

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29067: [SPARK-32274] Make SQL cache serialization pluggable

2020-07-10 Thread GitBox
AmplabJenkins removed a comment on pull request #29067: URL: https://github.com/apache/spark/pull/29067#issuecomment-656862075 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29067: [SPARK-32274] Make SQL cache serialization pluggable

2020-07-10 Thread GitBox
AmplabJenkins removed a comment on pull request #29067: URL: https://github.com/apache/spark/pull/29067#issuecomment-656862071 Merged build finished. Test FAILed. This is an automated message from the Apache Git Service. To

[GitHub] [spark] SparkQA removed a comment on pull request #29067: [SPARK-32274] Make SQL cache serialization pluggable

2020-07-10 Thread GitBox
SparkQA removed a comment on pull request #29067: URL: https://github.com/apache/spark/pull/29067#issuecomment-656818843 **[Test build #125633 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125633/testReport)** for PR 29067 at commit

[GitHub] [spark] AmplabJenkins commented on pull request #29067: [SPARK-32274] Make SQL cache serialization pluggable

2020-07-10 Thread GitBox
AmplabJenkins commented on pull request #29067: URL: https://github.com/apache/spark/pull/29067#issuecomment-656862071 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] SparkQA commented on pull request #29067: [SPARK-32274] Make SQL cache serialization pluggable

2020-07-10 Thread GitBox
SparkQA commented on pull request #29067: URL: https://github.com/apache/spark/pull/29067#issuecomment-656861989 **[Test build #125633 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125633/testReport)** for PR 29067 at commit

[GitHub] [spark] marmbrus commented on a change in pull request #28996: [SPARK-29358][SQL] Make unionByName optionally fill missing columns with nulls

2020-07-10 Thread GitBox
marmbrus commented on a change in pull request #28996: URL: https://github.com/apache/spark/pull/28996#discussion_r453046549 ## File path: sql/core/src/main/scala/org/apache/spark/sql/Dataset.scala ## @@ -2030,7 +2030,25 @@ class Dataset[T] private[sql]( * @group typedrel

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28931: [SPARK-32103][YARN] Handle IPv6 host/port split in YarnRMClient

2020-07-10 Thread GitBox
AmplabJenkins removed a comment on pull request #28931: URL: https://github.com/apache/spark/pull/28931#issuecomment-656856757 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] viirya commented on pull request #28957: [SPARK-32138] Drop Python 2.7, 3.4 and 3.5

2020-07-10 Thread GitBox
viirya commented on pull request #28957: URL: https://github.com/apache/spark/pull/28957#issuecomment-656856638 Looks good overall. This is an automated message from the Apache Git Service. To respond to the message, please

[GitHub] [spark] AmplabJenkins commented on pull request #28931: [SPARK-32103][YARN] Handle IPv6 host/port split in YarnRMClient

2020-07-10 Thread GitBox
AmplabJenkins commented on pull request #28931: URL: https://github.com/apache/spark/pull/28931#issuecomment-656856757 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] viirya commented on a change in pull request #28957: [SPARK-32138] Drop Python 2.7, 3.4 and 3.5

2020-07-10 Thread GitBox
viirya commented on a change in pull request #28957: URL: https://github.com/apache/spark/pull/28957#discussion_r453042728 ## File path: python/run-tests.py ## @@ -161,7 +157,7 @@ def run_individual_python_test(target_dir, test_name, pyspark_python): def

[GitHub] [spark] AmplabJenkins commented on pull request #29020: [SPARK-23431][CORE] Expose stage level peak executor metrics via REST API

2020-07-10 Thread GitBox
AmplabJenkins commented on pull request #29020: URL: https://github.com/apache/spark/pull/29020#issuecomment-656854737 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29020: [SPARK-23431][CORE] Expose stage level peak executor metrics via REST API

2020-07-10 Thread GitBox
AmplabJenkins removed a comment on pull request #29020: URL: https://github.com/apache/spark/pull/29020#issuecomment-656854737 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] SparkQA commented on pull request #29020: [SPARK-23431][CORE] Expose stage level peak executor metrics via REST API

2020-07-10 Thread GitBox
SparkQA commented on pull request #29020: URL: https://github.com/apache/spark/pull/29020#issuecomment-656854394 **[Test build #125636 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125636/testReport)** for PR 29020 at commit

[GitHub] [spark] SparkQA commented on pull request #28931: [SPARK-32103][YARN] Handle IPv6 host/port split in YarnRMClient

2020-07-10 Thread GitBox
SparkQA commented on pull request #28931: URL: https://github.com/apache/spark/pull/28931#issuecomment-656853891 **[Test build #125609 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125609/testReport)** for PR 28931 at commit

[GitHub] [spark] SparkQA removed a comment on pull request #28931: [SPARK-32103][YARN] Handle IPv6 host/port split in YarnRMClient

2020-07-10 Thread GitBox
SparkQA removed a comment on pull request #28931: URL: https://github.com/apache/spark/pull/28931#issuecomment-656663258 **[Test build #125609 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125609/testReport)** for PR 28931 at commit

[GitHub] [spark] imback82 commented on pull request #29020: [SPARK-23431][CORE] Expose stage level peak executor metrics via REST API

2020-07-10 Thread GitBox
imback82 commented on pull request #29020: URL: https://github.com/apache/spark/pull/29020#issuecomment-656852593 retest this please This is an automated message from the Apache Git Service. To respond to the message, please

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28746: [SPARK-31922][CORE] Fix "RpcEnv already stopped" error when exit spark-shell with local-cluster mode

2020-07-10 Thread GitBox
AmplabJenkins removed a comment on pull request #28746: URL: https://github.com/apache/spark/pull/28746#issuecomment-656849154 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28746: [SPARK-31922][CORE] Fix "RpcEnv already stopped" error when exit spark-shell with local-cluster mode

2020-07-10 Thread GitBox
AmplabJenkins removed a comment on pull request #28746: URL: https://github.com/apache/spark/pull/28746#issuecomment-656849147 Merged build finished. Test FAILed. This is an automated message from the Apache Git Service. To

[GitHub] [spark] AmplabJenkins commented on pull request #28746: [SPARK-31922][CORE] Fix "RpcEnv already stopped" error when exit spark-shell with local-cluster mode

2020-07-10 Thread GitBox
AmplabJenkins commented on pull request #28746: URL: https://github.com/apache/spark/pull/28746#issuecomment-656849147 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29069: [SPARK-31831][SQL][TESTS] Use constructor for mock in HiveSessionImplSuite

2020-07-10 Thread GitBox
AmplabJenkins removed a comment on pull request #29069: URL: https://github.com/apache/spark/pull/29069#issuecomment-656848455 Can one of the admins verify this patch? This is an automated message from the Apache Git

[GitHub] [spark] AmplabJenkins commented on pull request #29069: [SPARK-31831][SQL][TESTS] Use constructor for mock in HiveSessionImplSuite

2020-07-10 Thread GitBox
AmplabJenkins commented on pull request #29069: URL: https://github.com/apache/spark/pull/29069#issuecomment-656848901 Can one of the admins verify this patch? This is an automated message from the Apache Git Service. To

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29068: [SPARK-27892][ML]Saving/loading stages in PipelineModel are parallel

2020-07-10 Thread GitBox
AmplabJenkins removed a comment on pull request #29068: URL: https://github.com/apache/spark/pull/29068#issuecomment-656845987 Can one of the admins verify this patch? This is an automated message from the Apache Git

[GitHub] [spark] AmplabJenkins commented on pull request #29069: [SPARK-31831][SQL][TESTS] Use constructor for mock in HiveSessionImplSuite

2020-07-10 Thread GitBox
AmplabJenkins commented on pull request #29069: URL: https://github.com/apache/spark/pull/29069#issuecomment-656848455 Can one of the admins verify this patch? This is an automated message from the Apache Git Service. To

[GitHub] [spark] AmplabJenkins commented on pull request #29068: [SPARK-27892][ML]Saving/loading stages in PipelineModel are parallel

2020-07-10 Thread GitBox
AmplabJenkins commented on pull request #29068: URL: https://github.com/apache/spark/pull/29068#issuecomment-656848465 Can one of the admins verify this patch? This is an automated message from the Apache Git Service. To

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29024: [WIP][SPARK-32001][SQL]Create JDBC authentication provider developer API

2020-07-10 Thread GitBox
AmplabJenkins removed a comment on pull request #29024: URL: https://github.com/apache/spark/pull/29024#issuecomment-656847216 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] SparkQA removed a comment on pull request #28746: [SPARK-31922][CORE] Fix "RpcEnv already stopped" error when exit spark-shell with local-cluster mode

2020-07-10 Thread GitBox
SparkQA removed a comment on pull request #28746: URL: https://github.com/apache/spark/pull/28746#issuecomment-656709416 **[Test build #125619 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125619/testReport)** for PR 28746 at commit

[GitHub] [spark] frankyin-factual opened a new pull request #29069: [SPARK-31831] Use constructor for mock in HiveSessionImplSuite

2020-07-10 Thread GitBox
frankyin-factual opened a new pull request #29069: URL: https://github.com/apache/spark/pull/29069 ### What changes were proposed in this pull request? Fix flaky test org.apache.spark.sql.hive.thriftserver.HiveSessionImplSuite by using mockito constructor instantiator to avoid

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29024: [WIP][SPARK-32001][SQL]Create JDBC authentication provider developer API

2020-07-10 Thread GitBox
AmplabJenkins removed a comment on pull request #29024: URL: https://github.com/apache/spark/pull/29024#issuecomment-656847208 Merged build finished. Test FAILed. This is an automated message from the Apache Git Service. To

[GitHub] [spark] SparkQA commented on pull request #28746: [SPARK-31922][CORE] Fix "RpcEnv already stopped" error when exit spark-shell with local-cluster mode

2020-07-10 Thread GitBox
SparkQA commented on pull request #28746: URL: https://github.com/apache/spark/pull/28746#issuecomment-656847518 **[Test build #125619 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125619/testReport)** for PR 28746 at commit

[GitHub] [spark] AmplabJenkins commented on pull request #29024: [WIP][SPARK-32001][SQL]Create JDBC authentication provider developer API

2020-07-10 Thread GitBox
AmplabJenkins commented on pull request #29024: URL: https://github.com/apache/spark/pull/29024#issuecomment-656847208 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] SparkQA removed a comment on pull request #29024: [WIP][SPARK-32001][SQL]Create JDBC authentication provider developer API

2020-07-10 Thread GitBox
SparkQA removed a comment on pull request #29024: URL: https://github.com/apache/spark/pull/29024#issuecomment-656723337 **[Test build #125621 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125621/testReport)** for PR 29024 at commit

[GitHub] [spark] AmplabJenkins commented on pull request #29068: [SPARK-27892][ML]Saving/loading stages in PipelineModel are parallel

2020-07-10 Thread GitBox
AmplabJenkins commented on pull request #29068: URL: https://github.com/apache/spark/pull/29068#issuecomment-656845987 Can one of the admins verify this patch? This is an automated message from the Apache Git Service. To

[GitHub] [spark] SparkQA commented on pull request #29024: [WIP][SPARK-32001][SQL]Create JDBC authentication provider developer API

2020-07-10 Thread GitBox
SparkQA commented on pull request #29024: URL: https://github.com/apache/spark/pull/29024#issuecomment-656846044 **[Test build #125621 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125621/testReport)** for PR 29024 at commit

[GitHub] [spark] Moovlin opened a new pull request #29068: [SPARK-27892][ML]Saving/loading stages in PipelineModel are parallel

2020-07-10 Thread GitBox
Moovlin opened a new pull request #29068: URL: https://github.com/apache/spark/pull/29068 This was a dead simple change that I lightly tested to determine if there was actually a performance increase. Turns out, yes there is (at least locally). ### What changes were

[GitHub] [spark] viirya commented on a change in pull request #28957: [SPARK-32138] Drop Python 2.7, 3.4 and 3.5

2020-07-10 Thread GitBox
viirya commented on a change in pull request #28957: URL: https://github.com/apache/spark/pull/28957#discussion_r453018479 ## File path: dev/run-tests.py ## @@ -649,7 +649,7 @@ def main(): # if "DOCS" in changed_modules and test_env == "amplab_jenkins": #

[GitHub] [spark] viirya commented on a change in pull request #28957: [SPARK-32138] Drop Python 2.7, 3.4 and 3.5

2020-07-10 Thread GitBox
viirya commented on a change in pull request #28957: URL: https://github.com/apache/spark/pull/28957#discussion_r453017563 ## File path: dev/lint-python ## @@ -207,7 +207,7 @@ PYTHON_SOURCE="$(find . -name "*.py")" compile_python_test "$PYTHON_SOURCE" pycodestyle_test

[GitHub] [spark] revans2 commented on pull request #29067: [SPARK-32274] Make SQL cache serialization pluggable

2020-07-10 Thread GitBox
revans2 commented on pull request #29067: URL: https://github.com/apache/spark/pull/29067#issuecomment-656824473 I would love to see this go into the 3.1 release. It also applies cleanly to the 3.0 branch if someone wants to pull it in there too. This may look big, but it is mostly

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29066: [WIP][SPARK-23889] DataSourceV2: required sorting and clustering for writes

2020-07-10 Thread GitBox
AmplabJenkins removed a comment on pull request #29066: URL: https://github.com/apache/spark/pull/29066#issuecomment-656822736 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] SparkQA commented on pull request #28412: [SPARK-31608][CORE][WEBUI] Add a new type of KVStore to make loading UI faster

2020-07-10 Thread GitBox
SparkQA commented on pull request #28412: URL: https://github.com/apache/spark/pull/28412#issuecomment-656822532 **[Test build #125635 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125635/testReport)** for PR 28412 at commit

[GitHub] [spark] srowen closed pull request #28389: [SPARK-31592]bufferPoolsBySize in HeapMemoryAllocator should be thread safe

2020-07-10 Thread GitBox
srowen closed pull request #28389: URL: https://github.com/apache/spark/pull/28389 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to

[GitHub] [spark] AmplabJenkins commented on pull request #29066: [WIP][SPARK-23889] DataSourceV2: required sorting and clustering for writes

2020-07-10 Thread GitBox
AmplabJenkins commented on pull request #29066: URL: https://github.com/apache/spark/pull/29066#issuecomment-656822736 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] tgravescs commented on pull request #29067: [SPARK-32274] Make SQL cache serialization pluggable

2020-07-10 Thread GitBox
tgravescs commented on pull request #29067: URL: https://github.com/apache/spark/pull/29067#issuecomment-656822272 @revans2 can you add back in the PR template (### What changes were proposed in this pull request?, Why are the changes needed?, etc) and fill in the sections. that gets put

[GitHub] [spark] SparkQA commented on pull request #29066: [WIP][SPARK-23889] DataSourceV2: required sorting and clustering for writes

2020-07-10 Thread GitBox
SparkQA commented on pull request #29066: URL: https://github.com/apache/spark/pull/29066#issuecomment-656822196 **[Test build #125634 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125634/testReport)** for PR 29066 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #27988: [SPARK-31226][CORE][TEST] SizeBasedCoalesce logic will lose partition

2020-07-10 Thread GitBox
AmplabJenkins removed a comment on pull request #27988: URL: https://github.com/apache/spark/pull/27988#issuecomment-656820311 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] srowen commented on pull request #28850: [SPARK-32015][Core]Remote inheritable thread local variables after spark context is stopped

2020-07-10 Thread GitBox
srowen commented on pull request #28850: URL: https://github.com/apache/spark/pull/28850#issuecomment-656820906 I dunno, this just feels pretty hacky and like it will break things. Is there no other way to avoid holding the reference with soft references, better cleanup? I think this is

[GitHub] [spark] AmplabJenkins commented on pull request #27988: [SPARK-31226][CORE][TEST] SizeBasedCoalesce logic will lose partition

2020-07-10 Thread GitBox
AmplabJenkins commented on pull request #27988: URL: https://github.com/apache/spark/pull/27988#issuecomment-656820309 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins removed a comment on pull request #27988: [SPARK-31226][CORE][TEST] SizeBasedCoalesce logic will lose partition

2020-07-10 Thread GitBox
AmplabJenkins removed a comment on pull request #27988: URL: https://github.com/apache/spark/pull/27988#issuecomment-656820309 Merged build finished. Test FAILed. This is an automated message from the Apache Git Service. To

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29067: [SPARK-32274] Make SQL cache serialization pluggable

2020-07-10 Thread GitBox
AmplabJenkins removed a comment on pull request #29067: URL: https://github.com/apache/spark/pull/29067#issuecomment-656819397 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins commented on pull request #28412: [SPARK-31608][CORE][WEBUI] Add a new type of KVStore to make loading UI faster

2020-07-10 Thread GitBox
AmplabJenkins commented on pull request #28412: URL: https://github.com/apache/spark/pull/28412#issuecomment-656819488 This is an automated message from the Apache Git Service. To respond to the message, please log on to

<    1   2   3   4   5   6   7   8   9   10   >