[GitHub] [spark] SparkQA removed a comment on pull request #28825: [SPARK-32020][SQL][MINOR] Better error message when SPARK_HOME or spark.test.home is not set.

2020-06-17 Thread GitBox
SparkQA removed a comment on pull request #28825: URL: https://github.com/apache/spark/pull/28825#issuecomment-645732367 **[Test build #124190 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/124190/testReport)** for PR 28825 at commit [`d70a2af`](https://gi

[GitHub] [spark] SparkQA commented on pull request #28825: [SPARK-32020][SQL][MINOR] Better error message when SPARK_HOME or spark.test.home is not set.

2020-06-17 Thread GitBox
SparkQA commented on pull request #28825: URL: https://github.com/apache/spark/pull/28825#issuecomment-645820056 **[Test build #124190 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/124190/testReport)** for PR 28825 at commit [`d70a2af`](https://github.co

[GitHub] [spark] cloud-fan commented on a change in pull request #28619: [SPARK-21040][CORE] Speculate tasks which are running on decommission executors

2020-06-17 Thread GitBox
cloud-fan commented on a change in pull request #28619: URL: https://github.com/apache/spark/pull/28619#discussion_r442005198 ## File path: core/src/main/scala/org/apache/spark/internal/config/package.scala ## @@ -1842,6 +1842,17 @@ package object config { .timeConf(Time

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28840: [SPARK-31999][SQL] Add refresh function command

2020-06-17 Thread GitBox
AmplabJenkins removed a comment on pull request #28840: URL: https://github.com/apache/spark/pull/28840#issuecomment-645814833 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/124

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28840: [SPARK-31999][SQL] Add refresh function command

2020-06-17 Thread GitBox
AmplabJenkins removed a comment on pull request #28840: URL: https://github.com/apache/spark/pull/28840#issuecomment-645814827 Merged build finished. Test FAILed. This is an automated message from the Apache Git Service. To r

[GitHub] [spark] AmplabJenkins commented on pull request #28840: [SPARK-31999][SQL] Add refresh function command

2020-06-17 Thread GitBox
AmplabJenkins commented on pull request #28840: URL: https://github.com/apache/spark/pull/28840#issuecomment-645814827 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [spark] SparkQA removed a comment on pull request #28840: [SPARK-31999][SQL] Add refresh function command

2020-06-17 Thread GitBox
SparkQA removed a comment on pull request #28840: URL: https://github.com/apache/spark/pull/28840#issuecomment-645736604 **[Test build #124192 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/124192/testReport)** for PR 28840 at commit [`e444943`](https://gi

[GitHub] [spark] SparkQA commented on pull request #28840: [SPARK-31999][SQL] Add refresh function command

2020-06-17 Thread GitBox
SparkQA commented on pull request #28840: URL: https://github.com/apache/spark/pull/28840#issuecomment-645814371 **[Test build #124192 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/124192/testReport)** for PR 28840 at commit [`e444943`](https://github.co

[GitHub] [spark] gengliangwang commented on pull request #28841: [SPARK-31962][SQL] Provide option to load files after a specified date when reading from a folder path

2020-06-17 Thread GitBox
gengliangwang commented on pull request #28841: URL: https://github.com/apache/spark/pull/28841#issuecomment-645813858 @cchighman I like the idea of such filtering. How about we follow the approach of the option `pathGlobFilter`: https://github.com/apache/spark/pull/24518/files#diff-e458

[GitHub] [spark] dbtsai commented on pull request #28788: [SPARK-31960][Yarn][Build] Only populate Hadoop classpath for no-hadoop build

2020-06-17 Thread GitBox
dbtsai commented on pull request #28788: URL: https://github.com/apache/spark/pull/28788#issuecomment-645808793 retest this please This is an automated message from the Apache Git Service. To respond to the message, please lo

[GitHub] [spark] HyukjinKwon commented on pull request #26440: [SPARK-20628][CORE][K8S] Start to improve Spark decommissioning & preemption support

2020-06-17 Thread GitBox
HyukjinKwon commented on pull request #26440: URL: https://github.com/apache/spark/pull/26440#issuecomment-645806480 @holdenk, do you refer this [Initial Decom PR for Spark 3](http://apache-spark-developers-list.1001551.n3.nabble.com/Initial-Decom-PR-for-Spark-3-td28821.html)? It has one r

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28707: [SPARK-31894][SS] Introduce UnsafeRow format validation for streaming state store

2020-06-17 Thread GitBox
AmplabJenkins removed a comment on pull request #28707: URL: https://github.com/apache/spark/pull/28707#issuecomment-645804908 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins commented on pull request #28707: [SPARK-31894][SS] Introduce UnsafeRow format validation for streaming state store

2020-06-17 Thread GitBox
AmplabJenkins commented on pull request #28707: URL: https://github.com/apache/spark/pull/28707#issuecomment-645804908 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [spark] SparkQA removed a comment on pull request #28707: [SPARK-31894][SS] Introduce UnsafeRow format validation for streaming state store

2020-06-17 Thread GitBox
SparkQA removed a comment on pull request #28707: URL: https://github.com/apache/spark/pull/28707#issuecomment-645715888 **[Test build #124186 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/124186/testReport)** for PR 28707 at commit [`557eb30`](https://gi

[GitHub] [spark] SparkQA commented on pull request #28707: [SPARK-31894][SS] Introduce UnsafeRow format validation for streaming state store

2020-06-17 Thread GitBox
SparkQA commented on pull request #28707: URL: https://github.com/apache/spark/pull/28707#issuecomment-645804113 **[Test build #124186 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/124186/testReport)** for PR 28707 at commit [`557eb30`](https://github.co

[GitHub] [spark] AngersZhuuuu closed pull request #28836: [SPARK-31561][SQL] Add QUALIFY Clause

2020-06-17 Thread GitBox
AngersZh closed pull request #28836: URL: https://github.com/apache/spark/pull/28836 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to g

[GitHub] [spark] AngersZhuuuu commented on pull request #28836: [SPARK-31561][SQL] Add QUALIFY Clause

2020-06-17 Thread GitBox
AngersZh commented on pull request #28836: URL: https://github.com/apache/spark/pull/28836#issuecomment-645802129 > @AngersZh Agree on what @bart-samwel said. Maybe we can revisit this in future? Let us first close this PR? OK, close it.

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28804: [SPARK-31973][SQL] Add ability to disable Sort,Spill in Partial aggregation

2020-06-17 Thread GitBox
AmplabJenkins removed a comment on pull request #28804: URL: https://github.com/apache/spark/pull/28804#issuecomment-645800603 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/124

[GitHub] [spark] SparkQA removed a comment on pull request #28804: [SPARK-31973][SQL] Add ability to disable Sort,Spill in Partial aggregation

2020-06-17 Thread GitBox
SparkQA removed a comment on pull request #28804: URL: https://github.com/apache/spark/pull/28804#issuecomment-645780769 **[Test build #124199 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/124199/testReport)** for PR 28804 at commit [`2b3704b`](https://gi

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28804: [SPARK-31973][SQL] Add ability to disable Sort,Spill in Partial aggregation

2020-06-17 Thread GitBox
AmplabJenkins removed a comment on pull request #28804: URL: https://github.com/apache/spark/pull/28804#issuecomment-645800594 Merged build finished. Test FAILed. This is an automated message from the Apache Git Service. To r

[GitHub] [spark] dbtsai commented on pull request #28788: [SPARK-31960][Yarn][Build] Only populate Hadoop classpath for no-hadoop build

2020-06-17 Thread GitBox
dbtsai commented on pull request #28788: URL: https://github.com/apache/spark/pull/28788#issuecomment-645800313 Merged into master as previous build works, and no actual code change in the last commit. Thank you all for reviewing. --

[GitHub] [spark] AmplabJenkins commented on pull request #28804: [SPARK-31973][SQL] Add ability to disable Sort,Spill in Partial aggregation

2020-06-17 Thread GitBox
AmplabJenkins commented on pull request #28804: URL: https://github.com/apache/spark/pull/28804#issuecomment-645800594 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [spark] SparkQA commented on pull request #28804: [SPARK-31973][SQL] Add ability to disable Sort,Spill in Partial aggregation

2020-06-17 Thread GitBox
SparkQA commented on pull request #28804: URL: https://github.com/apache/spark/pull/28804#issuecomment-645800455 **[Test build #124199 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/124199/testReport)** for PR 28804 at commit [`2b3704b`](https://github.co

[GitHub] [spark] MaxGekk commented on pull request #27366: [SPARK-30648][SQL] Support filters pushdown in JSON datasource

2020-06-17 Thread GitBox
MaxGekk commented on pull request #27366: URL: https://github.com/apache/spark/pull/27366#issuecomment-64586 @HyukjinKwon @dongjoon-hyun @cloud-fan Can we continue with this PR? This is an automated message from the Apach

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28788: [SPARK-31960][Yarn][Build] Only populate Hadoop classpath for no-hadoop build

2020-06-17 Thread GitBox
AmplabJenkins removed a comment on pull request #28788: URL: https://github.com/apache/spark/pull/28788#issuecomment-645799277 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/124

[GitHub] [spark] AmplabJenkins commented on pull request #28788: [SPARK-31960][Yarn][Build] Only populate Hadoop classpath for no-hadoop build

2020-06-17 Thread GitBox
AmplabJenkins commented on pull request #28788: URL: https://github.com/apache/spark/pull/28788#issuecomment-645799265 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [spark] HyukjinKwon commented on pull request #28817: [WIP][SPARK-31197][CORE] Exit the executor once all tasks and migrations are finished built on top of on top of spark20629

2020-06-17 Thread GitBox
HyukjinKwon commented on pull request #28817: URL: https://github.com/apache/spark/pull/28817#issuecomment-645799419 cc @tgravescs too FYI This is an automated message from the Apache Git Service. To respond to the message, p

[GitHub] [spark] MaxGekk commented on pull request #27617: [SPARK-30865][SQL] Refactor DateTimeUtils

2020-06-17 Thread GitBox
MaxGekk commented on pull request #27617: URL: https://github.com/apache/spark/pull/27617#issuecomment-645799479 @cloud-fan @HyukjinKwon It is ready already. Can we continue with this PR? This is an automated message from the

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28788: [SPARK-31960][Yarn][Build] Only populate Hadoop classpath for no-hadoop build

2020-06-17 Thread GitBox
AmplabJenkins removed a comment on pull request #28788: URL: https://github.com/apache/spark/pull/28788#issuecomment-645798681 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] dbtsai closed pull request #28788: [SPARK-31960][Yarn][Build] Only populate Hadoop classpath for no-hadoop build

2020-06-17 Thread GitBox
dbtsai closed pull request #28788: URL: https://github.com/apache/spark/pull/28788 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to t

[GitHub] [spark] SparkQA removed a comment on pull request #28788: [SPARK-31960][Yarn][Build] Only populate Hadoop classpath for no-hadoop build

2020-06-17 Thread GitBox
SparkQA removed a comment on pull request #28788: URL: https://github.com/apache/spark/pull/28788#issuecomment-645798134 **[Test build #124200 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/124200/testReport)** for PR 28788 at commit [`c224152`](https://gi

[GitHub] [spark] SparkQA commented on pull request #28788: [SPARK-31960][Yarn][Build] Only populate Hadoop classpath for no-hadoop build

2020-06-17 Thread GitBox
SparkQA commented on pull request #28788: URL: https://github.com/apache/spark/pull/28788#issuecomment-645799254 **[Test build #124200 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/124200/testReport)** for PR 28788 at commit [`c224152`](https://github.co

[GitHub] [spark] AmplabJenkins commented on pull request #28788: [SPARK-31960][Yarn][Build] Only populate Hadoop classpath for no-hadoop build

2020-06-17 Thread GitBox
AmplabJenkins commented on pull request #28788: URL: https://github.com/apache/spark/pull/28788#issuecomment-645798681 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [spark] SparkQA commented on pull request #28788: [SPARK-31960][Yarn][Build] Only populate Hadoop classpath for no-hadoop build

2020-06-17 Thread GitBox
SparkQA commented on pull request #28788: URL: https://github.com/apache/spark/pull/28788#issuecomment-645798134 **[Test build #124200 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/124200/testReport)** for PR 28788 at commit [`c224152`](https://github.com

[GitHub] [spark] dbtsai commented on a change in pull request #28788: [SPARK-31960][Yarn][Build] Only populate Hadoop classpath for no-hadoop build

2020-06-17 Thread GitBox
dbtsai commented on a change in pull request #28788: URL: https://github.com/apache/spark/pull/28788#discussion_r441986877 ## File path: resource-managers/yarn/src/main/scala/org/apache/spark/deploy/yarn/config.scala ## @@ -74,10 +76,11 @@ package object config { .doc("Wh

[GitHub] [spark] dbtsai commented on a change in pull request #28788: [SPARK-31960][Yarn][Build] Only populate Hadoop classpath for no-hadoop build

2020-06-17 Thread GitBox
dbtsai commented on a change in pull request #28788: URL: https://github.com/apache/spark/pull/28788#discussion_r441986680 ## File path: docs/running-on-yarn.md ## @@ -82,6 +82,19 @@ In `cluster` mode, the driver runs on a different machine than the client, so `S Running Sp

[GitHub] [spark] HyukjinKwon commented on pull request #28818: [WIP][SPARK-31198][CORE] Use graceful decommissioning as part of dynamic scaling

2020-06-17 Thread GitBox
HyukjinKwon commented on pull request #28818: URL: https://github.com/apache/spark/pull/28818#issuecomment-645796051 cc @tgravescs too This is an automated message from the Apache Git Service. To respond to the message, pleas

[GitHub] [spark] dbtsai commented on a change in pull request #28788: [SPARK-31960][Yarn][Build] Only populate Hadoop classpath for no-hadoop build

2020-06-17 Thread GitBox
dbtsai commented on a change in pull request #28788: URL: https://github.com/apache/spark/pull/28788#discussion_r441985622 ## File path: docs/running-on-yarn.md ## @@ -82,6 +82,19 @@ In `cluster` mode, the driver runs on a different machine than the client, so `S Running Sp

[GitHub] [spark] dbtsai commented on a change in pull request #28788: [SPARK-31960][Yarn][Build] Only populate Hadoop classpath for no-hadoop build

2020-06-17 Thread GitBox
dbtsai commented on a change in pull request #28788: URL: https://github.com/apache/spark/pull/28788#discussion_r441985622 ## File path: docs/running-on-yarn.md ## @@ -82,6 +82,19 @@ In `cluster` mode, the driver runs on a different machine than the client, so `S Running Sp

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28804: [SPARK-31973][SQL] Add ability to disable Sort,Spill in Partial aggregation

2020-06-17 Thread GitBox
AmplabJenkins removed a comment on pull request #28804: URL: https://github.com/apache/spark/pull/28804#issuecomment-645781069 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins commented on pull request #28804: [SPARK-31973][SQL] Add ability to disable Sort,Spill in Partial aggregation

2020-06-17 Thread GitBox
AmplabJenkins commented on pull request #28804: URL: https://github.com/apache/spark/pull/28804#issuecomment-645781069 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [spark] SparkQA commented on pull request #28804: [SPARK-31973][SQL] Add ability to disable Sort,Spill in Partial aggregation

2020-06-17 Thread GitBox
SparkQA commented on pull request #28804: URL: https://github.com/apache/spark/pull/28804#issuecomment-645780769 **[Test build #124199 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/124199/testReport)** for PR 28804 at commit [`2b3704b`](https://github.com

[GitHub] [spark] karuppayya commented on a change in pull request #28804: [SPARK-31973][SQL] Add ability to disable Sort,Spill in Partial aggregation

2020-06-17 Thread GitBox
karuppayya commented on a change in pull request #28804: URL: https://github.com/apache/spark/pull/28804#discussion_r441974540 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/internal/SQLConf.scala ## @@ -2173,6 +2173,13 @@ object SQLConf { .checkValue(bi

[GitHub] [spark] karuppayya commented on a change in pull request #28804: [SPARK-31973][SQL] Add ability to disable Sort,Spill in Partial aggregation

2020-06-17 Thread GitBox
karuppayya commented on a change in pull request #28804: URL: https://github.com/apache/spark/pull/28804#discussion_r441974438 ## File path: sql/core/src/main/scala/org/apache/spark/sql/execution/aggregate/HashAggregateExec.scala ## @@ -72,6 +74,8 @@ case class HashAggregateEx

[GitHub] [spark] karuppayya commented on pull request #28804: [SPARK-31973][SQL] Add ability to disable Sort,Spill in Partial aggregation

2020-06-17 Thread GitBox
karuppayya commented on pull request #28804: URL: https://github.com/apache/spark/pull/28804#issuecomment-645779303 @maropu @cloud-fan Can you please add me to the whitelist to trigger the tests? This is an automated message

[GitHub] [spark] prakharjain09 commented on a change in pull request #28619: [SPARK-21040][CORE] Speculate tasks which are running on decommission executors

2020-06-17 Thread GitBox
prakharjain09 commented on a change in pull request #28619: URL: https://github.com/apache/spark/pull/28619#discussion_r441973394 ## File path: core/src/main/scala/org/apache/spark/internal/config/package.scala ## @@ -1842,6 +1842,17 @@ package object config { .timeConf(

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28804: [SPARK-31973][SQL] Add ability to disable Sort,Spill in Partial aggregation

2020-06-17 Thread GitBox
AmplabJenkins removed a comment on pull request #28804: URL: https://github.com/apache/spark/pull/28804#issuecomment-645778573 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins commented on pull request #28804: [SPARK-31973][SQL] Add ability to disable Sort,Spill in Partial aggregation

2020-06-17 Thread GitBox
AmplabJenkins commented on pull request #28804: URL: https://github.com/apache/spark/pull/28804#issuecomment-645778573 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28710: [SPARK-31893][ML] Add a generic ClassificationSummary trait

2020-06-17 Thread GitBox
AmplabJenkins removed a comment on pull request #28710: URL: https://github.com/apache/spark/pull/28710#issuecomment-645776165 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins commented on pull request #28710: [SPARK-31893][ML] Add a generic ClassificationSummary trait

2020-06-17 Thread GitBox
AmplabJenkins commented on pull request #28710: URL: https://github.com/apache/spark/pull/28710#issuecomment-645776165 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [spark] SparkQA commented on pull request #28710: [SPARK-31893][ML] Add a generic ClassificationSummary trait

2020-06-17 Thread GitBox
SparkQA commented on pull request #28710: URL: https://github.com/apache/spark/pull/28710#issuecomment-645775862 **[Test build #124198 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/124198/testReport)** for PR 28710 at commit [`e844c11`](https://github.com

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28710: [SPARK-31893][ML] Add a generic ClassificationSummary trait

2020-06-17 Thread GitBox
AmplabJenkins removed a comment on pull request #28710: URL: https://github.com/apache/spark/pull/28710#issuecomment-645773820 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8

[GitHub] [spark] huaxingao commented on pull request #28710: [SPARK-31893][ML] Add a generic ClassificationSummary trait

2020-06-17 Thread GitBox
huaxingao commented on pull request #28710: URL: https://github.com/apache/spark/pull/28710#issuecomment-645775168 retest this please This is an automated message from the Apache Git Service. To respond to the message, please

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28825: [SPARK-32020][SQL][MINOR] Better error message when SPARK_HOME or spark.test.home is not set.

2020-06-17 Thread GitBox
AmplabJenkins removed a comment on pull request #28825: URL: https://github.com/apache/spark/pull/28825#issuecomment-645774200 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] huaxingao commented on pull request #28710: [SPARK-31893][ML] Add a generic ClassificationSummary trait

2020-06-17 Thread GitBox
huaxingao commented on pull request #28710: URL: https://github.com/apache/spark/pull/28710#issuecomment-645774417 I moved ```asBinary``` back to ```LogisticRegressionSummary``` to get rid of this ``` ProblemFilters.exclude[IncompatibleResultTypeProblem]("org.apache.spark.ml.classifi

[GitHub] [spark] AmplabJenkins commented on pull request #28852: [SPARK-30616][SQL] Introduce TTL config option for SQL Metadata Cache

2020-06-17 Thread GitBox
AmplabJenkins commented on pull request #28852: URL: https://github.com/apache/spark/pull/28852#issuecomment-645774143 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28852: [SPARK-30616][SQL] Introduce TTL config option for SQL Metadata Cache

2020-06-17 Thread GitBox
AmplabJenkins removed a comment on pull request #28852: URL: https://github.com/apache/spark/pull/28852#issuecomment-645774143 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins commented on pull request #28825: [SPARK-32020][SQL][MINOR] Better error message when SPARK_HOME or spark.test.home is not set.

2020-06-17 Thread GitBox
AmplabJenkins commented on pull request #28825: URL: https://github.com/apache/spark/pull/28825#issuecomment-645774200 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [spark] SparkQA removed a comment on pull request #28852: [SPARK-30616][SQL] Introduce TTL config option for SQL Metadata Cache

2020-06-17 Thread GitBox
SparkQA removed a comment on pull request #28852: URL: https://github.com/apache/spark/pull/28852#issuecomment-645698048 **[Test build #124182 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/124182/testReport)** for PR 28852 at commit [`f03fe24`](https://gi

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28710: [SPARK-31893][ML] Add a generic ClassificationSummary trait

2020-06-17 Thread GitBox
AmplabJenkins removed a comment on pull request #28710: URL: https://github.com/apache/spark/pull/28710#issuecomment-645773814 Merged build finished. Test FAILed. This is an automated message from the Apache Git Service. To r

[GitHub] [spark] SparkQA removed a comment on pull request #28825: [SPARK-32020][SQL][MINOR] Better error message when SPARK_HOME or spark.test.home is not set.

2020-06-17 Thread GitBox
SparkQA removed a comment on pull request #28825: URL: https://github.com/apache/spark/pull/28825#issuecomment-645726046 **[Test build #124187 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/124187/testReport)** for PR 28825 at commit [`0ff8bf0`](https://gi

[GitHub] [spark] AmplabJenkins commented on pull request #28710: [SPARK-31893][ML] Add a generic ClassificationSummary trait

2020-06-17 Thread GitBox
AmplabJenkins commented on pull request #28710: URL: https://github.com/apache/spark/pull/28710#issuecomment-645773814 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [spark] SparkQA commented on pull request #28852: [SPARK-30616][SQL] Introduce TTL config option for SQL Metadata Cache

2020-06-17 Thread GitBox
SparkQA commented on pull request #28852: URL: https://github.com/apache/spark/pull/28852#issuecomment-645773560 **[Test build #124182 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/124182/testReport)** for PR 28852 at commit [`f03fe24`](https://github.co

[GitHub] [spark] SparkQA commented on pull request #28710: [SPARK-31893][ML] Add a generic ClassificationSummary trait

2020-06-17 Thread GitBox
SparkQA commented on pull request #28710: URL: https://github.com/apache/spark/pull/28710#issuecomment-645773554 **[Test build #124197 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/124197/testReport)** for PR 28710 at commit [`e844c11`](https://github.com

[GitHub] [spark] SparkQA commented on pull request #28825: [SPARK-32020][SQL][MINOR] Better error message when SPARK_HOME or spark.test.home is not set.

2020-06-17 Thread GitBox
SparkQA commented on pull request #28825: URL: https://github.com/apache/spark/pull/28825#issuecomment-645773587 **[Test build #124187 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/124187/testReport)** for PR 28825 at commit [`0ff8bf0`](https://github.co

[GitHub] [spark] gatorsmile commented on pull request #28817: [WIP][SPARK-31197][CORE] Exit the executor once all tasks and migrations are finished built on top of on top of spark20629

2020-06-17 Thread GitBox
gatorsmile commented on pull request #28817: URL: https://github.com/apache/spark/pull/28817#issuecomment-645771306 cc @Ngone51 @jiangxb1987 This is an automated message from the Apache Git Service. To respond to the message

[GitHub] [spark] gatorsmile commented on pull request #28818: [WIP][SPARK-31198][CORE] Use graceful decommissioning as part of dynamic scaling

2020-06-17 Thread GitBox
gatorsmile commented on pull request #28818: URL: https://github.com/apache/spark/pull/28818#issuecomment-645771384 cc @Ngone51 @jiangxb1987 This is an automated message from the Apache Git Service. To respond to the message

[GitHub] [spark] gatorsmile commented on pull request #28831: [SPARK-31993][SQL] Evaluate children code whenever needed in both varargCounts/varargBuilds for 'concat_ws' with columns having at least o

2020-06-17 Thread GitBox
gatorsmile commented on pull request #28831: URL: https://github.com/apache/spark/pull/28831#issuecomment-645770760 cc @rednaxelafx This is an automated message from the Apache Git Service. To respond to the message, please

[GitHub] [spark] gatorsmile commented on pull request #28835: [WIP][SPARK-31926][TESTS][FOLLOWUP]Cleanup the thread local variable of hive metastore

2020-06-17 Thread GitBox
gatorsmile commented on pull request #28835: URL: https://github.com/apache/spark/pull/28835#issuecomment-645770966 cc @juliuszsompolski This is an automated message from the Apache Git Service. To respond to the message, pl

[GitHub] [spark] gatorsmile commented on pull request #28836: [SPARK-31561][SQL] Add QUALIFY Clause

2020-06-17 Thread GitBox
gatorsmile commented on pull request #28836: URL: https://github.com/apache/spark/pull/28836#issuecomment-645770292 @AngersZh Agree on what @bart-samwel said. Maybe we can revisit this in future? Let us first close this PR?

[GitHub] [spark] gatorsmile commented on pull request #28841: [SPARK-31962][SQL] Provide option to load files after a specified date when reading from a folder path

2020-06-17 Thread GitBox
gatorsmile commented on pull request #28841: URL: https://github.com/apache/spark/pull/28841#issuecomment-645769608 cc @cloud-fan @gengliangwang @MaxGekk This is an automated message from the Apache Git Service. To respond t

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28854: [MINOR][DOCS] Emphasize the Streaming tab is for DStream API

2020-06-17 Thread GitBox
AmplabJenkins removed a comment on pull request #28854: URL: https://github.com/apache/spark/pull/28854#issuecomment-645757520 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] SparkQA removed a comment on pull request #28854: [MINOR][DOCS] Emphasize the Streaming tab is for DStream API

2020-06-17 Thread GitBox
SparkQA removed a comment on pull request #28854: URL: https://github.com/apache/spark/pull/28854#issuecomment-645754673 **[Test build #124196 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/124196/testReport)** for PR 28854 at commit [`cbfe1ac`](https://gi

[GitHub] [spark] SparkQA commented on pull request #28854: [MINOR][DOCS] Emphasize the Streaming tab is for DStream API

2020-06-17 Thread GitBox
SparkQA commented on pull request #28854: URL: https://github.com/apache/spark/pull/28854#issuecomment-645757449 **[Test build #124196 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/124196/testReport)** for PR 28854 at commit [`cbfe1ac`](https://github.co

[GitHub] [spark] AmplabJenkins commented on pull request #28854: [MINOR][DOCS] Emphasize the Streaming tab is for DStream API

2020-06-17 Thread GitBox
AmplabJenkins commented on pull request #28854: URL: https://github.com/apache/spark/pull/28854#issuecomment-645757520 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [spark] SparkQA commented on pull request #28854: [MINOR][DOCS] Emphasize the Streaming tab is for DStream API

2020-06-17 Thread GitBox
SparkQA commented on pull request #28854: URL: https://github.com/apache/spark/pull/28854#issuecomment-645754673 **[Test build #124196 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/124196/testReport)** for PR 28854 at commit [`cbfe1ac`](https://github.com

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28854: [MINOR][DOCS] Emphasize the Streaming tab is for DStream API

2020-06-17 Thread GitBox
AmplabJenkins removed a comment on pull request #28854: URL: https://github.com/apache/spark/pull/28854#issuecomment-645755010 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins commented on pull request #28854: [MINOR][DOCS] Emphasize the Streaming tab is for DStream API

2020-06-17 Thread GitBox
AmplabJenkins commented on pull request #28854: URL: https://github.com/apache/spark/pull/28854#issuecomment-645755010 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [spark] xuanyuanking commented on pull request #28854: [MINOR][DOCS] Emphasize the Streaming tab is for DStream API

2020-06-17 Thread GitBox
xuanyuanking commented on pull request #28854: URL: https://github.com/apache/spark/pull/28854#issuecomment-645753269 cc @HyukjinKwon @xccui as a minor follow up for SPARK-31792 This is an automated message from the Apache Gi

[GitHub] [spark] xuanyuanking opened a new pull request #28854: [MINOR][DOCS] Emphasize the Streaming tab is for DStream API

2020-06-17 Thread GitBox
xuanyuanking opened a new pull request #28854: URL: https://github.com/apache/spark/pull/28854 ### What changes were proposed in this pull request? Emphasize the Streaming tab is for DStream API. ### Why are the changes needed? Some users reported that it's a little confusing of

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28848: [SPARK-32003][CORE] Unregister outputs for executor on fetch failure …

2020-06-17 Thread GitBox
AmplabJenkins removed a comment on pull request #28848: URL: https://github.com/apache/spark/pull/28848#issuecomment-645748224 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins commented on pull request #28848: [SPARK-32003][CORE] Unregister outputs for executor on fetch failure …

2020-06-17 Thread GitBox
AmplabJenkins commented on pull request #28848: URL: https://github.com/apache/spark/pull/28848#issuecomment-645748224 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [spark] SparkQA removed a comment on pull request #28848: [SPARK-32003][CORE] Unregister outputs for executor on fetch failure …

2020-06-17 Thread GitBox
SparkQA removed a comment on pull request #28848: URL: https://github.com/apache/spark/pull/28848#issuecomment-645701890 **[Test build #124184 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/124184/testReport)** for PR 28848 at commit [`4c0b98c`](https://gi

[GitHub] [spark] SparkQA commented on pull request #28848: [SPARK-32003][CORE] Unregister outputs for executor on fetch failure …

2020-06-17 Thread GitBox
SparkQA commented on pull request #28848: URL: https://github.com/apache/spark/pull/28848#issuecomment-645747557 **[Test build #124184 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/124184/testReport)** for PR 28848 at commit [`4c0b98c`](https://github.co

[GitHub] [spark] AmplabJenkins commented on pull request #28853: [SPARK-32019][SQL] Add spark.sql.files.minPartitionNum config

2020-06-17 Thread GitBox
AmplabJenkins commented on pull request #28853: URL: https://github.com/apache/spark/pull/28853#issuecomment-645747457 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28853: [SPARK-32019][SQL] Add spark.sql.files.minPartitionNum config

2020-06-17 Thread GitBox
AmplabJenkins removed a comment on pull request #28853: URL: https://github.com/apache/spark/pull/28853#issuecomment-645747457 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] SparkQA commented on pull request #28853: [SPARK-32019][SQL] Add spark.sql.files.minPartitionNum config

2020-06-17 Thread GitBox
SparkQA commented on pull request #28853: URL: https://github.com/apache/spark/pull/28853#issuecomment-645747063 **[Test build #124195 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/124195/testReport)** for PR 28853 at commit [`09bba5c`](https://github.com

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28123: [SPARK-31350][SQL] Coalesce bucketed tables for sort merge join if applicable

2020-06-17 Thread GitBox
AmplabJenkins removed a comment on pull request #28123: URL: https://github.com/apache/spark/pull/28123#issuecomment-645743374 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins commented on pull request #28123: [SPARK-31350][SQL] Coalesce bucketed tables for sort merge join if applicable

2020-06-17 Thread GitBox
AmplabJenkins commented on pull request #28123: URL: https://github.com/apache/spark/pull/28123#issuecomment-645743374 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28825: [SPARK-32020][SQL][MINOR] Better error message when SPARK_HOME or spark.test.home is not set.

2020-06-17 Thread GitBox
AmplabJenkins removed a comment on pull request #28825: URL: https://github.com/apache/spark/pull/28825#issuecomment-645743276 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins commented on pull request #28825: [SPARK-32020][SQL][MINOR] Better error message when SPARK_HOME or spark.test.home is not set.

2020-06-17 Thread GitBox
AmplabJenkins commented on pull request #28825: URL: https://github.com/apache/spark/pull/28825#issuecomment-645743276 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [spark] SparkQA commented on pull request #28123: [SPARK-31350][SQL] Coalesce bucketed tables for sort merge join if applicable

2020-06-17 Thread GitBox
SparkQA commented on pull request #28123: URL: https://github.com/apache/spark/pull/28123#issuecomment-645742893 **[Test build #124194 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/124194/testReport)** for PR 28123 at commit [`e231268`](https://github.com

[GitHub] [spark] SparkQA commented on pull request #28825: [SPARK-32020][SQL][MINOR] Better error message when SPARK_HOME or spark.test.home is not set.

2020-06-17 Thread GitBox
SparkQA commented on pull request #28825: URL: https://github.com/apache/spark/pull/28825#issuecomment-645742891 **[Test build #124193 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/124193/testReport)** for PR 28825 at commit [`c3bb548`](https://github.com

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28853: [SPARK-32019][SQL] Add spark.sql.files.minPartitionNum config

2020-06-17 Thread GitBox
AmplabJenkins removed a comment on pull request #28853: URL: https://github.com/apache/spark/pull/28853#issuecomment-645737311 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/124

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28853: [SPARK-32019][SQL] Add spark.sql.files.minPartitionNum config

2020-06-17 Thread GitBox
AmplabJenkins removed a comment on pull request #28853: URL: https://github.com/apache/spark/pull/28853#issuecomment-645737306 Merged build finished. Test FAILed. This is an automated message from the Apache Git Service. To r

[GitHub] [spark] SparkQA removed a comment on pull request #28853: [SPARK-32019][SQL] Add spark.sql.files.minPartitionNum config

2020-06-17 Thread GitBox
SparkQA removed a comment on pull request #28853: URL: https://github.com/apache/spark/pull/28853#issuecomment-645736601 **[Test build #124191 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/124191/testReport)** for PR 28853 at commit [`4d776d3`](https://gi

[GitHub] [spark] AmplabJenkins commented on pull request #28853: [SPARK-32019][SQL] Add spark.sql.files.minPartitionNum config

2020-06-17 Thread GitBox
AmplabJenkins commented on pull request #28853: URL: https://github.com/apache/spark/pull/28853#issuecomment-645737306 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [spark] SparkQA commented on pull request #28853: [SPARK-32019][SQL] Add spark.sql.files.minPartitionNum config

2020-06-17 Thread GitBox
SparkQA commented on pull request #28853: URL: https://github.com/apache/spark/pull/28853#issuecomment-645737293 **[Test build #124191 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/124191/testReport)** for PR 28853 at commit [`4d776d3`](https://github.co

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28853: [SPARK-32019][SQL] Add spark.sql.files.minPartitionNum config

2020-06-17 Thread GitBox
AmplabJenkins removed a comment on pull request #28853: URL: https://github.com/apache/spark/pull/28853#issuecomment-645736934 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28840: [SPARK-31999][SQL] Add refresh function command

2020-06-17 Thread GitBox
AmplabJenkins removed a comment on pull request #28840: URL: https://github.com/apache/spark/pull/28840#issuecomment-645736929 This is an automated message from the Apache Git Service. To respond to the message, please log on

  1   2   3   4   5   >