[GitHub] [spark] AmplabJenkins removed a comment on pull request #28294: [SPARK-31519][SQL] Cast in having aggregate expressions returns the wrong result

2020-04-27 Thread GitBox
AmplabJenkins removed a comment on pull request #28294: URL: https://github.com/apache/spark/pull/28294#issuecomment-619784410 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] MaxGekk commented on pull request #27617: [SPARK-30865][SQL] Refactor DateTimeUtils

2020-04-27 Thread GitBox
MaxGekk commented on pull request #27617: URL: https://github.com/apache/spark/pull/27617#issuecomment-619798145 jenkins, retest this, please This is an automated message from the Apache Git Service. To respond to the

[GitHub] [spark] SparkQA commented on pull request #28364: [SPARK-31529][SQL][3.0] Remove extra whitespaces in formatted explain

2020-04-27 Thread GitBox
SparkQA commented on pull request #28364: URL: https://github.com/apache/spark/pull/28364#issuecomment-619812417 **[Test build #121888 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/121888/testReport)** for PR 28364 at commit

[GitHub] [spark] SparkQA commented on pull request #28362: [SPARK-31570][R][DOCS] R combine gapply dapply

2020-04-27 Thread GitBox
SparkQA commented on pull request #28362: URL: https://github.com/apache/spark/pull/28362#issuecomment-619812405 **[Test build #121889 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/121889/testReport)** for PR 28362 at commit

[GitHub] [spark] gaborgsomogyi commented on pull request #28215: [SPARK-31272][SQL] Support DB2 Kerberos login in JDBC connector

2020-04-27 Thread GitBox
gaborgsomogyi commented on pull request #28215: URL: https://github.com/apache/spark/pull/28215#issuecomment-619811920 That said maybe my environment is just a lucky one and would be good to take a look at the logs from test side and from container side as well.

[GitHub] [spark] viirya opened a new pull request #28366: [WIP][SPARK-31365][SQL] Enable nested predicate pushdown per data sources

2020-04-27 Thread GitBox
viirya opened a new pull request #28366: URL: https://github.com/apache/spark/pull/28366 ### What changes were proposed in this pull request? This patch proposes to replace `NESTED_PREDICATE_PUSHDOWN_ENABLED` with `NESTED_PREDICATE_PUSHDOWN_V1_SOURCE_LIST` which can

[GitHub] [spark] SparkQA removed a comment on pull request #28361: [SPARK-31572][SQL][CORE] Improve task logs at executor side

2020-04-27 Thread GitBox
SparkQA removed a comment on pull request #28361: URL: https://github.com/apache/spark/pull/28361#issuecomment-619816052 **[Test build #121890 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/121890/testReport)** for PR 28361 at commit

[GitHub] [spark] AmplabJenkins commented on pull request #28367: [SPARK-31573][R] apply fixed=TRUE as appropriate to regex usage in R

2020-04-27 Thread GitBox
AmplabJenkins commented on pull request #28367: URL: https://github.com/apache/spark/pull/28367#issuecomment-619823119 Can one of the admins verify this patch? This is an automated message from the Apache Git Service. To

[GitHub] [spark] SparkQA commented on pull request #28361: [SPARK-31572][SQL][CORE] Improve task logs at executor side

2020-04-27 Thread GitBox
SparkQA commented on pull request #28361: URL: https://github.com/apache/spark/pull/28361#issuecomment-619822977 **[Test build #121890 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/121890/testReport)** for PR 28361 at commit

[GitHub] [spark] AmplabJenkins commented on pull request #28361: [SPARK-31572][SQL][CORE] Improve task logs at executor side

2020-04-27 Thread GitBox
AmplabJenkins commented on pull request #28361: URL: https://github.com/apache/spark/pull/28361#issuecomment-619823023 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28361: [SPARK-31572][SQL][CORE] Improve task logs at executor side

2020-04-27 Thread GitBox
AmplabJenkins removed a comment on pull request #28361: URL: https://github.com/apache/spark/pull/28361#issuecomment-619823023 Merged build finished. Test FAILed. This is an automated message from the Apache Git Service. To

[GitHub] [spark] SparkQA commented on pull request #28294: [SPARK-31519][SQL] Cast in having aggregate expressions returns the wrong result

2020-04-27 Thread GitBox
SparkQA commented on pull request #28294: URL: https://github.com/apache/spark/pull/28294#issuecomment-619853417 **[Test build #121884 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/121884/testReport)** for PR 28294 at commit

[GitHub] [spark] AmplabJenkins commented on pull request #28294: [SPARK-31519][SQL] Cast in having aggregate expressions returns the wrong result

2020-04-27 Thread GitBox
AmplabJenkins commented on pull request #28294: URL: https://github.com/apache/spark/pull/28294#issuecomment-619853722 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] SparkQA removed a comment on pull request #28294: [SPARK-31519][SQL] Cast in having aggregate expressions returns the wrong result

2020-04-27 Thread GitBox
SparkQA removed a comment on pull request #28294: URL: https://github.com/apache/spark/pull/28294#issuecomment-619783728 **[Test build #121884 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/121884/testReport)** for PR 28294 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28294: [SPARK-31519][SQL] Cast in having aggregate expressions returns the wrong result

2020-04-27 Thread GitBox
AmplabJenkins removed a comment on pull request #28294: URL: https://github.com/apache/spark/pull/28294#issuecomment-619853722 Merged build finished. Test FAILed. This is an automated message from the Apache Git Service. To

[GitHub] [spark] AmplabJenkins commented on pull request #28109: [SPARK-31524][SQL][followup] Add metric to the split task number for skew optimization

2020-04-27 Thread GitBox
AmplabJenkins commented on pull request #28109: URL: https://github.com/apache/spark/pull/28109#issuecomment-619852256 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28109: [SPARK-31524][SQL][followup] Add metric to the split task number for skew optimization

2020-04-27 Thread GitBox
AmplabJenkins removed a comment on pull request #28109: URL: https://github.com/apache/spark/pull/28109#issuecomment-619852268 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] MaxGekk commented on a change in pull request #28328: [SPARK-31553][SQL] Fix isInCollection for collection sizes above the optimisation threshold

2020-04-27 Thread GitBox
MaxGekk commented on a change in pull request #28328: URL: https://github.com/apache/spark/pull/28328#discussion_r415676504 ## File path: sql/core/src/main/scala/org/apache/spark/sql/Column.scala ## @@ -828,11 +828,12 @@ class Column(val expr: Expression) extends Logging {

[GitHub] [spark] SparkQA commented on pull request #28328: [SPARK-31553][SQL] Fix isInCollection for collection sizes above the optimisation threshold

2020-04-27 Thread GitBox
SparkQA commented on pull request #28328: URL: https://github.com/apache/spark/pull/28328#issuecomment-619897888 **[Test build #121899 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/121899/testReport)** for PR 28328 at commit

[GitHub] [spark] SparkQA removed a comment on pull request #28356: [SPARK-31485][CORE][3.0] Avoid application hang if only partial barrier tasks launched

2020-04-27 Thread GitBox
SparkQA removed a comment on pull request #28356: URL: https://github.com/apache/spark/pull/28356#issuecomment-619779844 **[Test build #121882 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/121882/testReport)** for PR 28356 at commit

[GitHub] [spark] SparkQA commented on pull request #28356: [SPARK-31485][CORE][3.0] Avoid application hang if only partial barrier tasks launched

2020-04-27 Thread GitBox
SparkQA commented on pull request #28356: URL: https://github.com/apache/spark/pull/28356#issuecomment-619896941 **[Test build #121882 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/121882/testReport)** for PR 28356 at commit

[GitHub] [spark] MichaelChirico commented on a change in pull request #28365: [SPARK-31571][R] overhaul stop/message/warning calls to be more translation-friendly/canonical

2020-04-27 Thread GitBox
MichaelChirico commented on a change in pull request #28365: URL: https://github.com/apache/spark/pull/28365#discussion_r415605354 ## File path: R/pkg/R/DataFrame.R ## @@ -431,7 +431,7 @@ setMethod("coltypes", if (is.null(type)) {

[GitHub] [spark] MichaelChirico opened a new pull request #28365: [SPARK-31571][R] overhaul stop/message/warning calls to be more translation-friendly/canonical

2020-04-27 Thread GitBox
MichaelChirico opened a new pull request #28365: URL: https://github.com/apache/spark/pull/28365 ### What changes were proposed in this pull request? Internal usages like `{stop,warning,message}({paste,paste0,sprintf}` and

[GitHub] [spark] AmplabJenkins commented on pull request #28364: [SPARK-31529][SQL][3.0] Remove extra whitespaces in formatted explain

2020-04-27 Thread GitBox
AmplabJenkins commented on pull request #28364: URL: https://github.com/apache/spark/pull/28364#issuecomment-619813086 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28364: [SPARK-31529][SQL][3.0] Remove extra whitespaces in formatted explain

2020-04-27 Thread GitBox
AmplabJenkins removed a comment on pull request #28364: URL: https://github.com/apache/spark/pull/28364#issuecomment-619813086 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] SparkQA removed a comment on pull request #28362: [SPARK-31570][R][DOCS] R combine gapply dapply

2020-04-27 Thread GitBox
SparkQA removed a comment on pull request #28362: URL: https://github.com/apache/spark/pull/28362#issuecomment-619819692 **[Test build #121892 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/121892/testReport)** for PR 28362 at commit

[GitHub] [spark] HyukjinKwon commented on pull request #28367: [SPARK-31573][R] apply fixed=TRUE as appropriate to regex usage in R

2020-04-27 Thread GitBox
HyukjinKwon commented on pull request #28367: URL: https://github.com/apache/spark/pull/28367#issuecomment-619849863 ok to test This is an automated message from the Apache Git Service. To respond to the message, please log

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28362: [SPARK-31570][R][DOCS] R combine gapply dapply

2020-04-27 Thread GitBox
AmplabJenkins removed a comment on pull request #28362: URL: https://github.com/apache/spark/pull/28362#issuecomment-619848709 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28367: [SPARK-31573][R] apply fixed=TRUE as appropriate to regex usage in R

2020-04-27 Thread GitBox
AmplabJenkins removed a comment on pull request #28367: URL: https://github.com/apache/spark/pull/28367#issuecomment-619823651 Can one of the admins verify this patch? This is an automated message from the Apache Git

[GitHub] [spark] HyukjinKwon commented on pull request #28365: [SPARK-31571][R] overhaul stop/message/warning calls to be more translation-friendly/canonical

2020-04-27 Thread GitBox
HyukjinKwon commented on pull request #28365: URL: https://github.com/apache/spark/pull/28365#issuecomment-619858697 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub

[GitHub] [spark] HyukjinKwon commented on a change in pull request #28365: [SPARK-31571][R] overhaul stop/message/warning calls to be more translation-friendly/canonical

2020-04-27 Thread GitBox
HyukjinKwon commented on a change in pull request #28365: URL: https://github.com/apache/spark/pull/28365#discussion_r415660015 ## File path: R/pkg/R/DataFrame.R ## @@ -2587,18 +2589,18 @@ setMethod("join", if (is.null(joinType)) { sdf <-

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28365: [SPARK-31571][R] overhaul stop/message/warning calls to be more translation-friendly/canonical

2020-04-27 Thread GitBox
AmplabJenkins removed a comment on pull request #28365: URL: https://github.com/apache/spark/pull/28365#issuecomment-619816305 Can one of the admins verify this patch? This is an automated message from the Apache Git

[GitHub] [spark] HyukjinKwon commented on a change in pull request #28365: [SPARK-31571][R] overhaul stop/message/warning calls to be more translation-friendly/canonical

2020-04-27 Thread GitBox
HyukjinKwon commented on a change in pull request #28365: URL: https://github.com/apache/spark/pull/28365#discussion_r415660279 ## File path: R/pkg/R/DataFrame.R ## @@ -829,8 +829,11 @@ setMethod("repartitionByRange", jcol <- lapply(cols, function(c) { c@jc })

[GitHub] [spark] SparkQA commented on pull request #28109: [SPARK-31524][SQL][followup] Add metric to the split task number for skew optimization

2020-04-27 Thread GitBox
SparkQA commented on pull request #28109: URL: https://github.com/apache/spark/pull/28109#issuecomment-619863720 **[Test build #121898 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/121898/testReport)** for PR 28109 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28367: [SPARK-31573][R] Apply fixed=TRUE as appropriate to regex usage in R

2020-04-27 Thread GitBox
AmplabJenkins removed a comment on pull request #28367: URL: https://github.com/apache/spark/pull/28367#issuecomment-619876494 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on pull request #28365: [SPARK-31571][R] Overhaul stop/message/warning calls to be more translation-friendly/canonical

2020-04-27 Thread GitBox
AmplabJenkins commented on pull request #28365: URL: https://github.com/apache/spark/pull/28365#issuecomment-619885492 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] SparkQA commented on pull request #28365: [SPARK-31571][R] Overhaul stop/message/warning calls to be more translation-friendly/canonical

2020-04-27 Thread GitBox
SparkQA commented on pull request #28365: URL: https://github.com/apache/spark/pull/28365#issuecomment-619885451 **[Test build #121897 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/121897/testReport)** for PR 28365 at commit

[GitHub] [spark] maropu edited a comment on pull request #28360: [SPARK-31569][SQL][DOCS] Add links to subsections in SQL Reference main page

2020-04-27 Thread GitBox
maropu edited a comment on pull request #28360: URL: https://github.com/apache/spark/pull/28360#issuecomment-619782128 Looks fine. Thanks for the update. This is an automated message from the Apache Git Service. To respond

[GitHub] [spark] maropu commented on pull request #28360: [SPARK-31569][SQL][DOCS] Add links to subsections in SQL Reference main page

2020-04-27 Thread GitBox
maropu commented on pull request #28360: URL: https://github.com/apache/spark/pull/28360#issuecomment-619782128 Looks fine. Thanks for the udpate. This is an automated message from the Apache Git Service. To respond to the

[GitHub] [spark] cloud-fan commented on pull request #28315: [SPARK-31529][SQL] Remove extra whitespaces in formatted explain

2020-04-27 Thread GitBox
cloud-fan commented on pull request #28315: URL: https://github.com/apache/spark/pull/28315#issuecomment-619793759 thanks, merging to master! This is an automated message from the Apache Git Service. To respond to the

[GitHub] [spark] cloud-fan commented on pull request #28315: [SPARK-31529][SQL] Remove extra whitespaces in formatted explain

2020-04-27 Thread GitBox
cloud-fan commented on pull request #28315: URL: https://github.com/apache/spark/pull/28315#issuecomment-619794108 @Ngone51 can you send a PR for 3.0 if there is something we need to fix? This is an automated message from

[GitHub] [spark] Ngone51 commented on pull request #28315: [SPARK-31529][SQL] Remove extra whitespaces in formatted explain

2020-04-27 Thread GitBox
Ngone51 commented on pull request #28315: URL: https://github.com/apache/spark/pull/28315#issuecomment-619794371 Sure, thanks! This is an automated message from the Apache Git Service. To respond to the message, please log

[GitHub] [spark] Ngone51 commented on pull request #28361: [SPARK-31572][SQL][CORE] Improve task logs at executor side

2020-04-27 Thread GitBox
Ngone51 commented on pull request #28361: URL: https://github.com/apache/spark/pull/28361#issuecomment-619814450 cc @cloud-fan @gatorsmile @jiangxb1987 This is an automated message from the Apache Git Service. To respond to

[GitHub] [spark] Ngone51 commented on pull request #28361: [SPARK-31572][SQL][CORE] Improve task logs at executor side

2020-04-27 Thread GitBox
Ngone51 commented on pull request #28361: URL: https://github.com/apache/spark/pull/28361#issuecomment-619814328 retest this please. This is an automated message from the Apache Git Service. To respond to the message, please

[GitHub] [spark] MichaelChirico commented on a change in pull request #28365: [SPARK-31571][R] overhaul stop/message/warning calls to be more translation-friendly/canonical

2020-04-27 Thread GitBox
MichaelChirico commented on a change in pull request #28365: URL: https://github.com/apache/spark/pull/28365#discussion_r415607129 ## File path: R/pkg/R/client.R ## @@ -102,10 +102,17 @@ checkJavaVersion <- function() { javaVersionNum <- as.integer(versions[1]) } if

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28367: [SPARK-31573][R] apply fixed=TRUE as appropriate to regex usage in R

2020-04-27 Thread GitBox
AmplabJenkins removed a comment on pull request #28367: URL: https://github.com/apache/spark/pull/28367#issuecomment-619823119 Can one of the admins verify this patch? This is an automated message from the Apache Git

[GitHub] [spark] AmplabJenkins commented on pull request #28367: [SPARK-31573][R] apply fixed=TRUE as appropriate to regex usage in R

2020-04-27 Thread GitBox
AmplabJenkins commented on pull request #28367: URL: https://github.com/apache/spark/pull/28367#issuecomment-619823651 Can one of the admins verify this patch? This is an automated message from the Apache Git Service. To

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28361: [SPARK-31572][SQL][CORE] Improve task logs at executor side

2020-04-27 Thread GitBox
AmplabJenkins removed a comment on pull request #28361: URL: https://github.com/apache/spark/pull/28361#issuecomment-619823033 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] HyukjinKwon commented on a change in pull request #28365: [SPARK-31571][R] overhaul stop/message/warning calls to be more translation-friendly/canonical

2020-04-27 Thread GitBox
HyukjinKwon commented on a change in pull request #28365: URL: https://github.com/apache/spark/pull/28365#discussion_r415655632 ## File path: R/pkg/R/sparkR.R ## @@ -439,8 +439,11 @@ sparkR.session <- function( rPackageVersion <- paste0(packageVersion("SparkR")) if

[GitHub] [spark] HyukjinKwon commented on a change in pull request #28365: [SPARK-31571][R] overhaul stop/message/warning calls to be more translation-friendly/canonical

2020-04-27 Thread GitBox
HyukjinKwon commented on a change in pull request #28365: URL: https://github.com/apache/spark/pull/28365#discussion_r415655342 ## File path: R/pkg/R/utils.R ## @@ -354,8 +354,10 @@ varargsToStrEnv <- function(...) { } else { value <- pairs[[name]] if

[GitHub] [spark] HyukjinKwon commented on a change in pull request #28365: [SPARK-31571][R] overhaul stop/message/warning calls to be more translation-friendly/canonical

2020-04-27 Thread GitBox
HyukjinKwon commented on a change in pull request #28365: URL: https://github.com/apache/spark/pull/28365#discussion_r415655186 ## File path: R/pkg/R/utils.R ## @@ -369,8 +371,9 @@ varargsToStrEnv <- function(...) { } if (length(ignoredNames) != 0) { -

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28294: [SPARK-31519][SQL] Cast in having aggregate expressions returns the wrong result

2020-04-27 Thread GitBox
AmplabJenkins removed a comment on pull request #28294: URL: https://github.com/apache/spark/pull/28294#issuecomment-619853727 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] MichaelChirico commented on a change in pull request #28365: [SPARK-31571][R] Overhaul stop/message/warning calls to be more translation-friendly/canonical

2020-04-27 Thread GitBox
MichaelChirico commented on a change in pull request #28365: URL: https://github.com/apache/spark/pull/28365#discussion_r415687299 ## File path: R/pkg/R/install.R ## @@ -293,7 +289,7 @@ sparkCachePath <- function() { Sys.getenv("XDG_CACHE_HOME",

[GitHub] [spark] MichaelChirico commented on a change in pull request #28367: [SPARK-31573][R] Apply fixed=TRUE as appropriate to regex usage in R

2020-04-27 Thread GitBox
MichaelChirico commented on a change in pull request #28367: URL: https://github.com/apache/spark/pull/28367#discussion_r415688361 ## File path: R/pkg/R/sparkR.R ## @@ -606,7 +606,7 @@ getClientModeSparkSubmitOpts <- function(submitOps, sparkEnvirMap) { # process only if

[GitHub] [spark] SparkQA commented on pull request #28365: [SPARK-31571][R] Overhaul stop/message/warning calls to be more translation-friendly/canonical

2020-04-27 Thread GitBox
SparkQA commented on pull request #28365: URL: https://github.com/apache/spark/pull/28365#issuecomment-619897815 **[Test build #121900 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/121900/testReport)** for PR 28365 at commit

[GitHub] [spark] AmplabJenkins commented on pull request #28356: [SPARK-31485][CORE][3.0] Avoid application hang if only partial barrier tasks launched

2020-04-27 Thread GitBox
AmplabJenkins commented on pull request #28356: URL: https://github.com/apache/spark/pull/28356#issuecomment-619898517 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28365: [SPARK-31571][R] Overhaul stop/message/warning calls to be more translation-friendly/canonical

2020-04-27 Thread GitBox
AmplabJenkins removed a comment on pull request #28365: URL: https://github.com/apache/spark/pull/28365#issuecomment-619923072 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins commented on pull request #28365: [SPARK-31571][R] Overhaul stop/message/warning calls to be more translation-friendly/canonical

2020-04-27 Thread GitBox
AmplabJenkins commented on pull request #28365: URL: https://github.com/apache/spark/pull/28365#issuecomment-619923072 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28356: [SPARK-31485][CORE][3.0] Avoid application hang if only partial barrier tasks launched

2020-04-27 Thread GitBox
AmplabJenkins removed a comment on pull request #28356: URL: https://github.com/apache/spark/pull/28356#issuecomment-619780561 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins commented on pull request #28356: [SPARK-31485][CORE][3.0] Avoid application hang if only partial barrier tasks launched

2020-04-27 Thread GitBox
AmplabJenkins commented on pull request #28356: URL: https://github.com/apache/spark/pull/28356#issuecomment-619780561 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28363: [SPARK-27188][SS] FileStreamSink: provide a new option to have retention on output files

2020-04-27 Thread GitBox
AmplabJenkins removed a comment on pull request #28363: URL: https://github.com/apache/spark/pull/28363#issuecomment-619796828 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins commented on pull request #28363: [SPARK-27188][SS] FileStreamSink: provide a new option to have retention on output files

2020-04-27 Thread GitBox
AmplabJenkins commented on pull request #28363: URL: https://github.com/apache/spark/pull/28363#issuecomment-619796828 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] HeartSaVioR commented on pull request #28363: [SPARK-27188][SS] FileStreamSink: provide a new option to have retention on output files

2020-04-27 Thread GitBox
HeartSaVioR commented on pull request #28363: URL: https://github.com/apache/spark/pull/28363#issuecomment-619796653 cc. @tdas @zsxwing @jose-torres @gaborgsomogyi This is an automated message from the Apache Git Service.

[GitHub] [spark] AmplabJenkins commented on pull request #28366: [WIP][SPARK-31365][SQL] Enable nested predicate pushdown per data sources

2020-04-27 Thread GitBox
AmplabJenkins commented on pull request #28366: URL: https://github.com/apache/spark/pull/28366#issuecomment-619820342 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins commented on pull request #28362: [SPARK-31570][R][DOCS] R combine gapply dapply

2020-04-27 Thread GitBox
AmplabJenkins commented on pull request #28362: URL: https://github.com/apache/spark/pull/28362#issuecomment-619820262 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28362: [SPARK-31570][R][DOCS] R combine gapply dapply

2020-04-27 Thread GitBox
AmplabJenkins removed a comment on pull request #28362: URL: https://github.com/apache/spark/pull/28362#issuecomment-619820262 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] SparkQA commented on pull request #28366: [WIP][SPARK-31365][SQL] Enable nested predicate pushdown per data sources

2020-04-27 Thread GitBox
SparkQA commented on pull request #28366: URL: https://github.com/apache/spark/pull/28366#issuecomment-619819648 **[Test build #121891 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/121891/testReport)** for PR 28366 at commit

[GitHub] [spark] SparkQA commented on pull request #28362: [SPARK-31570][R][DOCS] R combine gapply dapply

2020-04-27 Thread GitBox
SparkQA commented on pull request #28362: URL: https://github.com/apache/spark/pull/28362#issuecomment-619819692 **[Test build #121892 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/121892/testReport)** for PR 28362 at commit

[GitHub] [spark] HeartSaVioR commented on pull request #27664: [SPARK-30915][SS] CompactibleFileStreamLog: Avoid reading the metadata log file when finding the latest batch ID

2020-04-27 Thread GitBox
HeartSaVioR commented on pull request #27664: URL: https://github.com/apache/spark/pull/27664#issuecomment-619819838 I'm sorry, but I think the name of the method should represent the thing what it does. That's why the boolean parameters have been considered as code smell and even we

[GitHub] [spark] SparkQA commented on pull request #28362: [SPARK-31570][R][DOCS] R combine gapply dapply

2020-04-27 Thread GitBox
SparkQA commented on pull request #28362: URL: https://github.com/apache/spark/pull/28362#issuecomment-619848483 **[Test build #121892 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/121892/testReport)** for PR 28362 at commit

[GitHub] [spark] AmplabJenkins commented on pull request #28362: [SPARK-31570][R][DOCS] R combine gapply dapply

2020-04-27 Thread GitBox
AmplabJenkins commented on pull request #28362: URL: https://github.com/apache/spark/pull/28362#issuecomment-619848709 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] HyukjinKwon commented on a change in pull request #28365: [SPARK-31571][R] overhaul stop/message/warning calls to be more translation-friendly/canonical

2020-04-27 Thread GitBox
HyukjinKwon commented on a change in pull request #28365: URL: https://github.com/apache/spark/pull/28365#discussion_r415659034 ## File path: R/pkg/R/client.R ## @@ -102,10 +102,17 @@ checkJavaVersion <- function() { javaVersionNum <- as.integer(versions[1]) } if

[GitHub] [spark] HyukjinKwon commented on a change in pull request #28365: [SPARK-31571][R] overhaul stop/message/warning calls to be more translation-friendly/canonical

2020-04-27 Thread GitBox
HyukjinKwon commented on a change in pull request #28365: URL: https://github.com/apache/spark/pull/28365#discussion_r415659247 ## File path: R/pkg/R/SQLContext.R ## @@ -207,7 +209,8 @@ getSchema <- function(schema, firstRow = NULL, rdd = NULL) { names <- lapply(names,

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28109: [SPARK-31524][SQL][followup] Add metric to the split task number for skew optimization

2020-04-27 Thread GitBox
AmplabJenkins removed a comment on pull request #28109: URL: https://github.com/apache/spark/pull/28109#issuecomment-619864473 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins commented on pull request #28109: [SPARK-31524][SQL][followup] Add metric to the split task number for skew optimization

2020-04-27 Thread GitBox
AmplabJenkins commented on pull request #28109: URL: https://github.com/apache/spark/pull/28109#issuecomment-619864473 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] SparkQA removed a comment on pull request #28365: [SPARK-31571][R] Overhaul stop/message/warning calls to be more translation-friendly/canonical

2020-04-27 Thread GitBox
SparkQA removed a comment on pull request #28365: URL: https://github.com/apache/spark/pull/28365#issuecomment-61985 **[Test build #121897 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/121897/testReport)** for PR 28365 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28365: [SPARK-31571][R] Overhaul stop/message/warning calls to be more translation-friendly/canonical

2020-04-27 Thread GitBox
AmplabJenkins removed a comment on pull request #28365: URL: https://github.com/apache/spark/pull/28365#issuecomment-619885492 Merged build finished. Test FAILed. This is an automated message from the Apache Git Service. To

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28365: [SPARK-31571][R] Overhaul stop/message/warning calls to be more translation-friendly/canonical

2020-04-27 Thread GitBox
AmplabJenkins removed a comment on pull request #28365: URL: https://github.com/apache/spark/pull/28365#issuecomment-619885497 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on pull request #28356: [SPARK-31485][CORE][3.0] Avoid application hang if only partial barrier tasks launched

2020-04-27 Thread GitBox
AmplabJenkins commented on pull request #28356: URL: https://github.com/apache/spark/pull/28356#issuecomment-619775683 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28294: [SPARK-31519][SQL] Cast in having aggregate expressions returns the wrong result

2020-04-27 Thread GitBox
AmplabJenkins removed a comment on pull request #28294: URL: https://github.com/apache/spark/pull/28294#issuecomment-619775414 Merged build finished. Test FAILed. This is an automated message from the Apache Git Service. To

[GitHub] [spark] SparkQA removed a comment on pull request #28355: [SPARK-31565][WEBUI][FOLLOWUP] Add font color setting of DAG-viz for query plan.

2020-04-27 Thread GitBox
SparkQA removed a comment on pull request #28355: URL: https://github.com/apache/spark/pull/28355#issuecomment-619694507 **[Test build #121867 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/121867/testReport)** for PR 28355 at commit

[GitHub] [spark] SparkQA commented on pull request #27019: [SPARK-30027][SQL] Support codegen for aggregate filters in HashAggregateExec

2020-04-27 Thread GitBox
SparkQA commented on pull request #27019: URL: https://github.com/apache/spark/pull/27019#issuecomment-619775791 **[Test build #121881 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/121881/testReport)** for PR 27019 at commit

[GitHub] [spark] SparkQA removed a comment on pull request #28359: [SPARK-31534][WEBUI][3.0] Text for tooltip should be escaped

2020-04-27 Thread GitBox
SparkQA removed a comment on pull request #28359: URL: https://github.com/apache/spark/pull/28359#issuecomment-619702598 **[Test build #121871 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/121871/testReport)** for PR 28359 at commit

[GitHub] [spark] SparkQA commented on pull request #28361: [SPARK-31572][SQL][CORE] Improve task logs at executor side

2020-04-27 Thread GitBox
SparkQA commented on pull request #28361: URL: https://github.com/apache/spark/pull/28361#issuecomment-619775337 **[Test build #121879 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/121879/testReport)** for PR 28361 at commit

[GitHub] [spark] SparkQA commented on pull request #28359: [SPARK-31534][WEBUI][3.0] Text for tooltip should be escaped

2020-04-27 Thread GitBox
SparkQA commented on pull request #28359: URL: https://github.com/apache/spark/pull/28359#issuecomment-619775334 **[Test build #121871 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/121871/testReport)** for PR 28359 at commit

[GitHub] [spark] SparkQA commented on pull request #27617: [SPARK-30865][SQL] Refactor DateTimeUtils

2020-04-27 Thread GitBox
SparkQA commented on pull request #27617: URL: https://github.com/apache/spark/pull/27617#issuecomment-619775329 **[Test build #121878 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/121878/testReport)** for PR 27617 at commit

[GitHub] [spark] AmplabJenkins commented on pull request #27617: [SPARK-30865][SQL] Refactor DateTimeUtils

2020-04-27 Thread GitBox
AmplabJenkins commented on pull request #27617: URL: https://github.com/apache/spark/pull/27617#issuecomment-619775387 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] maropu commented on pull request #27019: [SPARK-30027][SQL] Support codegen for aggregate filters in HashAggregateExec

2020-04-27 Thread GitBox
maropu commented on pull request #27019: URL: https://github.com/apache/spark/pull/27019#issuecomment-619775541 retest this please This is an automated message from the Apache Git Service. To respond to the message, please

[GitHub] [spark] SparkQA commented on pull request #27006: [SPARK-30352][SQL] DataSourceV2: Add CURRENT_CATALOG function

2020-04-27 Thread GitBox
SparkQA commented on pull request #27006: URL: https://github.com/apache/spark/pull/27006#issuecomment-619775331 **[Test build #121870 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/121870/testReport)** for PR 27006 at commit

[GitHub] [spark] SparkQA commented on pull request #28356: [SPARK-31485][CORE][3.0] Avoid application hang if only partial barrier tasks launched

2020-04-27 Thread GitBox
SparkQA commented on pull request #28356: URL: https://github.com/apache/spark/pull/28356#issuecomment-619775338 **[Test build #121875 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/121875/testReport)** for PR 28356 at commit

[GitHub] [spark] AmplabJenkins commented on pull request #28294: [SPARK-31519][SQL] Cast in having aggregate expressions returns the wrong result

2020-04-27 Thread GitBox
AmplabJenkins commented on pull request #28294: URL: https://github.com/apache/spark/pull/28294#issuecomment-619775414 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] SparkQA removed a comment on pull request #28294: [SPARK-31519][SQL] Cast in having aggregate expressions returns the wrong result

2020-04-27 Thread GitBox
SparkQA removed a comment on pull request #28294: URL: https://github.com/apache/spark/pull/28294#issuecomment-619771694 **[Test build #121880 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/121880/testReport)** for PR 28294 at commit

[GitHub] [spark] AmplabJenkins commented on pull request #28355: [SPARK-31565][WEBUI][FOLLOWUP] Add font color setting of DAG-viz for query plan.

2020-04-27 Thread GitBox
AmplabJenkins commented on pull request #28355: URL: https://github.com/apache/spark/pull/28355#issuecomment-619775640 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] maropu commented on pull request #27803: [SPARK-31049][SQL] Support nested adjacent generators, e.g., explode(explode(v))

2020-04-27 Thread GitBox
maropu commented on pull request #27803: URL: https://github.com/apache/spark/pull/27803#issuecomment-619776301 @dongjoon-hyun Could you check again at your convenience? This is an automated message from the Apache Git

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28359: [SPARK-31534][WEBUI][3.0] Text for tooltip should be escaped

2020-04-27 Thread GitBox
AmplabJenkins removed a comment on pull request #28359: URL: https://github.com/apache/spark/pull/28359#issuecomment-619776163 Merged build finished. Test FAILed. This is an automated message from the Apache Git Service. To

[GitHub] [spark] AmplabJenkins removed a comment on pull request #27617: [SPARK-30865][SQL] Refactor DateTimeUtils

2020-04-27 Thread GitBox
AmplabJenkins removed a comment on pull request #27617: URL: https://github.com/apache/spark/pull/27617#issuecomment-619775397 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28294: [SPARK-31519][SQL] Cast in having aggregate expressions returns the wrong result

2020-04-27 Thread GitBox
AmplabJenkins removed a comment on pull request #28294: URL: https://github.com/apache/spark/pull/28294#issuecomment-619775419 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28356: [SPARK-31485][CORE][3.0] Avoid application hang if only partial barrier tasks launched

2020-04-27 Thread GitBox
AmplabJenkins removed a comment on pull request #28356: URL: https://github.com/apache/spark/pull/28356#issuecomment-619775692 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on pull request #27617: [SPARK-30865][SQL] Refactor DateTimeUtils

2020-04-27 Thread GitBox
AmplabJenkins removed a comment on pull request #27617: URL: https://github.com/apache/spark/pull/27617#issuecomment-619775387 Merged build finished. Test FAILed. This is an automated message from the Apache Git Service. To

[GitHub] [spark] AmplabJenkins removed a comment on pull request #27006: [SPARK-30352][SQL] DataSourceV2: Add CURRENT_CATALOG function

2020-04-27 Thread GitBox
AmplabJenkins removed a comment on pull request #27006: URL: https://github.com/apache/spark/pull/27006#issuecomment-619775829 Merged build finished. Test FAILed. This is an automated message from the Apache Git Service. To

  1   2   3   4   5   6   7   8   9   10   >