[GitHub] [spark] gaborgsomogyi commented on a change in pull request #28368: [SPARK-31575][SQL] Synchronise global JVM security configuration modification

gaborgsomogyi commented on a change in pull request #28368: URL: https://github.com/apache/spark/pull/28368#discussion_r416581520 ## File path: sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/jdbc/connection/DB2ConnectionProvider.scala ## @@ -48,7 +48,7 @@

[GitHub] [spark] SparkQA removed a comment on pull request #28385: [SPARK-31591][CORE] Fix null name prefix when create directory

SparkQA removed a comment on pull request #28385: URL: https://github.com/apache/spark/pull/28385#issuecomment-620464831 **[Test build #121982 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/121982/testReport)** for PR 28385 at commit

[GitHub] [spark] cloud-fan commented on pull request #28026: [SPARK-31257][SQL] Unify create table syntax

cloud-fan commented on pull request #28026: URL: https://github.com/apache/spark/pull/28026#issuecomment-620582149 > ... and be questioned if it behaves differently. That's already the case. Spark is not 100% compatible with Hive, and `EXTERNAL` for example is not exactly the same

[GitHub] [spark] SparkQA commented on pull request #28385: [SPARK-31591][CORE] Fix null name prefix when create directory

SparkQA commented on pull request #28385: URL: https://github.com/apache/spark/pull/28385#issuecomment-620581679 **[Test build #121982 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/121982/testReport)** for PR 28385 at commit

[GitHub] [spark] HyukjinKwon commented on a change in pull request #28392: [SPARK-31594][SQL] Do not display rand/randn seed numbers in schema

HyukjinKwon commented on a change in pull request #28392: URL: https://github.com/apache/spark/pull/28392#discussion_r416580510 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/randomExpressions.scala ## @@ -102,6 +102,8 @@ case class

[GitHub] [spark] maropu commented on a change in pull request #28368: [SPARK-31575][SQL] Synchronise global JVM security configuration modification

maropu commented on a change in pull request #28368: URL: https://github.com/apache/spark/pull/28368#discussion_r416579720 ## File path: sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/jdbc/connection/DB2ConnectionProvider.scala ## @@ -48,7 +48,7 @@

[GitHub] [spark] gaborgsomogyi commented on a change in pull request #28368: [SPARK-31575][SQL] Synchronise global JVM security configuration modification

gaborgsomogyi commented on a change in pull request #28368: URL: https://github.com/apache/spark/pull/28368#discussion_r416571234 ## File path: sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/jdbc/connection/DB2ConnectionProvider.scala ## @@ -48,7 +48,7 @@

[GitHub] [spark] gaborgsomogyi commented on a change in pull request #28368: [SPARK-31575][SQL] Synchronise global JVM security configuration modification

gaborgsomogyi commented on a change in pull request #28368: URL: https://github.com/apache/spark/pull/28368#discussion_r416571234 ## File path: sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/jdbc/connection/DB2ConnectionProvider.scala ## @@ -48,7 +48,7 @@

[GitHub] [spark] igreenfield edited a comment on pull request #26624: [SPARK-8981][core] Add MDC support in Executor

igreenfield edited a comment on pull request #26624: URL: https://github.com/apache/spark/pull/26624#issuecomment-620460159 @gatorsmile The failed test does not seem to be connected to the changes in the code This is an

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28379: [SPARK-28040][SPARK-28070][R] Write type object s3

AmplabJenkins removed a comment on pull request #28379: URL: https://github.com/apache/spark/pull/28379#issuecomment-620563871 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28379: [SPARK-28040][SPARK-28070][R] Write type object s3

AmplabJenkins removed a comment on pull request #28379: URL: https://github.com/apache/spark/pull/28379#issuecomment-620563860 Merged build finished. Test FAILed. This is an automated message from the Apache Git Service. To

[GitHub] [spark] SparkQA removed a comment on pull request #28379: [SPARK-28040][SPARK-28070][R] Write type object s3

SparkQA removed a comment on pull request #28379: URL: https://github.com/apache/spark/pull/28379#issuecomment-620560032 **[Test build #121992 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/121992/testReport)** for PR 28379 at commit

[GitHub] [spark] SparkQA commented on pull request #26339: [SPARK-27194][SPARK-29302][SQL] For dynamic partition overwrite operation, fix speculation task conflict issue and FileAlreadyExistsException

SparkQA commented on pull request #26339: URL: https://github.com/apache/spark/pull/26339#issuecomment-620563639 **[Test build #121993 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/121993/testReport)** for PR 26339 at commit

[GitHub] [spark] AmplabJenkins commented on pull request #28379: [SPARK-28040][SPARK-28070][R] Write type object s3

AmplabJenkins commented on pull request #28379: URL: https://github.com/apache/spark/pull/28379#issuecomment-620563860 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] SparkQA commented on pull request #28379: [SPARK-28040][SPARK-28070][R] Write type object s3

SparkQA commented on pull request #28379: URL: https://github.com/apache/spark/pull/28379#issuecomment-620563838 **[Test build #121992 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/121992/testReport)** for PR 28379 at commit

[GitHub] [spark] LantaoJin commented on pull request #28385: [SPARK-31591][CORE] Fix null name prefix when create directory

LantaoJin commented on pull request #28385: URL: https://github.com/apache/spark/pull/28385#issuecomment-620562663 > Why is the method called with null in the shuffle case? Is this an issue in callsite? Maybe. I am still looking into it. Our code base is a bit different with here,

[GitHub] [spark] AmplabJenkins removed a comment on pull request #27978: [SPARK-31127][ML] Implement abstract Selector

AmplabJenkins removed a comment on pull request #27978: URL: https://github.com/apache/spark/pull/27978#issuecomment-620561296 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins commented on pull request #27978: [SPARK-31127][ML] Implement abstract Selector

AmplabJenkins commented on pull request #27978: URL: https://github.com/apache/spark/pull/27978#issuecomment-620561296 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins removed a comment on pull request #26339: [SPARK-27194][SPARK-29302][SQL] For dynamic partition overwrite operation, fix speculation task conflict issue and FileAlreadyE

AmplabJenkins removed a comment on pull request #26339: URL: https://github.com/apache/spark/pull/26339#issuecomment-620560542 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28379: [SPARK-28040][SPARK-28070][R] Write type object s3

AmplabJenkins removed a comment on pull request #28379: URL: https://github.com/apache/spark/pull/28379#issuecomment-620560547 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins commented on pull request #28379: [SPARK-28040][SPARK-28070][R] Write type object s3

AmplabJenkins commented on pull request #28379: URL: https://github.com/apache/spark/pull/28379#issuecomment-620560547 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins commented on pull request #26339: [SPARK-27194][SPARK-29302][SQL] For dynamic partition overwrite operation, fix speculation task conflict issue and FileAlreadyExistsExc

AmplabJenkins commented on pull request #26339: URL: https://github.com/apache/spark/pull/26339#issuecomment-620560542 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] SparkQA removed a comment on pull request #27978: [SPARK-31127][ML] Implement abstract Selector

SparkQA removed a comment on pull request #27978: URL: https://github.com/apache/spark/pull/27978#issuecomment-620438664 **[Test build #121977 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/121977/testReport)** for PR 27978 at commit

[GitHub] [spark] SparkQA commented on pull request #28379: [SPARK-28040][SPARK-28070][R] Write type object s3

SparkQA commented on pull request #28379: URL: https://github.com/apache/spark/pull/28379#issuecomment-620560032 **[Test build #121992 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/121992/testReport)** for PR 28379 at commit

[GitHub] [spark] SparkQA commented on pull request #27978: [SPARK-31127][ML] Implement abstract Selector

SparkQA commented on pull request #27978: URL: https://github.com/apache/spark/pull/27978#issuecomment-620559534 **[Test build #121977 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/121977/testReport)** for PR 27978 at commit

[GitHub] [spark] HyukjinKwon commented on a change in pull request #28387: [SPARK-29339][R][FOLLOW-UP] Remove requireNamespace1 workaround for arrow

HyukjinKwon commented on a change in pull request #28387: URL: https://github.com/apache/spark/pull/28387#discussion_r416551145 ## File path: R/pkg/R/utils.R ## @@ -930,3 +930,7 @@ getOne <- function(x, envir, inherits = TRUE, ifnotfound = NULL) { traverseParentDirs <-

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28393: [SPARK-31595][SQL] Spark sql should allow unescaped quote mark in quoted string

AmplabJenkins removed a comment on pull request #28393: URL: https://github.com/apache/spark/pull/28393#issuecomment-620556479 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] SparkQA removed a comment on pull request #28393: [SPARK-31595][SQL] Spark sql should allow unescaped quote mark in quoted string

SparkQA removed a comment on pull request #28393: URL: https://github.com/apache/spark/pull/28393#issuecomment-620539534 **[Test build #121991 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/121991/testReport)** for PR 28393 at commit

[GitHub] [spark] HyukjinKwon commented on a change in pull request #28387: [SPARK-29339][R][FOLLOW-UP] Remove requireNamespace1 workaround for arrow

HyukjinKwon commented on a change in pull request #28387: URL: https://github.com/apache/spark/pull/28387#discussion_r416548957 ## File path: R/pkg/R/types.R ## @@ -88,11 +88,6 @@ specialtypeshandle <- function(type) { checkSchemaInArrow <- function(schema) {

[GitHub] [spark] AmplabJenkins commented on pull request #28393: [SPARK-31595][SQL] Spark sql should allow unescaped quote mark in quoted string

AmplabJenkins commented on pull request #28393: URL: https://github.com/apache/spark/pull/28393#issuecomment-620556479 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] SparkQA commented on pull request #28393: [SPARK-31595][SQL] Spark sql should allow unescaped quote mark in quoted string

SparkQA commented on pull request #28393: URL: https://github.com/apache/spark/pull/28393#issuecomment-620556291 **[Test build #121991 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/121991/testReport)** for PR 28393 at commit

[GitHub] [spark] AmplabJenkins commented on pull request #28349: [SPARK-30642][ML][PYSPARK] LinearSVC blockify input vectors

AmplabJenkins commented on pull request #28349: URL: https://github.com/apache/spark/pull/28349#issuecomment-620554265 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28349: [SPARK-30642][ML][PYSPARK] LinearSVC blockify input vectors

AmplabJenkins removed a comment on pull request #28349: URL: https://github.com/apache/spark/pull/28349#issuecomment-620554265 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] SparkQA commented on pull request #28349: [SPARK-30642][ML][PYSPARK] LinearSVC blockify input vectors

SparkQA commented on pull request #28349: URL: https://github.com/apache/spark/pull/28349#issuecomment-620553232 **[Test build #121976 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/121976/testReport)** for PR 28349 at commit

[GitHub] [spark] SparkQA removed a comment on pull request #28349: [SPARK-30642][ML][PYSPARK] LinearSVC blockify input vectors

SparkQA removed a comment on pull request #28349: URL: https://github.com/apache/spark/pull/28349#issuecomment-620438687 **[Test build #121976 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/121976/testReport)** for PR 28349 at commit

[GitHub] [spark] yaooqinn commented on pull request #28222: SPARK-31447 Fix issue in ExtractIntervalPart expression

yaooqinn commented on pull request #28222: URL: https://github.com/apache/spark/pull/28222#issuecomment-620550806 Presto returns day-time intervals only with timestamp subtractions, I think we can handle this change with our own CalendarInterval. BTW, it seems both interval

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28359: [SPARK-31534][WEBUI][3.0] Text for tooltip should be escaped

AmplabJenkins removed a comment on pull request #28359: URL: https://github.com/apache/spark/pull/28359#issuecomment-620543015 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins commented on pull request #28359: [SPARK-31534][WEBUI][3.0] Text for tooltip should be escaped

AmplabJenkins commented on pull request #28359: URL: https://github.com/apache/spark/pull/28359#issuecomment-620543015 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] SparkQA removed a comment on pull request #28359: [SPARK-31534][WEBUI][3.0] Text for tooltip should be escaped

SparkQA removed a comment on pull request #28359: URL: https://github.com/apache/spark/pull/28359#issuecomment-620425381 **[Test build #121967 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/121967/testReport)** for PR 28359 at commit

[GitHub] [spark] SparkQA commented on pull request #28359: [SPARK-31534][WEBUI][3.0] Text for tooltip should be escaped

SparkQA commented on pull request #28359: URL: https://github.com/apache/spark/pull/28359#issuecomment-620541371 **[Test build #121967 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/121967/testReport)** for PR 28359 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28393: SPARK-31595 Spark sql should allow unescaped quote mark in quoted string

AmplabJenkins removed a comment on pull request #28393: URL: https://github.com/apache/spark/pull/28393#issuecomment-620539961 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins commented on pull request #28393: SPARK-31595 Spark sql should allow unescaped quote mark in quoted string

AmplabJenkins commented on pull request #28393: URL: https://github.com/apache/spark/pull/28393#issuecomment-620539961 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] SparkQA commented on pull request #28393: SPARK-31595 Spark sql should allow unescaped quote mark in quoted string

SparkQA commented on pull request #28393: URL: https://github.com/apache/spark/pull/28393#issuecomment-620539534 **[Test build #121991 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/121991/testReport)** for PR 28393 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #27978: [SPARK-31127][ML] Implement abstract Selector

AmplabJenkins removed a comment on pull request #27978: URL: https://github.com/apache/spark/pull/27978#issuecomment-620538367 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] adrian-wang opened a new pull request #28393: SPARK-31595 Spark sql should allow unescaped quote mark in quoted string

adrian-wang opened a new pull request #28393: URL: https://github.com/apache/spark/pull/28393 ### What changes were proposed in this pull request? `def splitSemiColon` cannot handle unescaped quote mark like "'" or '"' correctly. When there are unmatched quotes in a string,

[GitHub] [spark] AmplabJenkins removed a comment on pull request #27978: [SPARK-31127][ML] Implement abstract Selector

AmplabJenkins removed a comment on pull request #27978: URL: https://github.com/apache/spark/pull/27978#issuecomment-620538358 Merged build finished. Test FAILed. This is an automated message from the Apache Git Service. To

[GitHub] [spark] AmplabJenkins commented on pull request #27978: [SPARK-31127][ML] Implement abstract Selector

AmplabJenkins commented on pull request #27978: URL: https://github.com/apache/spark/pull/27978#issuecomment-620538358 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] SparkQA removed a comment on pull request #27978: [SPARK-31127][ML] Implement abstract Selector

SparkQA removed a comment on pull request #27978: URL: https://github.com/apache/spark/pull/27978#issuecomment-620445888 **[Test build #121979 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/121979/testReport)** for PR 27978 at commit

[GitHub] [spark] SparkQA commented on pull request #27978: [SPARK-31127][ML] Implement abstract Selector

SparkQA commented on pull request #27978: URL: https://github.com/apache/spark/pull/27978#issuecomment-620537591 **[Test build #121979 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/121979/testReport)** for PR 27978 at commit

[GitHub] [spark] xwu99 commented on pull request #28229: [SPARK-31454][ML] An optimized K-Means based on DenseMatrix and GEMM

xwu99 commented on pull request #28229: URL: https://github.com/apache/spark/pull/28229#issuecomment-620522247 @zhengruifeng I saw your PR was merged, I will rebase. I am preparing some benchmarks. let's focus on dense case first. For sparse cases, we can use original path. @srowen

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28392: [SPARK-31594][SQL] Do not display rand/randn seed numbers in schema

AmplabJenkins removed a comment on pull request #28392: URL: https://github.com/apache/spark/pull/28392#issuecomment-620519461 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins commented on pull request #28392: [SPARK-31594][SQL] Do not display rand/randn seed numbers in schema

AmplabJenkins commented on pull request #28392: URL: https://github.com/apache/spark/pull/28392#issuecomment-620519461 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] SparkQA commented on pull request #28392: [SPARK-31594][SQL] Do not display rand/randn seed numbers in schema

SparkQA commented on pull request #28392: URL: https://github.com/apache/spark/pull/28392#issuecomment-620518808 **[Test build #121990 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/121990/testReport)** for PR 28392 at commit

[GitHub] [spark] maropu commented on a change in pull request #28194: [SPARK-31372][SQL][TEST] Display expression schema for double check.

maropu commented on a change in pull request #28194: URL: https://github.com/apache/spark/pull/28194#discussion_r416502297 ## File path: sql/core/src/test/scala/org/apache/spark/sql/ExpressionsSchemaSuite.scala ## @@ -0,0 +1,230 @@ +/* + * Licensed to the Apache Software

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28365: [SPARK-31571][R] Overhaul stop/message/warning calls to be more translation-friendly/canonical

AmplabJenkins removed a comment on pull request #28365: URL: https://github.com/apache/spark/pull/28365#issuecomment-620517924 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins commented on pull request #28365: [SPARK-31571][R] Overhaul stop/message/warning calls to be more translation-friendly/canonical

AmplabJenkins commented on pull request #28365: URL: https://github.com/apache/spark/pull/28365#issuecomment-620517924 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] SparkQA commented on pull request #28365: [SPARK-31571][R] Overhaul stop/message/warning calls to be more translation-friendly/canonical

SparkQA commented on pull request #28365: URL: https://github.com/apache/spark/pull/28365#issuecomment-620517747 **[Test build #121986 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/121986/testReport)** for PR 28365 at commit

[GitHub] [spark] SparkQA removed a comment on pull request #28365: [SPARK-31571][R] Overhaul stop/message/warning calls to be more translation-friendly/canonical

SparkQA removed a comment on pull request #28365: URL: https://github.com/apache/spark/pull/28365#issuecomment-620491862 **[Test build #121986 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/121986/testReport)** for PR 28365 at commit

[GitHub] [spark] maropu commented on pull request #28392: [SPARK-31594][SQL] Do not display rand/randn seed numbers in schema

maropu commented on pull request #28392: URL: https://github.com/apache/spark/pull/28392#issuecomment-620517199 Minor fix though, how about this? @dongjoon-hyun @HyukjinKwon This is an automated message from the Apache Git

[GitHub] [spark] AmplabJenkins removed a comment on pull request #26339: [SPARK-27194][SPARK-29302][SQL] For dynamic partition overwrite operation, fix speculation task conflict issue and FileAlreadyE

AmplabJenkins removed a comment on pull request #26339: URL: https://github.com/apache/spark/pull/26339#issuecomment-620515860 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] maropu opened a new pull request #28392: [SPARK-31594][SQL] Do not display rand/randn seed numbers in schema

maropu opened a new pull request #28392: URL: https://github.com/apache/spark/pull/28392 ### What changes were proposed in this pull request? This PR intends to add `sql` in `Rand` and `Randn` to make a column name deterministic. Before this PR (a column name changes

[GitHub] [spark] AmplabJenkins removed a comment on pull request #26339: [SPARK-27194][SPARK-29302][SQL] For dynamic partition overwrite operation, fix speculation task conflict issue and FileAlreadyE

AmplabJenkins removed a comment on pull request #26339: URL: https://github.com/apache/spark/pull/26339#issuecomment-620515851 Merged build finished. Test FAILed. This is an automated message from the Apache Git Service. To

[GitHub] [spark] AmplabJenkins commented on pull request #26339: [SPARK-27194][SPARK-29302][SQL] For dynamic partition overwrite operation, fix speculation task conflict issue and FileAlreadyExistsExc

AmplabJenkins commented on pull request #26339: URL: https://github.com/apache/spark/pull/26339#issuecomment-620515851 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] SparkQA removed a comment on pull request #26339: [SPARK-27194][SPARK-29302][SQL] For dynamic partition overwrite operation, fix speculation task conflict issue and FileAlreadyExistsE

SparkQA removed a comment on pull request #26339: URL: https://github.com/apache/spark/pull/26339#issuecomment-620435452 **[Test build #121974 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/121974/testReport)** for PR 26339 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28387: [SPARK-29339][R][FOLLOW-UP] remove requireNamespace1 workaround for arrow

AmplabJenkins removed a comment on pull request #28387: URL: https://github.com/apache/spark/pull/28387#issuecomment-620515177 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] SparkQA commented on pull request #26339: [SPARK-27194][SPARK-29302][SQL] For dynamic partition overwrite operation, fix speculation task conflict issue and FileAlreadyExistsException

SparkQA commented on pull request #26339: URL: https://github.com/apache/spark/pull/26339#issuecomment-620515344 **[Test build #121974 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/121974/testReport)** for PR 26339 at commit

[GitHub] [spark] AmplabJenkins commented on pull request #28387: [SPARK-29339][R][FOLLOW-UP] remove requireNamespace1 workaround for arrow

AmplabJenkins commented on pull request #28387: URL: https://github.com/apache/spark/pull/28387#issuecomment-620515177 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] SparkQA removed a comment on pull request #28387: [SPARK-29339][R][FOLLOW-UP] remove requireNamespace1 workaround for arrow

SparkQA removed a comment on pull request #28387: URL: https://github.com/apache/spark/pull/28387#issuecomment-620488228 **[Test build #121985 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/121985/testReport)** for PR 28387 at commit

[GitHub] [spark] SparkQA commented on pull request #28387: [SPARK-29339][R][FOLLOW-UP] remove requireNamespace1 workaround for arrow

SparkQA commented on pull request #28387: URL: https://github.com/apache/spark/pull/28387#issuecomment-620514916 **[Test build #121985 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/121985/testReport)** for PR 28387 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28391: [SPARK-31593][SS] Remove unnecessary streaming query progress update

AmplabJenkins removed a comment on pull request #28391: URL: https://github.com/apache/spark/pull/28391#issuecomment-620511518 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins commented on pull request #28391: [SPARK-31593][SS] Remove unnecessary streaming query progress update

AmplabJenkins commented on pull request #28391: URL: https://github.com/apache/spark/pull/28391#issuecomment-620511518 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] uncleGen commented on pull request #28391: [SPARK-31593][SS] Remove unnecessary streaming query progress update

uncleGen commented on pull request #28391: URL: https://github.com/apache/spark/pull/28391#issuecomment-620510877 cc @xuanyuanking This is an automated message from the Apache Git Service. To respond to the message,

[GitHub] [spark] SparkQA commented on pull request #28391: [SPARK-31593][SS] Remove unnecessary streaming query progress update

SparkQA commented on pull request #28391: URL: https://github.com/apache/spark/pull/28391#issuecomment-620511080 **[Test build #121989 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/121989/testReport)** for PR 28391 at commit

[GitHub] [spark] uncleGen commented on a change in pull request #28391: [SPARK-31593][SS] Remove unnecessary streaming query progress update

uncleGen commented on a change in pull request #28391: URL: https://github.com/apache/spark/pull/28391#discussion_r416492827 ## File path: sql/core/src/main/scala/org/apache/spark/sql/execution/streaming/ProgressReporter.scala ## @@ -201,7 +201,7 @@ trait ProgressReporter

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28387: [SPARK-29339][R][FOLLOW-UP] remove requireNamespace1 workaround for arrow

AmplabJenkins removed a comment on pull request #28387: URL: https://github.com/apache/spark/pull/28387#issuecomment-620509074 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] SparkQA removed a comment on pull request #28387: [SPARK-29339][R][FOLLOW-UP] remove requireNamespace1 workaround for arrow

SparkQA removed a comment on pull request #28387: URL: https://github.com/apache/spark/pull/28387#issuecomment-620484508 **[Test build #121984 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/121984/testReport)** for PR 28387 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28386: [SPARK-26199][SPARK-31517][R] fix strategy for handling ... names in mutate

AmplabJenkins removed a comment on pull request #28386: URL: https://github.com/apache/spark/pull/28386#issuecomment-620508585 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] uncleGen opened a new pull request #28391: [SPARK-31593][SS] Remove unnecessary streaming query progress update

uncleGen opened a new pull request #28391: URL: https://github.com/apache/spark/pull/28391 ### What changes were proposed in this pull request? Structured Streaming progress reporter will always report an `empty` progress when there is no new data. As design, we should provide

[GitHub] [spark] AmplabJenkins commented on pull request #28387: [SPARK-29339][R][FOLLOW-UP] remove requireNamespace1 workaround for arrow

AmplabJenkins commented on pull request #28387: URL: https://github.com/apache/spark/pull/28387#issuecomment-620509074 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] SparkQA commented on pull request #28387: [SPARK-29339][R][FOLLOW-UP] remove requireNamespace1 workaround for arrow

SparkQA commented on pull request #28387: URL: https://github.com/apache/spark/pull/28387#issuecomment-620508854 **[Test build #121984 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/121984/testReport)** for PR 28387 at commit

[GitHub] [spark] SparkQA removed a comment on pull request #28386: [SPARK-26199][SPARK-31517][R] fix strategy for handling ... names in mutate

SparkQA removed a comment on pull request #28386: URL: https://github.com/apache/spark/pull/28386#issuecomment-620480549 **[Test build #121983 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/121983/testReport)** for PR 28386 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28386: [SPARK-26199][SPARK-31517][R] fix strategy for handling ... names in mutate

AmplabJenkins removed a comment on pull request #28386: URL: https://github.com/apache/spark/pull/28386#issuecomment-620508575 Merged build finished. Test FAILed. This is an automated message from the Apache Git Service. To

[GitHub] [spark] SparkQA commented on pull request #28386: [SPARK-26199][SPARK-31517][R] fix strategy for handling ... names in mutate

SparkQA commented on pull request #28386: URL: https://github.com/apache/spark/pull/28386#issuecomment-620508455 **[Test build #121983 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/121983/testReport)** for PR 28386 at commit

[GitHub] [spark] AmplabJenkins commented on pull request #28386: [SPARK-26199][SPARK-31517][R] fix strategy for handling ... names in mutate

AmplabJenkins commented on pull request #28386: URL: https://github.com/apache/spark/pull/28386#issuecomment-620508575 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] SparkQA commented on pull request #28370: [SPARK-20732][CORE] Decommission cache blocks to other executors when an executor is decommissioned

SparkQA commented on pull request #28370: URL: https://github.com/apache/spark/pull/28370#issuecomment-620507280 **[Test build #121988 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/121988/testReport)** for PR 28370 at commit

[GitHub] [spark] AmplabJenkins commented on pull request #28370: [SPARK-20732][CORE] Decommission cache blocks to other executors when an executor is decommissioned

AmplabJenkins commented on pull request #28370: URL: https://github.com/apache/spark/pull/28370#issuecomment-620503832 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28370: [SPARK-20732][CORE] Decommission cache blocks to other executors when an executor is decommissioned

AmplabJenkins removed a comment on pull request #28370: URL: https://github.com/apache/spark/pull/28370#issuecomment-620503832 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] prakharjain09 commented on a change in pull request #28370: [SPARK-20732][CORE] Decommission cache blocks to other executors when an executor is decommissioned

prakharjain09 commented on a change in pull request #28370: URL: https://github.com/apache/spark/pull/28370#discussion_r416482618 ## File path: core/src/main/scala/org/apache/spark/storage/BlockManager.scala ## @@ -1829,7 +1895,52 @@ private[spark] class BlockManager(

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28390: [SPARK-27340][SS][TESTS][FOLLOW-UP] Rephrase API comments and simplify tests

AmplabJenkins removed a comment on pull request #28390: URL: https://github.com/apache/spark/pull/28390#issuecomment-620496314 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] SparkQA commented on pull request #28390: [SPARK-27340][SS][TESTS][FOLLOW-UP] Rephrase API comments and simplify tests

SparkQA commented on pull request #28390: URL: https://github.com/apache/spark/pull/28390#issuecomment-620499465 **[Test build #121987 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/121987/testReport)** for PR 28390 at commit

[GitHub] [spark] xuanyuanking commented on pull request #28390: [SPARK-27340][SS][TESTS][FOLLOW-UP] Rephrase API comments and simplify tests

xuanyuanking commented on pull request #28390: URL: https://github.com/apache/spark/pull/28390#issuecomment-620496687 cc @cloud-fan @dongjoon-hyun @HeartSaVioR This is an automated message from the Apache Git Service. To

[GitHub] [spark] xuanyuanking commented on a change in pull request #28326: [SPARK-27340][SS] Alias on TimeWindow expression cause watermark metadata lost

xuanyuanking commented on a change in pull request #28326: URL: https://github.com/apache/spark/pull/28326#discussion_r416475211 ## File path: sql/core/src/test/scala/org/apache/spark/sql/streaming/StreamingJoinSuite.scala ## @@ -991,4 +991,30 @@ class StreamingOuterJoinSuite

[GitHub] [spark] AmplabJenkins commented on pull request #28390: [SPARK-27340][SS][TESTS][FOLLOW-UP] Rephrase API comments and simplify tests

AmplabJenkins commented on pull request #28390: URL: https://github.com/apache/spark/pull/28390#issuecomment-620496314 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] xuanyuanking opened a new pull request #28390: [SPARK-27340][SS][TESTS][FOLLOW-UP] Rephrase API comments and simplify tests

xuanyuanking opened a new pull request #28390: URL: https://github.com/apache/spark/pull/28390 ### What changes were proposed in this pull request? - Rephrase the API doc for `Column.as` - Simplify the UTs ### Why are the changes needed? Address comments in #28069

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28365: [SPARK-31571][R] Overhaul stop/message/warning calls to be more translation-friendly/canonical

AmplabJenkins removed a comment on pull request #28365: URL: https://github.com/apache/spark/pull/28365#issuecomment-620492603 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28389: [SPARK-31592]bufferPoolsBySize in HeapMemoryAllocator should be thread safe

AmplabJenkins removed a comment on pull request #28389: URL: https://github.com/apache/spark/pull/28389#issuecomment-620488475 Can one of the admins verify this patch? This is an automated message from the Apache Git

[GitHub] [spark] AmplabJenkins commented on pull request #28365: [SPARK-31571][R] Overhaul stop/message/warning calls to be more translation-friendly/canonical

AmplabJenkins commented on pull request #28365: URL: https://github.com/apache/spark/pull/28365#issuecomment-620492603 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] SparkQA commented on pull request #28365: [SPARK-31571][R] Overhaul stop/message/warning calls to be more translation-friendly/canonical

SparkQA commented on pull request #28365: URL: https://github.com/apache/spark/pull/28365#issuecomment-620491862 **[Test build #121986 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/121986/testReport)** for PR 28365 at commit

[GitHub] [spark] AmplabJenkins commented on pull request #28389: [SPARK-31592]bufferPoolsBySize in HeapMemoryAllocator should be thread safe

AmplabJenkins commented on pull request #28389: URL: https://github.com/apache/spark/pull/28389#issuecomment-620491616 Can one of the admins verify this patch? This is an automated message from the Apache Git Service. To

[GitHub] [spark] MichaelChirico commented on a change in pull request #28365: [SPARK-31571][R] Overhaul stop/message/warning calls to be more translation-friendly/canonical

MichaelChirico commented on a change in pull request #28365: URL: https://github.com/apache/spark/pull/28365#discussion_r416468623 ## File path: R/pkg/R/utils.R ## @@ -804,7 +807,7 @@ handledCallJMethod <- function(obj, method, ...) { captureJVMException <- function(e,

<    1   2   3   4   5   6   7   8   9   >