[GitHub] [spark] AmplabJenkins removed a comment on pull request #28998: [SPARK-32173][SQL] Deduplicate code in FromUTCTimestamp and ToUTCTimestamp

2020-07-08 Thread GitBox
AmplabJenkins removed a comment on pull request #28998: URL: https://github.com/apache/spark/pull/28998#issuecomment-655330865 Merged build finished. Test FAILed. This is an automated message from the Apache Git Service. To

[GitHub] [spark] SparkQA removed a comment on pull request #28969: [SPARK-32150][BUILD] Upgrade to ZStd 1.4.5-4

2020-07-08 Thread GitBox
SparkQA removed a comment on pull request #28969: URL: https://github.com/apache/spark/pull/28969#issuecomment-655254853 **[Test build #125286 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125286/testReport)** for PR 28969 at commit

[GitHub] [spark] AmplabJenkins commented on pull request #29034: [SPARK-32219][SQL] Add SHOW CACHED TABLES Command

2020-07-08 Thread GitBox
AmplabJenkins commented on pull request #29034: URL: https://github.com/apache/spark/pull/29034#issuecomment-655330977 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28953: [SPARK-32013][SQL] Support query execution before/after reading/writing DataFrame over JDBC

2020-07-08 Thread GitBox
AmplabJenkins removed a comment on pull request #28953: URL: https://github.com/apache/spark/pull/28953#issuecomment-655330800 Merged build finished. Test FAILed. This is an automated message from the Apache Git Service. To

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29022: [SPARK-32207][SQL] Support 'F'-suffixed Float Literals

2020-07-08 Thread GitBox
AmplabJenkins removed a comment on pull request #29022: URL: https://github.com/apache/spark/pull/29022#issuecomment-655330827 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] SparkQA removed a comment on pull request #28803: [SPARK-31971][WEBUI] Add pagination support for all jobs timeline

2020-07-08 Thread GitBox
SparkQA removed a comment on pull request #28803: URL: https://github.com/apache/spark/pull/28803#issuecomment-655279892 **[Test build #125295 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125295/testReport)** for PR 28803 at commit

[GitHub] [spark] SparkQA removed a comment on pull request #28977: [WIP] Add all hive.execution suite in the parallel test group

2020-07-08 Thread GitBox
SparkQA removed a comment on pull request #28977: URL: https://github.com/apache/spark/pull/28977#issuecomment-655258899 **[Test build #125289 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125289/testReport)** for PR 28977 at commit

[GitHub] [spark] AmplabJenkins commented on pull request #27428: [SPARK-30276][SQL] Support Filter expression allows simultaneous use of DISTINCT

2020-07-08 Thread GitBox
AmplabJenkins commented on pull request #27428: URL: https://github.com/apache/spark/pull/27428#issuecomment-655331113 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins commented on pull request #28983: [SPARK-32159][SQL] Fix integration between Aggregator[Array[_], _, _] and UnresolvedMapObjects

2020-07-08 Thread GitBox
AmplabJenkins commented on pull request #28983: URL: https://github.com/apache/spark/pull/28983#issuecomment-655330929 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] SparkQA removed a comment on pull request #28953: [SPARK-32013][SQL] Support query execution before/after reading/writing DataFrame over JDBC

2020-07-08 Thread GitBox
SparkQA removed a comment on pull request #28953: URL: https://github.com/apache/spark/pull/28953#issuecomment-655321279 **[Test build #125310 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125310/testReport)** for PR 28953 at commit

[GitHub] [spark] SparkQA removed a comment on pull request #29022: [SPARK-32207][SQL] Support 'F'-suffixed Float Literals

2020-07-08 Thread GitBox
SparkQA removed a comment on pull request #29022: URL: https://github.com/apache/spark/pull/29022#issuecomment-655284214 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] SparkQA removed a comment on pull request #27983: [SPARK-32105][SQL]Refactor current ScriptTransformationExec code

2020-07-08 Thread GitBox
SparkQA removed a comment on pull request #27983: URL: https://github.com/apache/spark/pull/27983#issuecomment-655304196 **[Test build #125305 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125305/testReport)** for PR 27983 at commit

[GitHub] [spark] SparkQA removed a comment on pull request #28898: [SPARK-32059][SQL] Allow nested schema pruning thru window/sort/filter plans

2020-07-08 Thread GitBox
SparkQA removed a comment on pull request #28898: URL: https://github.com/apache/spark/pull/28898#issuecomment-655200055 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins commented on pull request #29013: [SPARK-32196][SQL] Extract In convertible part if it is not convertible

2020-07-08 Thread GitBox
AmplabJenkins commented on pull request #29013: URL: https://github.com/apache/spark/pull/29013#issuecomment-655331190 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] SparkQA removed a comment on pull request #28986: [SPARK-32160][CORE][PYSPARK] Disallow to create SparkContext in executors.

2020-07-08 Thread GitBox
SparkQA removed a comment on pull request #28986: URL: https://github.com/apache/spark/pull/28986#issuecomment-655255039 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29034: [SPARK-32219][SQL] Add SHOW CACHED TABLES Command

2020-07-08 Thread GitBox
AmplabJenkins removed a comment on pull request #29034: URL: https://github.com/apache/spark/pull/29034#issuecomment-655330977 Merged build finished. Test FAILed. This is an automated message from the Apache Git Service. To

[GitHub] [spark] SparkQA commented on pull request #28898: [SPARK-32059][SQL] Allow nested schema pruning thru window/sort/filter plans

2020-07-08 Thread GitBox
SparkQA commented on pull request #28898: URL: https://github.com/apache/spark/pull/28898#issuecomment-655330636 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and

[GitHub] [spark] AmplabJenkins commented on pull request #29026: [SPARK-28067][SPARK-32018] Fix decimal overflow issues

2020-07-08 Thread GitBox
AmplabJenkins commented on pull request #29026: URL: https://github.com/apache/spark/pull/29026#issuecomment-655330772 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] SparkQA commented on pull request #28975: [SPARK-32148][SS] Fix stream-stream join issue on missing to copy reused unsafe row

2020-07-08 Thread GitBox
SparkQA commented on pull request #28975: URL: https://github.com/apache/spark/pull/28975#issuecomment-655330669 **[Test build #125271 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125271/testReport)** for PR 28975 at commit

[GitHub] [spark] SparkQA commented on pull request #28977: [WIP] Add all hive.execution suite in the parallel test group

2020-07-08 Thread GitBox
SparkQA commented on pull request #28977: URL: https://github.com/apache/spark/pull/28977#issuecomment-655330653 **[Test build #125289 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125289/testReport)** for PR 28977 at commit

[GitHub] [spark] SparkQA commented on pull request #29020: [SPARK-23431][CORE] Expose stage level peak executor metrics via REST API

2020-07-08 Thread GitBox
SparkQA commented on pull request #29020: URL: https://github.com/apache/spark/pull/29020#issuecomment-655330643 **[Test build #125309 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125309/testReport)** for PR 29020 at commit

[GitHub] [spark] SparkQA commented on pull request #27428: [SPARK-30276][SQL] Support Filter expression allows simultaneous use of DISTINCT

2020-07-08 Thread GitBox
SparkQA commented on pull request #27428: URL: https://github.com/apache/spark/pull/27428#issuecomment-655330637 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and

[GitHub] [spark] cloud-fan commented on a change in pull request #28676: [SPARK-31869][SQL] BroadcastHashJoinExec can utilize the build side for its output partitioning

2020-07-08 Thread GitBox
cloud-fan commented on a change in pull request #28676: URL: https://github.com/apache/spark/pull/28676#discussion_r451334249 ## File path: sql/core/src/main/scala/org/apache/spark/sql/execution/joins/BroadcastHashJoinExec.scala ## @@ -51,7 +53,7 @@ case class

[GitHub] [spark] AmplabJenkins commented on pull request #29002: [SPARK-32175][CORE] Fix the order between initialization for ExecutorPlugin and starting heartbeat thread

2020-07-08 Thread GitBox
AmplabJenkins commented on pull request #29002: URL: https://github.com/apache/spark/pull/29002#issuecomment-655337806 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins commented on pull request #28975: [SPARK-32148][SS] Fix stream-stream join issue on missing to copy reused unsafe row

2020-07-08 Thread GitBox
AmplabJenkins commented on pull request #28975: URL: https://github.com/apache/spark/pull/28975#issuecomment-655337862 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins commented on pull request #28953: [SPARK-32013][SQL] Support query execution before/after reading/writing DataFrame over JDBC

2020-07-08 Thread GitBox
AmplabJenkins commented on pull request #28953: URL: https://github.com/apache/spark/pull/28953#issuecomment-655337903 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] cloud-fan commented on pull request #29022: [SPARK-32207][SQL] Support 'F'-suffixed Float Literals

2020-07-08 Thread GitBox
cloud-fan commented on pull request #29022: URL: https://github.com/apache/spark/pull/29022#issuecomment-655338263 retest this please This is an automated message from the Apache Git Service. To respond to the message,

[GitHub] [spark] AmplabJenkins removed a comment on pull request #27428: [SPARK-30276][SQL] Support Filter expression allows simultaneous use of DISTINCT

2020-07-08 Thread GitBox
AmplabJenkins removed a comment on pull request #27428: URL: https://github.com/apache/spark/pull/27428#issuecomment-655338033 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins commented on pull request #29026: [SPARK-28067][SPARK-32018] Fix decimal overflow issues

2020-07-08 Thread GitBox
AmplabJenkins commented on pull request #29026: URL: https://github.com/apache/spark/pull/29026#issuecomment-655337898 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins commented on pull request #27428: [SPARK-30276][SQL] Support Filter expression allows simultaneous use of DISTINCT

2020-07-08 Thread GitBox
AmplabJenkins commented on pull request #27428: URL: https://github.com/apache/spark/pull/27428#issuecomment-655338033 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29002: [SPARK-32175][CORE] Fix the order between initialization for ExecutorPlugin and starting heartbeat thread

2020-07-08 Thread GitBox
AmplabJenkins removed a comment on pull request #29002: URL: https://github.com/apache/spark/pull/29002#issuecomment-655337806 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29026: [SPARK-28067][SPARK-32018] Fix decimal overflow issues

2020-07-08 Thread GitBox
AmplabJenkins removed a comment on pull request #29026: URL: https://github.com/apache/spark/pull/29026#issuecomment-655337898 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] maropu commented on a change in pull request #28953: [SPARK-32013][SQL] Support query execution before/after reading/writing DataFrame over JDBC

2020-07-08 Thread GitBox
maropu commented on a change in pull request #28953: URL: https://github.com/apache/spark/pull/28953#discussion_r451334503 ## File path: sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/jdbc/JDBCRDD.scala ## @@ -156,6 +164,7 @@ object JDBCRDD extends Logging

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28975: [SPARK-32148][SS] Fix stream-stream join issue on missing to copy reused unsafe row

2020-07-08 Thread GitBox
AmplabJenkins removed a comment on pull request #28975: URL: https://github.com/apache/spark/pull/28975#issuecomment-655337862 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] cloud-fan commented on pull request #28983: [SPARK-32159][SQL] Fix integration between Aggregator[Array[_], _, _] and UnresolvedMapObjects

2020-07-08 Thread GitBox
cloud-fan commented on pull request #28983: URL: https://github.com/apache/spark/pull/28983#issuecomment-655337958 retest this please This is an automated message from the Apache Git Service. To respond to the message,

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28953: [SPARK-32013][SQL] Support query execution before/after reading/writing DataFrame over JDBC

2020-07-08 Thread GitBox
AmplabJenkins removed a comment on pull request #28953: URL: https://github.com/apache/spark/pull/28953#issuecomment-655337903 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] SparkQA commented on pull request #28998: [SPARK-32173][SQL] Deduplicate code in FromUTCTimestamp and ToUTCTimestamp

2020-07-08 Thread GitBox
SparkQA commented on pull request #28998: URL: https://github.com/apache/spark/pull/28998#issuecomment-655344891 **[Test build #125327 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125327/testReport)** for PR 28998 at commit

[GitHub] [spark] HeartSaVioR commented on pull request #26935: [SPARK-30294][SS] Explicitly defines read-only StateStore and optimize for HDFSBackedStateStore

2020-07-08 Thread GitBox
HeartSaVioR commented on pull request #26935: URL: https://github.com/apache/spark/pull/26935#issuecomment-655345152 retest this, please This is an automated message from the Apache Git Service. To respond to the message,

[GitHub] [spark] maropu commented on a change in pull request #28953: [SPARK-32013][SQL] Support query execution before/after reading/writing DataFrame over JDBC

2020-07-08 Thread GitBox
maropu commented on a change in pull request #28953: URL: https://github.com/apache/spark/pull/28953#discussion_r451348913 ## File path: sql/core/src/main/scala/org/apache/spark/sql/util/QueryStatementUtils.scala ## @@ -0,0 +1,89 @@ +/* + * Licensed to the Apache Software

[GitHub] [spark] ScrapCodes commented on pull request #29017: [WIP][SPARK-XXX][TESTS] Disable SBT unidoc generation testing in Jenkins

2020-07-08 Thread GitBox
ScrapCodes commented on pull request #29017: URL: https://github.com/apache/spark/pull/29017#issuecomment-655350321 I think if it is too flaky, we can disable it. This is an automated message from the Apache Git Service. To

[GitHub] [spark] ScrapCodes edited a comment on pull request #29017: [WIP][SPARK-XXX][TESTS] Disable SBT unidoc generation testing in Jenkins

2020-07-08 Thread GitBox
ScrapCodes edited a comment on pull request #29017: URL: https://github.com/apache/spark/pull/29017#issuecomment-655350321 I think if it is too flaky, we can disable it. I am ready to look at it closely later, if the flakiness can be mitigated.

[GitHub] [spark] AmplabJenkins removed a comment on pull request #27690: [SPARK-21514][SQL] Added a new option to use non-blobstore storage when writing into blobstore storage

2020-07-08 Thread GitBox
AmplabJenkins removed a comment on pull request #27690: URL: https://github.com/apache/spark/pull/27690#issuecomment-655356495 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] maropu commented on pull request #29022: [SPARK-32207][SQL] Support 'F'-suffixed Float Literals

2020-07-08 Thread GitBox
maropu commented on pull request #29022: URL: https://github.com/apache/spark/pull/29022#issuecomment-655356600 Yea, the @cloud-fan comment above sounds fine to me. This is an automated message from the Apache Git Service.

[GitHub] [spark] AmplabJenkins commented on pull request #27690: [SPARK-21514][SQL] Added a new option to use non-blobstore storage when writing into blobstore storage

2020-07-08 Thread GitBox
AmplabJenkins commented on pull request #27690: URL: https://github.com/apache/spark/pull/27690#issuecomment-655356495 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] maropu commented on pull request #28986: [SPARK-32160][CORE][PYSPARK] Disallow to create SparkContext in executors.

2020-07-08 Thread GitBox
maropu commented on pull request #28986: URL: https://github.com/apache/spark/pull/28986#issuecomment-655365885 retest this please This is an automated message from the Apache Git Service. To respond to the message, please

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28926: [SPARK-32133][SQL] Forbid time field steps for date start/end in Sequence

2020-07-08 Thread GitBox
AmplabJenkins removed a comment on pull request #28926: URL: https://github.com/apache/spark/pull/28926#issuecomment-655372242 Merged build finished. Test FAILed. This is an automated message from the Apache Git Service. To

[GitHub] [spark] SparkQA removed a comment on pull request #26935: [SPARK-30294][SS] Explicitly defines read-only StateStore and optimize for HDFSBackedStateStore

2020-07-08 Thread GitBox
SparkQA removed a comment on pull request #26935: URL: https://github.com/apache/spark/pull/26935#issuecomment-655348458 **[Test build #125329 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125329/testReport)** for PR 26935 at commit

[GitHub] [spark] SparkQA commented on pull request #26935: [SPARK-30294][SS] Explicitly defines read-only StateStore and optimize for HDFSBackedStateStore

2020-07-08 Thread GitBox
SparkQA commented on pull request #26935: URL: https://github.com/apache/spark/pull/26935#issuecomment-655372452 **[Test build #125329 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125329/testReport)** for PR 26935 at commit

[GitHub] [spark] SparkQA commented on pull request #28926: [SPARK-32133][SQL] Forbid time field steps for date start/end in Sequence

2020-07-08 Thread GitBox
SparkQA commented on pull request #28926: URL: https://github.com/apache/spark/pull/28926#issuecomment-655372202 **[Test build #125333 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125333/testReport)** for PR 28926 at commit

[GitHub] [spark] AmplabJenkins commented on pull request #28926: [SPARK-32133][SQL] Forbid time field steps for date start/end in Sequence

2020-07-08 Thread GitBox
AmplabJenkins commented on pull request #28926: URL: https://github.com/apache/spark/pull/28926#issuecomment-655372242 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins commented on pull request #26935: [SPARK-30294][SS] Explicitly defines read-only StateStore and optimize for HDFSBackedStateStore

2020-07-08 Thread GitBox
AmplabJenkins commented on pull request #26935: URL: https://github.com/apache/spark/pull/26935#issuecomment-655372783 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] LuciferYang opened a new pull request #29037: [SPARK-32224][ SPARK-SUBMIT]Support pass 'spark.yarn.priority' through the SparkSubmit

2020-07-08 Thread GitBox
LuciferYang opened a new pull request #29037: URL: https://github.com/apache/spark/pull/29037 ### What changes were proposed in this pull request? After #26255 we support configure 'spark.yarn.priority' on Yarn deploy modes, this pr support pass this configuration through the

[GitHub] [spark] AmplabJenkins commented on pull request #29037: [SPARK-32224][ SPARK-SUBMIT]Support pass 'spark.yarn.priority' through the SparkSubmit

2020-07-08 Thread GitBox
AmplabJenkins commented on pull request #29037: URL: https://github.com/apache/spark/pull/29037#issuecomment-655379511 Can one of the admins verify this patch? This is an automated message from the Apache Git Service. To

[GitHub] [spark] SparkQA commented on pull request #29036: [WIP][SPARK-XXXXX][SQL] CliSuite flakiness fix via differentiating cli driver bootup timeout and query execution timeout

2020-07-08 Thread GitBox
SparkQA commented on pull request #29036: URL: https://github.com/apache/spark/pull/29036#issuecomment-655379752 **[Test build #125338 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125338/testReport)** for PR 29036 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29037: [SPARK-32224][ SPARK-SUBMIT]Support pass 'spark.yarn.priority' through the SparkSubmit

2020-07-08 Thread GitBox
AmplabJenkins removed a comment on pull request #29037: URL: https://github.com/apache/spark/pull/29037#issuecomment-655379511 Can one of the admins verify this patch? This is an automated message from the Apache Git

[GitHub] [spark] AmplabJenkins commented on pull request #29036: [WIP][SPARK-XXXXX][SQL] CliSuite flakiness fix via differentiating cli driver bootup timeout and query execution timeout

2020-07-08 Thread GitBox
AmplabJenkins commented on pull request #29036: URL: https://github.com/apache/spark/pull/29036#issuecomment-655380662 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins commented on pull request #29037: [SPARK-32224][ SPARK-SUBMIT]Support pass 'spark.yarn.priority' through the SparkSubmit

2020-07-08 Thread GitBox
AmplabJenkins commented on pull request #29037: URL: https://github.com/apache/spark/pull/29037#issuecomment-655380183 Can one of the admins verify this patch? This is an automated message from the Apache Git Service. To

[GitHub] [spark] moomindani commented on a change in pull request #28953: [SPARK-32013][SQL] Support query execution before/after reading/writing DataFrame over JDBC

2020-07-08 Thread GitBox
moomindani commented on a change in pull request #28953: URL: https://github.com/apache/spark/pull/28953#discussion_r451388011 ## File path: sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/jdbc/JdbcUtils.scala ## @@ -122,6 +122,37 @@ object JdbcUtils

[GitHub] [spark] AmplabJenkins commented on pull request #28979: [SPARK-32154][SQL] Use ExpressionEncoder for the return type of ScalaUDF to convert to catalyst type

2020-07-08 Thread GitBox
AmplabJenkins commented on pull request #28979: URL: https://github.com/apache/spark/pull/28979#issuecomment-655393966 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] SparkQA commented on pull request #29036: [WIP][SPARK-XXXXX][SQL] CliSuite flakiness fix via differentiating cli driver bootup timeout and query execution timeout

2020-07-08 Thread GitBox
SparkQA commented on pull request #29036: URL: https://github.com/apache/spark/pull/29036#issuecomment-655394075 **[Test build #125339 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125339/testReport)** for PR 29036 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29036: [WIP][SPARK-XXXXX][SQL] CliSuite flakiness fix via differentiating cli driver bootup timeout and query execution timeout

2020-07-08 Thread GitBox
AmplabJenkins removed a comment on pull request #29036: URL: https://github.com/apache/spark/pull/29036#issuecomment-655394285 Merged build finished. Test FAILed. This is an automated message from the Apache Git Service. To

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29036: [WIP][SPARK-XXXXX][SQL] CliSuite flakiness fix via differentiating cli driver bootup timeout and query execution timeout

2020-07-08 Thread GitBox
AmplabJenkins removed a comment on pull request #29036: URL: https://github.com/apache/spark/pull/29036#issuecomment-655394301 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] SparkQA removed a comment on pull request #29036: [WIP][SPARK-XXXXX][SQL] CliSuite flakiness fix via differentiating cli driver bootup timeout and query execution timeout

2020-07-08 Thread GitBox
SparkQA removed a comment on pull request #29036: URL: https://github.com/apache/spark/pull/29036#issuecomment-655383674 **[Test build #125339 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125339/testReport)** for PR 29036 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28979: [SPARK-32154][SQL] Use ExpressionEncoder for the return type of ScalaUDF to convert to catalyst type

2020-07-08 Thread GitBox
AmplabJenkins removed a comment on pull request #28979: URL: https://github.com/apache/spark/pull/28979#issuecomment-655393966 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins commented on pull request #29036: [WIP][SPARK-XXXXX][SQL] CliSuite flakiness fix via differentiating cli driver bootup timeout and query execution timeout

2020-07-08 Thread GitBox
AmplabJenkins commented on pull request #29036: URL: https://github.com/apache/spark/pull/29036#issuecomment-655394285 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] SparkQA commented on pull request #29024: [WIP][SPARK-32001][SQL]Create JDBC authentication provider developer API

2020-07-08 Thread GitBox
SparkQA commented on pull request #29024: URL: https://github.com/apache/spark/pull/29024#issuecomment-655403852 **[Test build #125344 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125344/testReport)** for PR 29024 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28939: [SPARK-32119][CORE] ExecutorPlugin doesn't work with Standalone Cluster

2020-07-08 Thread GitBox
AmplabJenkins removed a comment on pull request #28939: URL: https://github.com/apache/spark/pull/28939#issuecomment-655309045 Merged build finished. Test FAILed. This is an automated message from the Apache Git Service. To

[GitHub] [spark] yaooqinn commented on a change in pull request #29022: [SPARK-32207][SQL] Support 'F'-suffixed Float Literals

2020-07-08 Thread GitBox
yaooqinn commented on a change in pull request #29022: URL: https://github.com/apache/spark/pull/29022#discussion_r451305791 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/parser/AstBuilder.scala ## @@ -2030,6 +2030,12 @@ class AstBuilder(conf:

[GitHub] [spark] SparkQA commented on pull request #29034: [SPARK-32219][SQL] Add SHOW CACHED TABLES Command

2020-07-08 Thread GitBox
SparkQA commented on pull request #29034: URL: https://github.com/apache/spark/pull/29034#issuecomment-655315149 **[Test build #125308 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125308/testReport)** for PR 29034 at commit

[GitHub] [spark] SparkQA commented on pull request #29020: [SPARK-23431][CORE] Expose stage level peak executor metrics via REST API

2020-07-08 Thread GitBox
SparkQA commented on pull request #29020: URL: https://github.com/apache/spark/pull/29020#issuecomment-655315589 **[Test build #125278 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125278/testReport)** for PR 29020 at commit

[GitHub] [spark] AmplabJenkins commented on pull request #29034: [SPARK-32219][SQL] Add SHOW CACHED TABLES Command

2020-07-08 Thread GitBox
AmplabJenkins commented on pull request #29034: URL: https://github.com/apache/spark/pull/29034#issuecomment-655315621 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28953: [SPARK-32013][SQL] Support query execution before/after reading/writing DataFrame over JDBC

2020-07-08 Thread GitBox
AmplabJenkins removed a comment on pull request #28953: URL: https://github.com/apache/spark/pull/28953#issuecomment-655321894 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins commented on pull request #29020: [SPARK-23431][CORE] Expose stage level peak executor metrics via REST API

2020-07-08 Thread GitBox
AmplabJenkins commented on pull request #29020: URL: https://github.com/apache/spark/pull/29020#issuecomment-655349133 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29020: [SPARK-23431][CORE] Expose stage level peak executor metrics via REST API

2020-07-08 Thread GitBox
AmplabJenkins removed a comment on pull request #29020: URL: https://github.com/apache/spark/pull/29020#issuecomment-655349133 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] SparkQA commented on pull request #27690: [SPARK-21514][SQL] Added a new option to use non-blobstore storage when writing into blobstore storage

2020-07-08 Thread GitBox
SparkQA commented on pull request #27690: URL: https://github.com/apache/spark/pull/27690#issuecomment-655355807 **[Test build #125330 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125330/testReport)** for PR 27690 at commit

[GitHub] [spark] maropu commented on pull request #29013: [SPARK-32196][SQL] Extract In convertible part if it is not convertible

2020-07-08 Thread GitBox
maropu commented on pull request #29013: URL: https://github.com/apache/spark/pull/29013#issuecomment-655362149 Why is ` where c1 in (1, 2) or c1 in (c2)` an optimized form? You mean it is fater than `where c1 in (1, 2, c2)`? At least, I think you need to describe more in the PR

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28898: [SPARK-32059][SQL] Allow nested schema pruning thru window/sort/filter plans

2020-07-08 Thread GitBox
AmplabJenkins removed a comment on pull request #28898: URL: https://github.com/apache/spark/pull/28898#issuecomment-655368737 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins removed a comment on pull request #26935: [SPARK-30294][SS] Explicitly defines read-only StateStore and optimize for HDFSBackedStateStore

2020-07-08 Thread GitBox
AmplabJenkins removed a comment on pull request #26935: URL: https://github.com/apache/spark/pull/26935#issuecomment-655372790 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] SparkQA removed a comment on pull request #28926: [SPARK-32133][SQL] Forbid time field steps for date start/end in Sequence

2020-07-08 Thread GitBox
SparkQA removed a comment on pull request #28926: URL: https://github.com/apache/spark/pull/28926#issuecomment-655363819 **[Test build #125333 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125333/testReport)** for PR 28926 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #26935: [SPARK-30294][SS] Explicitly defines read-only StateStore and optimize for HDFSBackedStateStore

2020-07-08 Thread GitBox
AmplabJenkins removed a comment on pull request #26935: URL: https://github.com/apache/spark/pull/26935#issuecomment-655372783 Merged build finished. Test FAILed. This is an automated message from the Apache Git Service. To

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28926: [SPARK-32133][SQL] Forbid time field steps for date start/end in Sequence

2020-07-08 Thread GitBox
AmplabJenkins removed a comment on pull request #28926: URL: https://github.com/apache/spark/pull/28926#issuecomment-655372253 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] HeartSaVioR commented on pull request #29036: [WIP][SPARK-XXXXX][SQL] CliSuite flakiness fix via differentiating cli driver bootup timeout and query execution timeout

2020-07-08 Thread GitBox
HeartSaVioR commented on pull request #29036: URL: https://github.com/apache/spark/pull/29036#issuecomment-655381588 Rationalization: I've been looking into the recent failures of CliSuite, and realized it took around 40 seconds for bootup message (`master: ... Application Id: ...`) to be

[GitHub] [spark] ulysses-you commented on pull request #29013: [SPARK-32196][SQL] Extract In convertible part if it is not convertible

2020-07-08 Thread GitBox
ulysses-you commented on pull request #29013: URL: https://github.com/apache/spark/pull/29013#issuecomment-655396900 @maropu Once we have `where c1 in (1, 2) or c1 in (c2)`, we can optimize the `c1 in (1, 2)` part with `OptimizeIn`. e.g. ``` c1 in(1, c2) => c1 = 1 or c1 in(c2)

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28848: [SPARK-32003][CORE] When external shuffle service is used, unregister outputs for executor on fetch failure after executor is l

2020-07-08 Thread GitBox
AmplabJenkins removed a comment on pull request #28848: URL: https://github.com/apache/spark/pull/28848#issuecomment-655392280 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins commented on pull request #28848: [SPARK-32003][CORE] When external shuffle service is used, unregister outputs for executor on fetch failure after executor is lost

2020-07-08 Thread GitBox
AmplabJenkins commented on pull request #28848: URL: https://github.com/apache/spark/pull/28848#issuecomment-655396368 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] SparkQA removed a comment on pull request #28848: [SPARK-32003][CORE] When external shuffle service is used, unregister outputs for executor on fetch failure after executor is lost

2020-07-08 Thread GitBox
SparkQA removed a comment on pull request #28848: URL: https://github.com/apache/spark/pull/28848#issuecomment-655383707 **[Test build #125340 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125340/testReport)** for PR 28848 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28848: [SPARK-32003][CORE] When external shuffle service is used, unregister outputs for executor on fetch failure after executor is l

2020-07-08 Thread GitBox
AmplabJenkins removed a comment on pull request #28848: URL: https://github.com/apache/spark/pull/28848#issuecomment-655396381 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] ulysses-you opened a new pull request #29034: [SPARK-32219][SQL] Add SHOW CACHED TABLES Command

2020-07-08 Thread GitBox
ulysses-you opened a new pull request #29034: URL: https://github.com/apache/spark/pull/29034 ### What changes were proposed in this pull request? Modify `SHOW TABLES` to support `SHOW CACHED TABLES`. After this pr, we can call ``` SHOW CACHED TABLES; ```

[GitHub] [spark] AmplabJenkins commented on pull request #29020: [SPARK-23431][CORE] Expose stage level peak executor metrics via REST API

2020-07-08 Thread GitBox
AmplabJenkins commented on pull request #29020: URL: https://github.com/apache/spark/pull/29020#issuecomment-655317534 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29029: [SPARK-32214][SQL] The type conversion function generated in makeFromJava for "other" type uses a wrong variable.

2020-07-08 Thread GitBox
AmplabJenkins removed a comment on pull request #29029: URL: https://github.com/apache/spark/pull/29029#issuecomment-655317269 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] imback82 commented on pull request #29020: [SPARK-23431][CORE] Expose stage level peak executor metrics via REST API

2020-07-08 Thread GitBox
imback82 commented on pull request #29020: URL: https://github.com/apache/spark/pull/29020#issuecomment-655317913 retest this please This is an automated message from the Apache Git Service. To respond to the message, please

[GitHub] [spark] yaooqinn commented on pull request #29022: [SPARK-32207][SQL] Support 'F'-suffixed Float Literals

2020-07-08 Thread GitBox
yaooqinn commented on pull request #29022: URL: https://github.com/apache/spark/pull/29022#issuecomment-655317952 > Maybe we should convert suffix to alias. Please see these examples for more details: If the digits part is integral, e.g. `2f`, `2a`, these systems vary from each

[GitHub] [spark] kiszk commented on pull request #28953: [SPARK-32013][SQL] Support query execution before/after reading/writing DataFrame over JDBC

2020-07-08 Thread GitBox
kiszk commented on pull request #28953: URL: https://github.com/apache/spark/pull/28953#issuecomment-655320879 retest this please This is an automated message from the Apache Git Service. To respond to the message, please

[GitHub] [spark] SparkQA commented on pull request #27428: [SPARK-30276][SQL] Support Filter expression allows simultaneous use of DISTINCT

2020-07-08 Thread GitBox
SparkQA commented on pull request #27428: URL: https://github.com/apache/spark/pull/27428#issuecomment-655337298 **[Test build #125319 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125319/testReport)** for PR 27428 at commit

[GitHub] [spark] SparkQA commented on pull request #28975: [SPARK-32148][SS] Fix stream-stream join issue on missing to copy reused unsafe row

2020-07-08 Thread GitBox
SparkQA commented on pull request #28975: URL: https://github.com/apache/spark/pull/28975#issuecomment-655337317 **[Test build #125317 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125317/testReport)** for PR 28975 at commit

[GitHub] [spark] cloud-fan commented on pull request #29026: [SPARK-28067][SPARK-32018] Fix decimal overflow issues

2020-07-08 Thread GitBox
cloud-fan commented on pull request #29026: URL: https://github.com/apache/spark/pull/29026#issuecomment-655336987 retest this please This is an automated message from the Apache Git Service. To respond to the message,

[GitHub] [spark] SparkQA commented on pull request #28953: [SPARK-32013][SQL] Support query execution before/after reading/writing DataFrame over JDBC

2020-07-08 Thread GitBox
SparkQA commented on pull request #28953: URL: https://github.com/apache/spark/pull/28953#issuecomment-655337342 **[Test build #125318 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125318/testReport)** for PR 28953 at commit

[GitHub] [spark] SparkQA commented on pull request #29002: [SPARK-32175][CORE] Fix the order between initialization for ExecutorPlugin and starting heartbeat thread

2020-07-08 Thread GitBox
SparkQA commented on pull request #29002: URL: https://github.com/apache/spark/pull/29002#issuecomment-655337239 **[Test build #125316 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125316/testReport)** for PR 29002 at commit

[GitHub] [spark] SparkQA commented on pull request #29026: [SPARK-28067][SPARK-32018] Fix decimal overflow issues

2020-07-08 Thread GitBox
SparkQA commented on pull request #29026: URL: https://github.com/apache/spark/pull/29026#issuecomment-655337284 **[Test build #125315 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125315/testReport)** for PR 29026 at commit

[GitHub] [spark] SparkQA commented on pull request #29020: [SPARK-23431][CORE] Expose stage level peak executor metrics via REST API

2020-07-08 Thread GitBox
SparkQA commented on pull request #29020: URL: https://github.com/apache/spark/pull/29020#issuecomment-655348480 **[Test build #125328 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125328/testReport)** for PR 29020 at commit

<    1   2   3   4   5   6   7   8   9   10   >