[GitHub] [spark] maropu commented on a change in pull request #28953: [SPARK-32013][SQL] Support query execution before/after reading/writing DataFrame over JDBC

2020-07-08 Thread GitBox
maropu commented on a change in pull request #28953: URL: https://github.com/apache/spark/pull/28953#discussion_r451308570 ## File path: sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/jdbc/JdbcUtils.scala ## @@ -122,6 +122,37 @@ object JdbcUtils extends

[GitHub] [spark] SparkQA commented on pull request #29022: [SPARK-32207][SQL] Support 'F'-suffixed Float Literals

2020-07-08 Thread GitBox
SparkQA commented on pull request #29022: URL: https://github.com/apache/spark/pull/29022#issuecomment-655312281 **[Test build #125307 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125307/testReport)** for PR 29022 at commit

[GitHub] [spark] AmplabJenkins commented on pull request #29022: [SPARK-32207][SQL] Support 'F'-suffixed Float Literals

2020-07-08 Thread GitBox
AmplabJenkins commented on pull request #29022: URL: https://github.com/apache/spark/pull/29022#issuecomment-655312665 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29022: [SPARK-32207][SQL] Support 'F'-suffixed Float Literals

2020-07-08 Thread GitBox
AmplabJenkins removed a comment on pull request #29022: URL: https://github.com/apache/spark/pull/29022#issuecomment-655312665 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29019: [2.4][SPARK-32167][SQL] Fix GetArrayStructFields to respect inner field's nullability together

2020-07-08 Thread GitBox
AmplabJenkins removed a comment on pull request #29019: URL: https://github.com/apache/spark/pull/29019#issuecomment-655319667 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29019: [2.4][SPARK-32167][SQL] Fix GetArrayStructFields to respect inner field's nullability together

2020-07-08 Thread GitBox
AmplabJenkins removed a comment on pull request #29019: URL: https://github.com/apache/spark/pull/29019#issuecomment-655319665 Merged build finished. Test FAILed. This is an automated message from the Apache Git Service. To

[GitHub] [spark] SparkQA commented on pull request #29035: [SPARK-32220][SQL]SHUFFLE_REPLICATE_NL Hint should not change Non-Cartesian Product join redsult

2020-07-08 Thread GitBox
SparkQA commented on pull request #29035: URL: https://github.com/apache/spark/pull/29035#issuecomment-655333845 **[Test build #125314 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125314/testReport)** for PR 29035 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28803: [SPARK-31971][WEBUI] Add pagination support for all jobs timeline

2020-07-08 Thread GitBox
AmplabJenkins removed a comment on pull request #28803: URL: https://github.com/apache/spark/pull/28803#issuecomment-655333656 Merged build finished. Test FAILed. This is an automated message from the Apache Git Service. To

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29026: [SPARK-28067][SPARK-32018] Fix decimal overflow issues

2020-07-08 Thread GitBox
AmplabJenkins removed a comment on pull request #29026: URL: https://github.com/apache/spark/pull/29026#issuecomment-655333564 Merged build finished. Test FAILed. This is an automated message from the Apache Git Service. To

[GitHub] [spark] AmplabJenkins commented on pull request #28803: [SPARK-31971][WEBUI] Add pagination support for all jobs timeline

2020-07-08 Thread GitBox
AmplabJenkins commented on pull request #28803: URL: https://github.com/apache/spark/pull/28803#issuecomment-655333656 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins commented on pull request #28898: [SPARK-32059][SQL] Allow nested schema pruning thru window/sort/filter plans

2020-07-08 Thread GitBox
AmplabJenkins commented on pull request #28898: URL: https://github.com/apache/spark/pull/28898#issuecomment-655334501 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28898: [SPARK-32059][SQL] Allow nested schema pruning thru window/sort/filter plans

2020-07-08 Thread GitBox
AmplabJenkins removed a comment on pull request #28898: URL: https://github.com/apache/spark/pull/28898#issuecomment-655334501 Merged build finished. Test FAILed. This is an automated message from the Apache Git Service. To

[GitHub] [spark] AmplabJenkins commented on pull request #28975: [SPARK-32148][SS] Fix stream-stream join issue on missing to copy reused unsafe row

2020-07-08 Thread GitBox
AmplabJenkins commented on pull request #28975: URL: https://github.com/apache/spark/pull/28975#issuecomment-655334516 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins commented on pull request #29035: [SPARK-32220][SQL]SHUFFLE_REPLICATE_NL Hint should not change Non-Cartesian Product join redsult

2020-07-08 Thread GitBox
AmplabJenkins commented on pull request #29035: URL: https://github.com/apache/spark/pull/29035#issuecomment-655334589 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins commented on pull request #28977: [WIP] Add all hive.execution suite in the parallel test group

2020-07-08 Thread GitBox
AmplabJenkins commented on pull request #28977: URL: https://github.com/apache/spark/pull/28977#issuecomment-655334795 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins commented on pull request #28969: [SPARK-32150][BUILD] Upgrade to ZStd 1.4.5-4

2020-07-08 Thread GitBox
AmplabJenkins commented on pull request #28969: URL: https://github.com/apache/spark/pull/28969#issuecomment-655334791 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28975: [SPARK-32148][SS] Fix stream-stream join issue on missing to copy reused unsafe row

2020-07-08 Thread GitBox
AmplabJenkins removed a comment on pull request #28975: URL: https://github.com/apache/spark/pull/28975#issuecomment-655334516 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29035: [SPARK-32220][SQL]SHUFFLE_REPLICATE_NL Hint should not change Non-Cartesian Product join redsult

2020-07-08 Thread GitBox
AmplabJenkins removed a comment on pull request #29035: URL: https://github.com/apache/spark/pull/29035#issuecomment-655334589 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] HeartSaVioR commented on pull request #28975: [SPARK-32148][SS] Fix stream-stream join issue on missing to copy reused unsafe row

2020-07-08 Thread GitBox
HeartSaVioR commented on pull request #28975: URL: https://github.com/apache/spark/pull/28975#issuecomment-655334279 retest this, please This is an automated message from the Apache Git Service. To respond to the message,

[GitHub] [spark] HeartSaVioR removed a comment on pull request #28975: [SPARK-32148][SS] Fix stream-stream join issue on missing to copy reused unsafe row

2020-07-08 Thread GitBox
HeartSaVioR removed a comment on pull request #28975: URL: https://github.com/apache/spark/pull/28975#issuecomment-655331028 retest this, please This is an automated message from the Apache Git Service. To respond to

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29026: [SPARK-28067][SPARK-32018] Fix decimal overflow issues

2020-07-08 Thread GitBox
AmplabJenkins removed a comment on pull request #29026: URL: https://github.com/apache/spark/pull/29026#issuecomment-655333576 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28975: [SPARK-32148][SS] Fix stream-stream join issue on missing to copy reused unsafe row

2020-07-08 Thread GitBox
AmplabJenkins removed a comment on pull request #28975: URL: https://github.com/apache/spark/pull/28975#issuecomment-655332055 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28803: [SPARK-31971][WEBUI] Add pagination support for all jobs timeline

2020-07-08 Thread GitBox
AmplabJenkins removed a comment on pull request #28803: URL: https://github.com/apache/spark/pull/28803#issuecomment-655333663 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on pull request #27983: [SPARK-32105][SQL]Refactor current ScriptTransformationExec code

2020-07-08 Thread GitBox
AmplabJenkins removed a comment on pull request #27983: URL: https://github.com/apache/spark/pull/27983#issuecomment-655341963 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins commented on pull request #28993: [SPARK-32168][SQL] Fix hidden partitioning correctness bug in SQL overwrite

2020-07-08 Thread GitBox
AmplabJenkins commented on pull request #28993: URL: https://github.com/apache/spark/pull/28993#issuecomment-655341703 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins commented on pull request #28683: [SPARK-31875][SQL] Provide a option to disable user supplied Hints

2020-07-08 Thread GitBox
AmplabJenkins commented on pull request #28683: URL: https://github.com/apache/spark/pull/28683#issuecomment-655341774 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28993: [SPARK-32168][SQL] Fix hidden partitioning correctness bug in SQL overwrite

2020-07-08 Thread GitBox
AmplabJenkins removed a comment on pull request #28993: URL: https://github.com/apache/spark/pull/28993#issuecomment-655341703 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins commented on pull request #25290: [SPARK-28551][SQL]Add a Checker Rule when CTAS SQL with LOCATION

2020-07-08 Thread GitBox
AmplabJenkins commented on pull request #25290: URL: https://github.com/apache/spark/pull/25290#issuecomment-655341883 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins commented on pull request #27983: [SPARK-32105][SQL]Refactor current ScriptTransformationExec code

2020-07-08 Thread GitBox
AmplabJenkins commented on pull request #27983: URL: https://github.com/apache/spark/pull/27983#issuecomment-655341963 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28683: [SPARK-31875][SQL] Provide a option to disable user supplied Hints

2020-07-08 Thread GitBox
AmplabJenkins removed a comment on pull request #28683: URL: https://github.com/apache/spark/pull/28683#issuecomment-655341774 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins removed a comment on pull request #25290: [SPARK-28551][SQL]Add a Checker Rule when CTAS SQL with LOCATION

2020-07-08 Thread GitBox
AmplabJenkins removed a comment on pull request #25290: URL: https://github.com/apache/spark/pull/25290#issuecomment-655341883 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29022: [SPARK-32207][SQL] Support 'F'-suffixed Float Literals

2020-07-08 Thread GitBox
AmplabJenkins removed a comment on pull request #29022: URL: https://github.com/apache/spark/pull/29022#issuecomment-655341643 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] maropu commented on a change in pull request #28953: [SPARK-32013][SQL] Support query execution before/after reading/writing DataFrame over JDBC

2020-07-08 Thread GitBox
maropu commented on a change in pull request #28953: URL: https://github.com/apache/spark/pull/28953#discussion_r451339072 ## File path: docs/sql-data-sources-jdbc.md ## @@ -156,6 +156,20 @@ the following case-insensitive options: + + preActions + +

[GitHub] [spark] gaborgsomogyi commented on pull request #29024: [WIP][SPARK-32001][SQL]Create JDBC authentication provider developer API

2020-07-08 Thread GitBox
gaborgsomogyi commented on pull request #29024: URL: https://github.com/apache/spark/pull/29024#issuecomment-655342131 Found the issue. `JDBCWriteSuite` initiated provider load before `ConnectionProviderSuite` which resulted noop in the second case. All in all `ConnectionProviderSuite`

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28983: [SPARK-32159][SQL] Fix integration between Aggregator[Array[_], _, _] and UnresolvedMapObjects

2020-07-08 Thread GitBox
AmplabJenkins removed a comment on pull request #28983: URL: https://github.com/apache/spark/pull/28983#issuecomment-655341607 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins commented on pull request #28983: [SPARK-32159][SQL] Fix integration between Aggregator[Array[_], _, _] and UnresolvedMapObjects

2020-07-08 Thread GitBox
AmplabJenkins commented on pull request #28983: URL: https://github.com/apache/spark/pull/28983#issuecomment-655341607 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins commented on pull request #29022: [SPARK-32207][SQL] Support 'F'-suffixed Float Literals

2020-07-08 Thread GitBox
AmplabJenkins commented on pull request #29022: URL: https://github.com/apache/spark/pull/29022#issuecomment-655341643 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29019: [2.4][SPARK-32167][SQL] Fix GetArrayStructFields to respect inner field's nullability together

2020-07-08 Thread GitBox
AmplabJenkins removed a comment on pull request #29019: URL: https://github.com/apache/spark/pull/29019#issuecomment-655341636 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins commented on pull request #29019: [2.4][SPARK-32167][SQL] Fix GetArrayStructFields to respect inner field's nullability together

2020-07-08 Thread GitBox
AmplabJenkins commented on pull request #29019: URL: https://github.com/apache/spark/pull/29019#issuecomment-655341636 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins removed a comment on pull request #26935: [SPARK-30294][SS] Explicitly defines read-only StateStore and optimize for HDFSBackedStateStore

2020-07-08 Thread GitBox
AmplabJenkins removed a comment on pull request #26935: URL: https://github.com/apache/spark/pull/26935#issuecomment-655345537 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins commented on pull request #26935: [SPARK-30294][SS] Explicitly defines read-only StateStore and optimize for HDFSBackedStateStore

2020-07-08 Thread GitBox
AmplabJenkins commented on pull request #26935: URL: https://github.com/apache/spark/pull/26935#issuecomment-655345537 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins commented on pull request #28998: [SPARK-32173][SQL] Deduplicate code in FromUTCTimestamp and ToUTCTimestamp

2020-07-08 Thread GitBox
AmplabJenkins commented on pull request #28998: URL: https://github.com/apache/spark/pull/28998#issuecomment-655345501 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28998: [SPARK-32173][SQL] Deduplicate code in FromUTCTimestamp and ToUTCTimestamp

2020-07-08 Thread GitBox
AmplabJenkins removed a comment on pull request #28998: URL: https://github.com/apache/spark/pull/28998#issuecomment-655345501 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] ScrapCodes edited a comment on pull request #27735: [RFC][SPARK-30985][k8s] Support propagating SPARK_CONF_DIR files to driver and executor pods.

2020-07-08 Thread GitBox
ScrapCodes edited a comment on pull request #27735: URL: https://github.com/apache/spark/pull/27735#issuecomment-655333175 Hi @dongjoon-hyun and @holdenk , can you please take a look at this PR/issue/design doc, and at least comment on the overall usefulness. Do you think it makes sense

[GitHub] [spark] HyukjinKwon commented on pull request #29017: [WIP][SPARK-XXX][TESTS] Disable SBT unidoc generation testing in Jenkins

2020-07-08 Thread GitBox
HyukjinKwon commented on pull request #29017: URL: https://github.com/apache/spark/pull/29017#issuecomment-655378117 The documentation build failure is one of many problems, @ScrapCodes. Most of builds are already being failed due to the flakiness apparently because the meachines are

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28986: [SPARK-32160][CORE][PYSPARK] Disallow to create SparkContext in executors.

2020-07-08 Thread GitBox
AmplabJenkins removed a comment on pull request #28986: URL: https://github.com/apache/spark/pull/28986#issuecomment-655377143 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] SparkQA removed a comment on pull request #28986: [SPARK-32160][CORE][PYSPARK] Disallow to create SparkContext in executors.

2020-07-08 Thread GitBox
SparkQA removed a comment on pull request #28986: URL: https://github.com/apache/spark/pull/28986#issuecomment-655367848 **[Test build #125336 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125336/testReport)** for PR 28986 at commit

[GitHub] [spark] AmplabJenkins commented on pull request #28986: [SPARK-32160][CORE][PYSPARK] Disallow to create SparkContext in executors.

2020-07-08 Thread GitBox
AmplabJenkins commented on pull request #28986: URL: https://github.com/apache/spark/pull/28986#issuecomment-655377133 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28986: [SPARK-32160][CORE][PYSPARK] Disallow to create SparkContext in executors.

2020-07-08 Thread GitBox
AmplabJenkins removed a comment on pull request #28986: URL: https://github.com/apache/spark/pull/28986#issuecomment-655377133 Merged build finished. Test FAILed. This is an automated message from the Apache Git Service. To

[GitHub] [spark] HeartSaVioR opened a new pull request #29036: [WIP][SPARK-XXXXX][SQL] CliSuite flakiness fix via differentiating cli driver bootup timeout and query execution timeout

2020-07-08 Thread GitBox
HeartSaVioR opened a new pull request #29036: URL: https://github.com/apache/spark/pull/29036 ### What changes were proposed in this pull request? ...TBD... ### Why are the changes needed? ...TBD... ### Does this PR introduce _any_ user-facing change?

[GitHub] [spark] HyukjinKwon commented on pull request #29017: [WIP][SPARK-XXX][TESTS] Disable SBT unidoc generation testing in Jenkins

2020-07-08 Thread GitBox
HyukjinKwon commented on pull request #29017: URL: https://github.com/apache/spark/pull/29017#issuecomment-655378671 This is why I am suggesting to move to Github Actions too. It has been more than a week but we don't have much progress on it.

[GitHub] [spark] HyukjinKwon commented on pull request #28986: [SPARK-32160][CORE][PYSPARK] Disallow to create SparkContext in executors.

2020-07-08 Thread GitBox
HyukjinKwon commented on pull request #28986: URL: https://github.com/apache/spark/pull/28986#issuecomment-655387473 retest this please This is an automated message from the Apache Git Service. To respond to the message,

[GitHub] [spark] HeartSaVioR commented on pull request #29036: [WIP][SPARK-XXXXX][SQL] CliSuite flakiness fix via differentiating cli driver bootup timeout and query execution timeout

2020-07-08 Thread GitBox
HeartSaVioR commented on pull request #29036: URL: https://github.com/apache/spark/pull/29036#issuecomment-655395314 I’ll temporarily disable gendoc here soon to unblock experiments. This is an automated message from the

[GitHub] [spark] SparkQA commented on pull request #28848: [SPARK-32003][CORE] When external shuffle service is used, unregister outputs for executor on fetch failure after executor is lost

2020-07-08 Thread GitBox
SparkQA commented on pull request #28848: URL: https://github.com/apache/spark/pull/28848#issuecomment-655396260 **[Test build #125340 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125340/testReport)** for PR 28848 at commit

[GitHub] [spark] SparkQA removed a comment on pull request #29020: [SPARK-23431][CORE] Expose stage level peak executor metrics via REST API

2020-07-08 Thread GitBox
SparkQA removed a comment on pull request #29020: URL: https://github.com/apache/spark/pull/29020#issuecomment-655233154 **[Test build #125278 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125278/testReport)** for PR 29020 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29034: [SPARK-32219][SQL] Add SHOW CACHED TABLES Command

2020-07-08 Thread GitBox
AmplabJenkins removed a comment on pull request #29034: URL: https://github.com/apache/spark/pull/29034#issuecomment-655315621 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] SparkQA removed a comment on pull request #29029: [SPARK-32214][SQL] The type conversion function generated in makeFromJava for "other" type uses a wrong variable.

2020-07-08 Thread GitBox
SparkQA removed a comment on pull request #29029: URL: https://github.com/apache/spark/pull/29029#issuecomment-655165177 **[Test build #125261 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125261/testReport)** for PR 29029 at commit

[GitHub] [spark] SparkQA commented on pull request #29029: [SPARK-32214][SQL] The type conversion function generated in makeFromJava for "other" type uses a wrong variable.

2020-07-08 Thread GitBox
SparkQA commented on pull request #29029: URL: https://github.com/apache/spark/pull/29029#issuecomment-655316181 **[Test build #125261 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125261/testReport)** for PR 29029 at commit

[GitHub] [spark] SparkQA commented on pull request #28953: [SPARK-32013][SQL] Support query execution before/after reading/writing DataFrame over JDBC

2020-07-08 Thread GitBox
SparkQA commented on pull request #28953: URL: https://github.com/apache/spark/pull/28953#issuecomment-655321279 **[Test build #125310 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125310/testReport)** for PR 28953 at commit

[GitHub] [spark] wangyum commented on pull request #29022: [SPARK-32207][SQL] Support 'F'-suffixed Float Literals

2020-07-08 Thread GitBox
wangyum commented on pull request #29022: URL: https://github.com/apache/spark/pull/29022#issuecomment-655321571 Is there a system support `F`-suffixed as float Literal? This is an automated message from the Apache Git

[GitHub] [spark] AmplabJenkins commented on pull request #28953: [SPARK-32013][SQL] Support query execution before/after reading/writing DataFrame over JDBC

2020-07-08 Thread GitBox
AmplabJenkins commented on pull request #28953: URL: https://github.com/apache/spark/pull/28953#issuecomment-655321902 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins removed a comment on pull request #27428: [SPARK-30276][SQL] Support Filter expression allows simultaneous use of DISTINCT

2020-07-08 Thread GitBox
AmplabJenkins removed a comment on pull request #27428: URL: https://github.com/apache/spark/pull/27428#issuecomment-655324580 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] LantaoJin edited a comment on pull request #29021: [WIP][SPARK-32201][SQL] More general skew join pattern matching

2020-07-08 Thread GitBox
LantaoJin edited a comment on pull request #29021: URL: https://github.com/apache/spark/pull/29021#issuecomment-655272794 In the case I given in the description. If I add a LIMIT in the SQL ``` SELECT * FROM skewData1 AS data1 INNER JOIN ( SELECT skewData2.key2,

[GitHub] [spark] HeartSaVioR edited a comment on pull request #28859: [SPARK-32024][WEBUI] Update ApplicationStoreInfo.size during HistoryServerDiskManager initializing

2020-07-08 Thread GitBox
HeartSaVioR edited a comment on pull request #28859: URL: https://github.com/apache/spark/pull/28859#issuecomment-655325185 The PR builders look to be quite unstable, though all the test failures are not related to the change. > build 125054

[GitHub] [spark] SparkQA commented on pull request #28859: [SPARK-32024][WEBUI] Update ApplicationStoreInfo.size during HistoryServerDiskManager initializing

2020-07-08 Thread GitBox
SparkQA commented on pull request #28859: URL: https://github.com/apache/spark/pull/28859#issuecomment-655330476 **[Test build #125313 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125313/testReport)** for PR 28859 at commit

[GitHub] [spark] SparkQA commented on pull request #28803: [SPARK-31971][WEBUI] Add pagination support for all jobs timeline

2020-07-08 Thread GitBox
SparkQA commented on pull request #28803: URL: https://github.com/apache/spark/pull/28803#issuecomment-655330652 **[Test build #125295 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125295/testReport)** for PR 28803 at commit

[GitHub] [spark] SparkQA commented on pull request #27983: [SPARK-32105][SQL]Refactor current ScriptTransformationExec code

2020-07-08 Thread GitBox
SparkQA commented on pull request #27983: URL: https://github.com/apache/spark/pull/27983#issuecomment-655330670 **[Test build #125305 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125305/testReport)** for PR 27983 at commit

[GitHub] [spark] AmplabJenkins commented on pull request #29022: [SPARK-32207][SQL] Support 'F'-suffixed Float Literals

2020-07-08 Thread GitBox
AmplabJenkins commented on pull request #29022: URL: https://github.com/apache/spark/pull/29022#issuecomment-655330827 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] SparkQA commented on pull request #28953: [SPARK-32013][SQL] Support query execution before/after reading/writing DataFrame over JDBC

2020-07-08 Thread GitBox
SparkQA commented on pull request #28953: URL: https://github.com/apache/spark/pull/28953#issuecomment-655330642 **[Test build #125310 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125310/testReport)** for PR 28953 at commit

[GitHub] [spark] SparkQA commented on pull request #28986: [SPARK-32160][CORE][PYSPARK] Disallow to create SparkContext in executors.

2020-07-08 Thread GitBox
SparkQA commented on pull request #28986: URL: https://github.com/apache/spark/pull/28986#issuecomment-655330640 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and

[GitHub] [spark] SparkQA commented on pull request #29033: [SPARK-30703][SQL][FOLLOWUP] Update SqlBase.g4 invalid comment

2020-07-08 Thread GitBox
SparkQA commented on pull request #29033: URL: https://github.com/apache/spark/pull/29033#issuecomment-655330671 **[Test build #125280 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125280/testReport)** for PR 29033 at commit

[GitHub] [spark] SparkQA commented on pull request #29034: [SPARK-32219][SQL] Add SHOW CACHED TABLES Command

2020-07-08 Thread GitBox
SparkQA commented on pull request #29034: URL: https://github.com/apache/spark/pull/29034#issuecomment-655330639 **[Test build #125308 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125308/testReport)** for PR 29034 at commit

[GitHub] [spark] AmplabJenkins commented on pull request #28953: [SPARK-32013][SQL] Support query execution before/after reading/writing DataFrame over JDBC

2020-07-08 Thread GitBox
AmplabJenkins commented on pull request #28953: URL: https://github.com/apache/spark/pull/28953#issuecomment-655330800 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AngersZhuuuu opened a new pull request #29035: [SPARK-32220][SQL]SHUFFLE_REPLICATE_NL Hint should not change Non-Cartesian Product join redsult

2020-07-08 Thread GitBox
AngersZh opened a new pull request #29035: URL: https://github.com/apache/spark/pull/29035 ### What changes were proposed in this pull request? In current Join Hint strategies, if we use SHUFFLE_REPLICATE_NL hint, it will directly convert join to Cartesian Product Join and loss join

[GitHub] [spark] SparkQA commented on pull request #29013: [SPARK-32196][SQL] Extract In convertible part if it is not convertible

2020-07-08 Thread GitBox
SparkQA commented on pull request #29013: URL: https://github.com/apache/spark/pull/29013#issuecomment-655330667 **[Test build #125299 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125299/testReport)** for PR 29013 at commit

[GitHub] [spark] AmplabJenkins commented on pull request #27428: [SPARK-30276][SQL] Support Filter expression allows simultaneous use of DISTINCT

2020-07-08 Thread GitBox
AmplabJenkins commented on pull request #27428: URL: https://github.com/apache/spark/pull/27428#issuecomment-655330831 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] SparkQA commented on pull request #29026: [SPARK-28067][SPARK-32018] Fix decimal overflow issues

2020-07-08 Thread GitBox
SparkQA commented on pull request #29026: URL: https://github.com/apache/spark/pull/29026#issuecomment-655330647 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and

[GitHub] [spark] SparkQA commented on pull request #29022: [SPARK-32207][SQL] Support 'F'-suffixed Float Literals

2020-07-08 Thread GitBox
SparkQA commented on pull request #29022: URL: https://github.com/apache/spark/pull/29022#issuecomment-655330646 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and

[GitHub] [spark] SparkQA removed a comment on pull request #27428: [SPARK-30276][SQL] Support Filter expression allows simultaneous use of DISTINCT

2020-07-08 Thread GitBox
SparkQA removed a comment on pull request #27428: URL: https://github.com/apache/spark/pull/27428#issuecomment-655327178 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] SparkQA commented on pull request #28983: [SPARK-32159][SQL] Fix integration between Aggregator[Array[_], _, _] and UnresolvedMapObjects

2020-07-08 Thread GitBox
SparkQA commented on pull request #28983: URL: https://github.com/apache/spark/pull/28983#issuecomment-655330645 **[Test build #125284 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125284/testReport)** for PR 28983 at commit

[GitHub] [spark] AmplabJenkins commented on pull request #28998: [SPARK-32173][SQL] Deduplicate code in FromUTCTimestamp and ToUTCTimestamp

2020-07-08 Thread GitBox
AmplabJenkins commented on pull request #28998: URL: https://github.com/apache/spark/pull/28998#issuecomment-655330865 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] SparkQA commented on pull request #28998: [SPARK-32173][SQL] Deduplicate code in FromUTCTimestamp and ToUTCTimestamp

2020-07-08 Thread GitBox
SparkQA commented on pull request #28998: URL: https://github.com/apache/spark/pull/28998#issuecomment-655330644 **[Test build #125296 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125296/testReport)** for PR 28998 at commit

[GitHub] [spark] SparkQA commented on pull request #28969: [SPARK-32150][BUILD] Upgrade to ZStd 1.4.5-4

2020-07-08 Thread GitBox
SparkQA commented on pull request #28969: URL: https://github.com/apache/spark/pull/28969#issuecomment-655330650 **[Test build #125286 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125286/testReport)** for PR 28969 at commit

[GitHub] [spark] SparkQA commented on pull request #28676: [SPARK-31869][SQL] BroadcastHashJoinExec can utilize the build side for its output partitioning

2020-07-08 Thread GitBox
SparkQA commented on pull request #28676: URL: https://github.com/apache/spark/pull/28676#issuecomment-655330638 **[Test build #125304 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125304/testReport)** for PR 28676 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #27428: [SPARK-30276][SQL] Support Filter expression allows simultaneous use of DISTINCT

2020-07-08 Thread GitBox
AmplabJenkins removed a comment on pull request #27428: URL: https://github.com/apache/spark/pull/27428#issuecomment-655330831 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] SparkQA removed a comment on pull request #28676: [SPARK-31869][SQL] BroadcastHashJoinExec can utilize the build side for its output partitioning

2020-07-08 Thread GitBox
SparkQA removed a comment on pull request #28676: URL: https://github.com/apache/spark/pull/28676#issuecomment-655304305 **[Test build #125304 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125304/testReport)** for PR 28676 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28983: [SPARK-32159][SQL] Fix integration between Aggregator[Array[_], _, _] and UnresolvedMapObjects

2020-07-08 Thread GitBox
AmplabJenkins removed a comment on pull request #28983: URL: https://github.com/apache/spark/pull/28983#issuecomment-655301487 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] HeartSaVioR commented on pull request #26935: [SPARK-30294][SS] Explicitly defines read-only StateStore and optimize for HDFSBackedStateStore

2020-07-08 Thread GitBox
HeartSaVioR commented on pull request #26935: URL: https://github.com/apache/spark/pull/26935#issuecomment-655330994 retest this, please This is an automated message from the Apache Git Service. To respond to the

[GitHub] [spark] SparkQA removed a comment on pull request #29013: [SPARK-32196][SQL] Extract In convertible part if it is not convertible

2020-07-08 Thread GitBox
SparkQA removed a comment on pull request #29013: URL: https://github.com/apache/spark/pull/29013#issuecomment-655284188 **[Test build #125299 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125299/testReport)** for PR 29013 at commit

[GitHub] [spark] SparkQA removed a comment on pull request #29033: [SPARK-30703][SQL][FOLLOWUP] Update SqlBase.g4 invalid comment

2020-07-08 Thread GitBox
SparkQA removed a comment on pull request #29033: URL: https://github.com/apache/spark/pull/29033#issuecomment-655239570 **[Test build #125280 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125280/testReport)** for PR 29033 at commit

[GitHub] [spark] AmplabJenkins commented on pull request #29020: [SPARK-23431][CORE] Expose stage level peak executor metrics via REST API

2020-07-08 Thread GitBox
AmplabJenkins commented on pull request #29020: URL: https://github.com/apache/spark/pull/29020#issuecomment-655331157 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28676: [SPARK-31869][SQL] BroadcastHashJoinExec can utilize the build side for its output partitioning

2020-07-08 Thread GitBox
AmplabJenkins removed a comment on pull request #28676: URL: https://github.com/apache/spark/pull/28676#issuecomment-655331073 Merged build finished. Test FAILed. This is an automated message from the Apache Git Service. To

[GitHub] [spark] SparkQA removed a comment on pull request #28983: [SPARK-32159][SQL] Fix integration between Aggregator[Array[_], _, _] and UnresolvedMapObjects

2020-07-08 Thread GitBox
SparkQA removed a comment on pull request #28983: URL: https://github.com/apache/spark/pull/28983#issuecomment-655252499 **[Test build #125284 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125284/testReport)** for PR 28983 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29013: [SPARK-32196][SQL] Extract In convertible part if it is not convertible

2020-07-08 Thread GitBox
AmplabJenkins removed a comment on pull request #29013: URL: https://github.com/apache/spark/pull/29013#issuecomment-655331190 Merged build finished. Test FAILed. This is an automated message from the Apache Git Service. To

[GitHub] [spark] SparkQA removed a comment on pull request #28998: [SPARK-32173][SQL] Deduplicate code in FromUTCTimestamp and ToUTCTimestamp

2020-07-08 Thread GitBox
SparkQA removed a comment on pull request #28998: URL: https://github.com/apache/spark/pull/28998#issuecomment-655282159 **[Test build #125296 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125296/testReport)** for PR 28998 at commit

[GitHub] [spark] SparkQA removed a comment on pull request #29020: [SPARK-23431][CORE] Expose stage level peak executor metrics via REST API

2020-07-08 Thread GitBox
SparkQA removed a comment on pull request #29020: URL: https://github.com/apache/spark/pull/29020#issuecomment-655318274 **[Test build #125309 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125309/testReport)** for PR 29020 at commit

[GitHub] [spark] SparkQA removed a comment on pull request #29034: [SPARK-32219][SQL] Add SHOW CACHED TABLES Command

2020-07-08 Thread GitBox
SparkQA removed a comment on pull request #29034: URL: https://github.com/apache/spark/pull/29034#issuecomment-655315149 **[Test build #125308 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125308/testReport)** for PR 29034 at commit

[GitHub] [spark] AmplabJenkins commented on pull request #28676: [SPARK-31869][SQL] BroadcastHashJoinExec can utilize the build side for its output partitioning

2020-07-08 Thread GitBox
AmplabJenkins commented on pull request #28676: URL: https://github.com/apache/spark/pull/28676#issuecomment-655331073 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] HeartSaVioR commented on pull request #28975: [SPARK-32148][SS] Fix stream-stream join issue on missing to copy reused unsafe row

2020-07-08 Thread GitBox
HeartSaVioR commented on pull request #28975: URL: https://github.com/apache/spark/pull/28975#issuecomment-655331028 retest this, please This is an automated message from the Apache Git Service. To respond to the

[GitHub] [spark] SparkQA removed a comment on pull request #28975: [SPARK-32148][SS] Fix stream-stream join issue on missing to copy reused unsafe row

2020-07-08 Thread GitBox
SparkQA removed a comment on pull request #28975: URL: https://github.com/apache/spark/pull/28975#issuecomment-655214539 **[Test build #125271 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/125271/testReport)** for PR 28975 at commit

  1   2   3   4   5   6   7   8   9   10   >