[GitHub] [spark] viirya commented on a change in pull request #29427: [SPARK-25557][SQL][Followup] Add case-sensitivity test for ORC predicate pushdown

2020-08-13 Thread GitBox
viirya commented on a change in pull request #29427: URL: https://github.com/apache/spark/pull/29427#discussion_r470203728 ## File path: sql/core/v1.2/src/test/scala/org/apache/spark/sql/execution/datasources/orc/OrcFilterSuite.scala ## @@ -513,5 +513,98 @@ class

[GitHub] [spark] viirya commented on pull request #29427: [SPARK-25557][SQL][Followup] Add case-sensitivity test for ORC predicate pushdown

2020-08-13 Thread GitBox
viirya commented on pull request #29427: URL: https://github.com/apache/spark/pull/29427#issuecomment-673673420 cc @HyukjinKwon @dongjoon-hyun This is an automated message from the Apache Git Service. To respond to the

[GitHub] [spark] viirya opened a new pull request #29427: [SPARK-25557][SQL][Followup] Add case-sensitivity test for ORC predicate pushdown

2020-08-13 Thread GitBox
viirya opened a new pull request #29427: URL: https://github.com/apache/spark/pull/29427 ### What changes were proposed in this pull request? This is a follow-up of SPARK-25557. In this PR, adding case-sensitivity test for ORC predicate pushdown. ### Why are the

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29426: [SPARK-32610][DOCS] Fix the link to metrics.dropwizard.io in monitoring.md to refer the proper version

2020-08-13 Thread GitBox
AmplabJenkins removed a comment on pull request #29426: URL: https://github.com/apache/spark/pull/29426#issuecomment-673672934 Merged build finished. Test FAILed. This is an automated message from the Apache Git Service. To

[GitHub] [spark] AmplabJenkins commented on pull request #29426: [SPARK-32610][DOCS] Fix the link to metrics.dropwizard.io in monitoring.md to refer the proper version

2020-08-13 Thread GitBox
AmplabJenkins commented on pull request #29426: URL: https://github.com/apache/spark/pull/29426#issuecomment-673672934 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] SparkQA removed a comment on pull request #29426: [SPARK-32610][DOCS] Fix the link to metrics.dropwizard.io in monitoring.md to refer the proper version

2020-08-13 Thread GitBox
SparkQA removed a comment on pull request #29426: URL: https://github.com/apache/spark/pull/29426#issuecomment-673613199 **[Test build #127418 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/127418/testReport)** for PR 29426 at commit

[GitHub] [spark] SparkQA commented on pull request #29426: [SPARK-32610][DOCS] Fix the link to metrics.dropwizard.io in monitoring.md to refer the proper version

2020-08-13 Thread GitBox
SparkQA commented on pull request #29426: URL: https://github.com/apache/spark/pull/29426#issuecomment-673672294 **[Test build #127418 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/127418/testReport)** for PR 29426 at commit

[GitHub] [spark] tgravescs commented on pull request #29413: [SPARK-32597][CORE] Tune Event Drop in Async Event Queue

2020-08-13 Thread GitBox
tgravescs commented on pull request #29413: URL: https://github.com/apache/spark/pull/29413#issuecomment-673665565 Yeah so you have described the affects of it dropping the events, which I know. The thing I want to know is why it dropped the events in your cases. I'm not sure the

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28939: [SPARK-32119][CORE] ExecutorPlugin doesn't work with Standalone Cluster and Kubernetes with --jars

2020-08-13 Thread GitBox
AmplabJenkins removed a comment on pull request #28939: URL: https://github.com/apache/spark/pull/28939#issuecomment-673635080 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28939: [SPARK-32119][CORE] ExecutorPlugin doesn't work with Standalone Cluster and Kubernetes with --jars

2020-08-13 Thread GitBox
AmplabJenkins removed a comment on pull request #28939: URL: https://github.com/apache/spark/pull/28939#issuecomment-673635070 Merged build finished. Test FAILed. This is an automated message from the Apache Git Service. To

[GitHub] [spark] AmplabJenkins commented on pull request #28939: [SPARK-32119][CORE] ExecutorPlugin doesn't work with Standalone Cluster and Kubernetes with --jars

2020-08-13 Thread GitBox
AmplabJenkins commented on pull request #28939: URL: https://github.com/apache/spark/pull/28939#issuecomment-673635070 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] SparkQA commented on pull request #28939: [SPARK-32119][CORE] ExecutorPlugin doesn't work with Standalone Cluster and Kubernetes with --jars

2020-08-13 Thread GitBox
SparkQA commented on pull request #28939: URL: https://github.com/apache/spark/pull/28939#issuecomment-673635040 Kubernetes integration test status failure URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/32038/

[GitHub] [spark] agrawaldevesh commented on a change in pull request #29342: [SPARK-32399][SQL] Full outer shuffled hash join

2020-08-13 Thread GitBox
agrawaldevesh commented on a change in pull request #29342: URL: https://github.com/apache/spark/pull/29342#discussion_r470091083 ## File path: core/src/main/java/org/apache/spark/unsafe/map/BytesToBytesMap.java ## @@ -601,6 +657,14 @@ public boolean isDefined() {

[GitHub] [spark] AmplabJenkins commented on pull request #29425: [SPARK-32350][FOLLOW-UP] Divide the value list into a set of small batches when bulk writing to LevelDB

2020-08-13 Thread GitBox
AmplabJenkins commented on pull request #29425: URL: https://github.com/apache/spark/pull/29425#issuecomment-673631398 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29425: [SPARK-32350][FOLLOW-UP] Divide the value list into a set of small batches when bulk writing to LevelDB

2020-08-13 Thread GitBox
AmplabJenkins removed a comment on pull request #29425: URL: https://github.com/apache/spark/pull/29425#issuecomment-673631398 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] SparkQA removed a comment on pull request #29425: [SPARK-32350][FOLLOW-UP] Divide the value list into a set of small batches when bulk writing to LevelDB

2020-08-13 Thread GitBox
SparkQA removed a comment on pull request #29425: URL: https://github.com/apache/spark/pull/29425#issuecomment-673557515 **[Test build #127415 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/127415/testReport)** for PR 29425 at commit

[GitHub] [spark] SparkQA commented on pull request #29425: [SPARK-32350][FOLLOW-UP] Divide the value list into a set of small batches when bulk writing to LevelDB

2020-08-13 Thread GitBox
SparkQA commented on pull request #29425: URL: https://github.com/apache/spark/pull/29425#issuecomment-673630432 **[Test build #127415 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/127415/testReport)** for PR 29425 at commit

[GitHub] [spark] SparkQA commented on pull request #28939: [SPARK-32119][CORE] ExecutorPlugin doesn't work with Standalone Cluster and Kubernetes with --jars

2020-08-13 Thread GitBox
SparkQA commented on pull request #28939: URL: https://github.com/apache/spark/pull/28939#issuecomment-673625281 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/32038/

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29426: [SPARK-32610][DOCS] Fix the link to metrics.dropwizard.io in monitoring.md to refer the proper version

2020-08-13 Thread GitBox
AmplabJenkins removed a comment on pull request #29426: URL: https://github.com/apache/spark/pull/29426#issuecomment-673613746 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins commented on pull request #29426: [SPARK-32610][DOCS] Fix the link to metrics.dropwizard.io in monitoring.md to refer the proper version

2020-08-13 Thread GitBox
AmplabJenkins commented on pull request #29426: URL: https://github.com/apache/spark/pull/29426#issuecomment-673613746 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] SparkQA commented on pull request #29426: [SPARK-32610][DOCS] Fix the link to metrics.dropwizard.io in monitoring.md to refer the proper version

2020-08-13 Thread GitBox
SparkQA commented on pull request #29426: URL: https://github.com/apache/spark/pull/29426#issuecomment-673613199 **[Test build #127418 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/127418/testReport)** for PR 29426 at commit

[GitHub] [spark] sarutak opened a new pull request #29426: Fix dropwizard url

2020-08-13 Thread GitBox
sarutak opened a new pull request #29426: URL: https://github.com/apache/spark/pull/29426 ### What changes were proposed in this pull request? This PR fixes the link to metrics.dropwizard.io in monitoring.md to refer the proper version of the library. ### Why are the changes

[GitHub] [spark] warrenzhu25 commented on pull request #29082: [SPARK-32288][UI] Add exception summary for failed tasks in stage page

2020-08-13 Thread GitBox
warrenzhu25 commented on pull request #29082: URL: https://github.com/apache/spark/pull/29082#issuecomment-673607246 @gengliangwang @sarutak Do you have more comments on this? This is an automated message from the Apache Git

[GitHub] [spark] SparkQA commented on pull request #28939: [SPARK-32119][CORE] ExecutorPlugin doesn't work with Standalone Cluster and Kubernetes with --jars

2020-08-13 Thread GitBox
SparkQA commented on pull request #28939: URL: https://github.com/apache/spark/pull/28939#issuecomment-673602120 **[Test build #127417 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/127417/testReport)** for PR 28939 at commit

[GitHub] [spark] sarutak commented on a change in pull request #28939: [SPARK-32119][CORE] ExecutorPlugin doesn't work with Standalone Cluster and Kubernetes with --jars

2020-08-13 Thread GitBox
sarutak commented on a change in pull request #28939: URL: https://github.com/apache/spark/pull/28939#discussion_r470046600 ## File path: core/src/main/scala/org/apache/spark/util/Utils.scala ## @@ -2598,6 +2598,15 @@ private[spark] object Utils extends Logging {

[GitHub] [spark] mccheah commented on pull request #28618: [SPARK-31801][API][SHUFFLE] Register map output metadata

2020-08-13 Thread GitBox
mccheah commented on pull request #28618: URL: https://github.com/apache/spark/pull/28618#issuecomment-673599684 Ping here - what would be the best way to get this merged? This is an automated message from the Apache Git

[GitHub] [spark] sarutak commented on a change in pull request #28939: [SPARK-32119][CORE] ExecutorPlugin doesn't work with Standalone Cluster and Kubernetes with --jars

2020-08-13 Thread GitBox
sarutak commented on a change in pull request #28939: URL: https://github.com/apache/spark/pull/28939#discussion_r470103732 ## File path: core/src/main/scala/org/apache/spark/executor/Executor.scala ## @@ -220,6 +220,21 @@ private[spark] class Executor(

[GitHub] [spark] SaurabhChawla100 edited a comment on pull request #29413: [SPARK-32597][CORE] Tune Event Drop in Async Event Queue

2020-08-13 Thread GitBox
SaurabhChawla100 edited a comment on pull request #29413: URL: https://github.com/apache/spark/pull/29413#issuecomment-673593703 >I don't get your point here. it can already be configured on a per queue basis (set "spark.scheduler.listenerbus.eventqueue.$name.capacity") and if user sets

[GitHub] [spark] SaurabhChawla100 commented on pull request #29413: [SPARK-32597][CORE] Tune Event Drop in Async Event Queue

2020-08-13 Thread GitBox
SaurabhChawla100 commented on pull request #29413: URL: https://github.com/apache/spark/pull/29413#issuecomment-673593703 >I don't get your point here. it can already be configured on a per queue basis (set "spark.scheduler.listenerbus.eventqueue.$name.capacity") and if user sets

[GitHub] [spark] srowen commented on pull request #29370: [SPARK-32526][SQL]Fix some test cases of `sql/catalyst` module in scala 2.13

2020-08-13 Thread GitBox
srowen commented on pull request #29370: URL: https://github.com/apache/spark/pull/29370#issuecomment-673587065 Merged to master. I didn't resolve the JIRA yet because there are a few more tests to fix. Good work! let's keep going.

[GitHub] [spark] srowen closed pull request #29370: [SPARK-32526][SQL]Fix some test cases of `sql/catalyst` module in scala 2.13

2020-08-13 Thread GitBox
srowen closed pull request #29370: URL: https://github.com/apache/spark/pull/29370 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29415: [SPARK-32590][SQL] Remove fullOutput from RowDataSourceScanExec

2020-08-13 Thread GitBox
AmplabJenkins removed a comment on pull request #29415: URL: https://github.com/apache/spark/pull/29415#issuecomment-673577285 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins commented on pull request #29415: [SPARK-32590][SQL] Remove fullOutput from RowDataSourceScanExec

2020-08-13 Thread GitBox
AmplabJenkins commented on pull request #29415: URL: https://github.com/apache/spark/pull/29415#issuecomment-673577285 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] SparkQA commented on pull request #29415: [SPARK-32590][SQL] Remove fullOutput from RowDataSourceScanExec

2020-08-13 Thread GitBox
SparkQA commented on pull request #29415: URL: https://github.com/apache/spark/pull/29415#issuecomment-673576724 **[Test build #127416 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/127416/testReport)** for PR 29415 at commit

[GitHub] [spark] huaxingao commented on a change in pull request #29415: [SPARK-32590][SQL] Remove fullOutput from RowDataSourceScanExec

2020-08-13 Thread GitBox
huaxingao commented on a change in pull request #29415: URL: https://github.com/apache/spark/pull/29415#discussion_r470072879 ## File path: sql/core/src/main/scala/org/apache/spark/sql/execution/DataSourceScanExec.scala ## @@ -143,7 +140,6 @@ case class RowDataSourceScanExec(

[GitHub] [spark] AmplabJenkins commented on pull request #29360: [SPARK-32542][SQL]Add a Batch in Optimizer to improve performance in multidimensional analysis

2020-08-13 Thread GitBox
AmplabJenkins commented on pull request #29360: URL: https://github.com/apache/spark/pull/29360#issuecomment-673568012 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] SparkQA removed a comment on pull request #29360: [SPARK-32542][SQL]Add a Batch in Optimizer to improve performance in multidimensional analysis

2020-08-13 Thread GitBox
SparkQA removed a comment on pull request #29360: URL: https://github.com/apache/spark/pull/29360#issuecomment-673432002 **[Test build #127409 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/127409/testReport)** for PR 29360 at commit

[GitHub] [spark] SparkQA commented on pull request #29360: [SPARK-32542][SQL]Add a Batch in Optimizer to improve performance in multidimensional analysis

2020-08-13 Thread GitBox
SparkQA commented on pull request #29360: URL: https://github.com/apache/spark/pull/29360#issuecomment-673567010 **[Test build #127409 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/127409/testReport)** for PR 29360 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29333: [SPARK-32357][INFRA] Publish failed and succeeded test reports in GitHub Actions

2020-08-13 Thread GitBox
AmplabJenkins removed a comment on pull request #29333: URL: https://github.com/apache/spark/pull/29333#issuecomment-673561445 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins commented on pull request #29333: [SPARK-32357][INFRA] Publish failed and succeeded test reports in GitHub Actions

2020-08-13 Thread GitBox
AmplabJenkins commented on pull request #29333: URL: https://github.com/apache/spark/pull/29333#issuecomment-673561445 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] SparkQA removed a comment on pull request #29333: [SPARK-32357][INFRA] Publish failed and succeeded test reports in GitHub Actions

2020-08-13 Thread GitBox
SparkQA removed a comment on pull request #29333: URL: https://github.com/apache/spark/pull/29333#issuecomment-673480819 **[Test build #127413 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/127413/testReport)** for PR 29333 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29333: [SPARK-32357][INFRA] Publish failed and succeeded test reports in GitHub Actions

2020-08-13 Thread GitBox
AmplabJenkins removed a comment on pull request #29333: URL: https://github.com/apache/spark/pull/29333#issuecomment-673480992 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] SparkQA commented on pull request #29333: [SPARK-32357][INFRA] Publish failed and succeeded test reports in GitHub Actions

2020-08-13 Thread GitBox
SparkQA commented on pull request #29333: URL: https://github.com/apache/spark/pull/29333#issuecomment-673560248 **[Test build #127413 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/127413/testReport)** for PR 29333 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29423: [SPARK-20680][SQL][FOLLOW-UP] Add HiveVoidType in HiveClientImpl

2020-08-13 Thread GitBox
AmplabJenkins removed a comment on pull request #29423: URL: https://github.com/apache/spark/pull/29423#issuecomment-673557992 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29425: [SPARK-32350][FOLLOW-UP] Divide the value list into a set of small batches when bulk writing to LevelDB

2020-08-13 Thread GitBox
AmplabJenkins removed a comment on pull request #29425: URL: https://github.com/apache/spark/pull/29425#issuecomment-673558234 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29423: [SPARK-20680][SQL][FOLLOW-UP] Add HiveVoidType in HiveClientImpl

2020-08-13 Thread GitBox
AmplabJenkins removed a comment on pull request #29423: URL: https://github.com/apache/spark/pull/29423#issuecomment-673557978 Merged build finished. Test FAILed. This is an automated message from the Apache Git Service. To

[GitHub] [spark] AmplabJenkins commented on pull request #29425: [SPARK-32350][FOLLOW-UP] Divide the value list into a set of small batches when bulk writing to LevelDB

2020-08-13 Thread GitBox
AmplabJenkins commented on pull request #29425: URL: https://github.com/apache/spark/pull/29425#issuecomment-673558234 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins commented on pull request #29423: [SPARK-20680][SQL][FOLLOW-UP] Add HiveVoidType in HiveClientImpl

2020-08-13 Thread GitBox
AmplabJenkins commented on pull request #29423: URL: https://github.com/apache/spark/pull/29423#issuecomment-673557978 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] SparkQA removed a comment on pull request #29423: [SPARK-20680][SQL][FOLLOW-UP] Add HiveVoidType in HiveClientImpl

2020-08-13 Thread GitBox
SparkQA removed a comment on pull request #29423: URL: https://github.com/apache/spark/pull/29423#issuecomment-673501133 **[Test build #127414 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/127414/testReport)** for PR 29423 at commit

[GitHub] [spark] baohe-zhang commented on pull request #29425: [SPARK-32350][FOLLOW-UP] Divide the value list into a set of small batches when bulk writing to LevelDB

2020-08-13 Thread GitBox
baohe-zhang commented on pull request #29425: URL: https://github.com/apache/spark/pull/29425#issuecomment-673558097 cc @mridulm @HeartSaVioR This is an automated message from the Apache Git Service. To respond to the

[GitHub] [spark] SparkQA commented on pull request #29423: [SPARK-20680][SQL][FOLLOW-UP] Add HiveVoidType in HiveClientImpl

2020-08-13 Thread GitBox
SparkQA commented on pull request #29423: URL: https://github.com/apache/spark/pull/29423#issuecomment-673557841 **[Test build #127414 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/127414/testReport)** for PR 29423 at commit

[GitHub] [spark] SparkQA commented on pull request #29425: [SPARK-32350][FOLLOW-UP] Divide the value list into a set of small batches when bulk writing to LevelDB

2020-08-13 Thread GitBox
SparkQA commented on pull request #29425: URL: https://github.com/apache/spark/pull/29425#issuecomment-673557515 **[Test build #127415 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/127415/testReport)** for PR 29425 at commit

[GitHub] [spark] baohe-zhang opened a new pull request #29425: [SPARK-32350][FOLLOW-UP] Divide the value list into a set of small batches when bulk writing to LevelDB

2020-08-13 Thread GitBox
baohe-zhang opened a new pull request #29425: URL: https://github.com/apache/spark/pull/29425 ### What changes were proposed in this pull request? This is a follow-up of https://github.com/apache/spark/pull/29149. The change is that when writing a large value list, we divide the value

[GitHub] [spark] cloud-fan commented on a change in pull request #29270: [SPARK-32466][TEST][SQL] Add PlanStabilitySuite to detect SparkPlan regression

2020-08-13 Thread GitBox
cloud-fan commented on a change in pull request #29270: URL: https://github.com/apache/spark/pull/29270#discussion_r470048887 ## File path: sql/core/src/test/scala/org/apache/spark/sql/TPCDSBase.scala ## @@ -298,12 +302,22 @@ trait TPCDSBase extends SharedSparkSession {

[GitHub] [spark] cloud-fan commented on a change in pull request #29423: [SPARK-20680][SQL][FOLLOW-UP] Add HiveVoidType in HiveClientImpl

2020-08-13 Thread GitBox
cloud-fan commented on a change in pull request #29423: URL: https://github.com/apache/spark/pull/29423#discussion_r470046782 ## File path: sql/core/src/test/scala/org/apache/spark/sql/execution/SQLViewSuite.scala ## @@ -731,6 +731,7 @@ abstract class SQLViewSuite extends

[GitHub] [spark] sarutak commented on pull request #29265: [SPARK-32462][WEBUI] Reset previous search text for datatable

2020-08-13 Thread GitBox
sarutak commented on pull request #29265: URL: https://github.com/apache/spark/pull/29265#issuecomment-673548916 @dongjoon-hyun > Keeping search text is a kind of UX feature to reduce re-typing, but I believe we can remove it from Apache Spark 3.1.0 to achieve simplicity by preventing

[GitHub] [spark] AngersZhuuuu commented on a change in pull request #29414: [SPARK-32106][SQL] Implement script transform in sql/core

2020-08-13 Thread GitBox
AngersZh commented on a change in pull request #29414: URL: https://github.com/apache/spark/pull/29414#discussion_r470040613 ## File path: sql/core/src/test/resources/sql-tests/results/transform.sql.out ## @@ -0,0 +1,224 @@ +-- Automatically generated by SQLQueryTestSuite

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29414: [SPARK-32106][SQL] Implement script transform in sql/core

2020-08-13 Thread GitBox
AmplabJenkins removed a comment on pull request #29414: URL: https://github.com/apache/spark/pull/29414#issuecomment-673527844 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins commented on pull request #29414: [SPARK-32106][SQL] Implement script transform in sql/core

2020-08-13 Thread GitBox
AmplabJenkins commented on pull request #29414: URL: https://github.com/apache/spark/pull/29414#issuecomment-673527844 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] SparkQA removed a comment on pull request #29414: [SPARK-32106][SQL] Implement script transform in sql/core

2020-08-13 Thread GitBox
SparkQA removed a comment on pull request #29414: URL: https://github.com/apache/spark/pull/29414#issuecomment-673399976 **[Test build #127406 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/127406/testReport)** for PR 29414 at commit

[GitHub] [spark] SparkQA commented on pull request #29414: [SPARK-32106][SQL] Implement script transform in sql/core

2020-08-13 Thread GitBox
SparkQA commented on pull request #29414: URL: https://github.com/apache/spark/pull/29414#issuecomment-673526698 **[Test build #127406 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/127406/testReport)** for PR 29414 at commit

[GitHub] [spark] karuppayya commented on pull request #28804: [SPARK-31973][SQL] Skip partial aggregates if grouping keys have high cardinality

2020-08-13 Thread GitBox
karuppayya commented on pull request #28804: URL: https://github.com/apache/spark/pull/28804#issuecomment-673514702 @maropu The stats(specifically number of records from aggregation map after a threshold) that we are looking for is available only at the operator level at runtime.

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28685: [SPARK-27951][SQL] Support ANSI SQL NTH_VALUE window function

2020-08-13 Thread GitBox
AmplabJenkins removed a comment on pull request #28685: URL: https://github.com/apache/spark/pull/28685#issuecomment-673504016 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins commented on pull request #28685: [SPARK-27951][SQL] Support ANSI SQL NTH_VALUE window function

2020-08-13 Thread GitBox
AmplabJenkins commented on pull request #28685: URL: https://github.com/apache/spark/pull/28685#issuecomment-673504016 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] Ngone51 commented on pull request #29413: [SPARK-32597][CORE] Tune Event Drop in Async Event Queue

2020-08-13 Thread GitBox
Ngone51 commented on pull request #29413: URL: https://github.com/apache/spark/pull/29413#issuecomment-673503430 > It would make configuring individual queues much harder but I don't know how much people do that. Much harder? IIUC, if users have some experienced stats of the queues

[GitHub] [spark] SparkQA removed a comment on pull request #28685: [SPARK-27951][SQL] Support ANSI SQL NTH_VALUE window function

2020-08-13 Thread GitBox
SparkQA removed a comment on pull request #28685: URL: https://github.com/apache/spark/pull/28685#issuecomment-673384225 **[Test build #127405 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/127405/testReport)** for PR 28685 at commit

[GitHub] [spark] SparkQA commented on pull request #28685: [SPARK-27951][SQL] Support ANSI SQL NTH_VALUE window function

2020-08-13 Thread GitBox
SparkQA commented on pull request #28685: URL: https://github.com/apache/spark/pull/28685#issuecomment-673502948 **[Test build #127405 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/127405/testReport)** for PR 28685 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29423: [SPARK-20680][SQL][FOLLOW-UP] Add HiveVoidType in HiveClientImpl

2020-08-13 Thread GitBox
AmplabJenkins removed a comment on pull request #29423: URL: https://github.com/apache/spark/pull/29423#issuecomment-673501890 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins commented on pull request #29423: [SPARK-20680][SQL][FOLLOW-UP] Add HiveVoidType in HiveClientImpl

2020-08-13 Thread GitBox
AmplabJenkins commented on pull request #29423: URL: https://github.com/apache/spark/pull/29423#issuecomment-673501890 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] SparkQA commented on pull request #29423: [SPARK-20680][SQL][FOLLOW-UP] Add HiveVoidType in HiveClientImpl

2020-08-13 Thread GitBox
SparkQA commented on pull request #29423: URL: https://github.com/apache/spark/pull/29423#issuecomment-673501133 **[Test build #127414 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/127414/testReport)** for PR 29423 at commit

[GitHub] [spark] ulysses-you commented on a change in pull request #29423: [SPARK-20680][SQL][FOLLOW-UP] Add HiveVoidType in HiveClientImpl

2020-08-13 Thread GitBox
ulysses-you commented on a change in pull request #29423: URL: https://github.com/apache/spark/pull/29423#discussion_r469977908 ## File path: sql/hive/src/test/scala/org/apache/spark/sql/hive/execution/HiveSQLViewSuite.scala ## @@ -137,4 +137,25 @@ class HiveSQLViewSuite

[GitHub] [spark] ulysses-you commented on a change in pull request #29423: [SPARK-20680][SQL][FOLLOW-UP] Add HiveVoidType in HiveClientImpl

2020-08-13 Thread GitBox
ulysses-you commented on a change in pull request #29423: URL: https://github.com/apache/spark/pull/29423#discussion_r469976892 ## File path: sql/core/src/test/scala/org/apache/spark/sql/execution/SQLViewSuite.scala ## @@ -731,6 +731,7 @@ abstract class SQLViewSuite extends

[GitHub] [spark] ulysses-you commented on a change in pull request #29423: [SPARK-20680][SQL][FOLLOW-UP] Add HiveVoidType in HiveClientImpl

2020-08-13 Thread GitBox
ulysses-you commented on a change in pull request #29423: URL: https://github.com/apache/spark/pull/29423#discussion_r469976892 ## File path: sql/core/src/test/scala/org/apache/spark/sql/execution/SQLViewSuite.scala ## @@ -731,6 +731,7 @@ abstract class SQLViewSuite extends

[GitHub] [spark] ulysses-you commented on a change in pull request #29423: [SPARK-20680][SQL][FOLLOW-UP] Add HiveVoidType in HiveClientImpl

2020-08-13 Thread GitBox
ulysses-you commented on a change in pull request #29423: URL: https://github.com/apache/spark/pull/29423#discussion_r469976892 ## File path: sql/core/src/test/scala/org/apache/spark/sql/execution/SQLViewSuite.scala ## @@ -731,6 +731,7 @@ abstract class SQLViewSuite extends

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29424: [MINOR] Fixed approx_count_distinct rsd param description

2020-08-13 Thread GitBox
AmplabJenkins removed a comment on pull request #29424: URL: https://github.com/apache/spark/pull/29424#issuecomment-673496947 Can one of the admins verify this patch? This is an automated message from the Apache Git

[GitHub] [spark] AmplabJenkins commented on pull request #29424: [MINOR] Fixed approx_count_distinct rsd param description

2020-08-13 Thread GitBox
AmplabJenkins commented on pull request #29424: URL: https://github.com/apache/spark/pull/29424#issuecomment-673497518 Can one of the admins verify this patch? This is an automated message from the Apache Git Service. To

[GitHub] [spark] AmplabJenkins commented on pull request #29424: [MINOR] Fixed approx_count_distinct rsd param description

2020-08-13 Thread GitBox
AmplabJenkins commented on pull request #29424: URL: https://github.com/apache/spark/pull/29424#issuecomment-673496947 Can one of the admins verify this patch? This is an automated message from the Apache Git Service. To

[GitHub] [spark] Karl-WangSK commented on pull request #29360: [SPARK-32542][SQL]Add a Batch in Optimizer to improve performance in multidimensional analysis

2020-08-13 Thread GitBox
Karl-WangSK commented on pull request #29360: URL: https://github.com/apache/spark/pull/29360#issuecomment-673496112 please review the benchmark This is an automated message from the Apache Git Service. To respond to the

[GitHub] [spark] Karl-WangSK commented on pull request #29360: [SPARK-32542][SQL]Add a Batch in Optimizer to improve performance in multidimensional analysis

2020-08-13 Thread GitBox
Karl-WangSK commented on pull request #29360: URL: https://github.com/apache/spark/pull/29360#issuecomment-673495331 @viirya @maropu This is an automated message from the Apache Git Service. To respond to the message,

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29270: [SPARK-32466][TEST][SQL] Add PlanStabilitySuite to detect SparkPlan regression

2020-08-13 Thread GitBox
AmplabJenkins removed a comment on pull request #29270: URL: https://github.com/apache/spark/pull/29270#issuecomment-673495116 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29270: [SPARK-32466][TEST][SQL] Add PlanStabilitySuite to detect SparkPlan regression

2020-08-13 Thread GitBox
AmplabJenkins removed a comment on pull request #29270: URL: https://github.com/apache/spark/pull/29270#issuecomment-673495104 Merged build finished. Test FAILed. This is an automated message from the Apache Git Service. To

[GitHub] [spark] SparkQA commented on pull request #29270: [SPARK-32466][TEST][SQL] Add PlanStabilitySuite to detect SparkPlan regression

2020-08-13 Thread GitBox
SparkQA commented on pull request #29270: URL: https://github.com/apache/spark/pull/29270#issuecomment-673495026 **[Test build #127412 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/127412/testReport)** for PR 29270 at commit

[GitHub] [spark] SparkQA removed a comment on pull request #29270: [SPARK-32466][TEST][SQL] Add PlanStabilitySuite to detect SparkPlan regression

2020-08-13 Thread GitBox
SparkQA removed a comment on pull request #29270: URL: https://github.com/apache/spark/pull/29270#issuecomment-673476667 **[Test build #127412 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/127412/testReport)** for PR 29270 at commit

[GitHub] [spark] AmplabJenkins commented on pull request #29270: [SPARK-32466][TEST][SQL] Add PlanStabilitySuite to detect SparkPlan regression

2020-08-13 Thread GitBox
AmplabJenkins commented on pull request #29270: URL: https://github.com/apache/spark/pull/29270#issuecomment-673495104 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] Comonut opened a new pull request #29424: [MINOR] Fixed approx_count_distinct rsd param description

2020-08-13 Thread GitBox
Comonut opened a new pull request #29424: URL: https://github.com/apache/spark/pull/29424 ### What changes were proposed in this pull request? In the docs concerning the approx_count_distinct I have changed the description of the rsd parameter from **_maximum estimation

[GitHub] [spark] ulysses-you commented on a change in pull request #29423: [SPARK-20680][SQL][FOLLOW-UP] Add HiveVoidType in HiveClientImpl

2020-08-13 Thread GitBox
ulysses-you commented on a change in pull request #29423: URL: https://github.com/apache/spark/pull/29423#discussion_r469969329 ## File path: sql/hive/src/main/scala/org/apache/spark/sql/hive/client/HiveClientImpl.scala ## @@ -1005,7 +1006,8 @@ private[hive] object

[GitHub] [spark] HyukjinKwon edited a comment on pull request #29333: [SPARK-32357][INFRA] Publish failed and succeeded test reports in GitHub Actions

2020-08-13 Thread GitBox
HyukjinKwon edited a comment on pull request #29333: URL: https://github.com/apache/spark/pull/29333#issuecomment-673479039 https://github.com/HyukjinKwon/spark/runs/980622718 should show the example of this PR. Once this example shows the results correctly, this PR should be good to go.

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29423: [SPARK-20680][SQL][FOLLOW-UP] Add HiveVoidType in HiveClientImpl

2020-08-13 Thread GitBox
AmplabJenkins removed a comment on pull request #29423: URL: https://github.com/apache/spark/pull/29423#issuecomment-673482391 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins commented on pull request #29423: [SPARK-20680][SQL][FOLLOW-UP] Add HiveVoidType in HiveClientImpl

2020-08-13 Thread GitBox
AmplabJenkins commented on pull request #29423: URL: https://github.com/apache/spark/pull/29423#issuecomment-673482391 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] HyukjinKwon edited a comment on pull request #29333: [SPARK-32357][INFRA] Publish failed and succeeded test reports in GitHub Actions

2020-08-13 Thread GitBox
HyukjinKwon edited a comment on pull request #29333: URL: https://github.com/apache/spark/pull/29333#issuecomment-673479039 https://github.com/HyukjinKwon/spark/runs/980613130 should show the example of this PR. Once this example shows the results correctly, this PR should be good to go.

[GitHub] [spark] SparkQA commented on pull request #29423: [SPARK-20680][SQL][FOLLOW-UP] Add HiveVoidType in HiveClientImpl

2020-08-13 Thread GitBox
SparkQA commented on pull request #29423: URL: https://github.com/apache/spark/pull/29423#issuecomment-673481512 **[Test build #127408 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/127408/testReport)** for PR 29423 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29333: [SPARK-32357][INFRA] Publish failed and succeeded test reports in GitHub Actions

2020-08-13 Thread GitBox
AmplabJenkins removed a comment on pull request #29333: URL: https://github.com/apache/spark/pull/29333#issuecomment-673481461 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] SparkQA removed a comment on pull request #29423: [SPARK-20680][SQL][FOLLOW-UP] Add HiveVoidType in HiveClientImpl

2020-08-13 Thread GitBox
SparkQA removed a comment on pull request #29423: URL: https://github.com/apache/spark/pull/29423#issuecomment-673426253 **[Test build #127408 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/127408/testReport)** for PR 29423 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29333: [SPARK-32357][INFRA] Publish failed and succeeded test reports in GitHub Actions

2020-08-13 Thread GitBox
AmplabJenkins removed a comment on pull request #29333: URL: https://github.com/apache/spark/pull/29333#issuecomment-673480981 Merged build finished. Test FAILed. This is an automated message from the Apache Git Service. To

[GitHub] [spark] AmplabJenkins commented on pull request #29333: [SPARK-32357][INFRA] Publish failed and succeeded test reports in GitHub Actions

2020-08-13 Thread GitBox
AmplabJenkins commented on pull request #29333: URL: https://github.com/apache/spark/pull/29333#issuecomment-673481461 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins commented on pull request #29333: [SPARK-32357][INFRA] Publish failed and succeeded test reports in GitHub Actions

2020-08-13 Thread GitBox
AmplabJenkins commented on pull request #29333: URL: https://github.com/apache/spark/pull/29333#issuecomment-673480981 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] SparkQA commented on pull request #29333: [SPARK-32357][INFRA] Publish failed and succeeded test reports in GitHub Actions

2020-08-13 Thread GitBox
SparkQA commented on pull request #29333: URL: https://github.com/apache/spark/pull/29333#issuecomment-673480819 **[Test build #127413 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/127413/testReport)** for PR 29333 at commit

[GitHub] [spark] tgravescs commented on pull request #29413: [SPARK-32597][CORE] Tune Event Drop in Async Event Queue

2020-08-13 Thread GitBox
tgravescs commented on pull request #29413: URL: https://github.com/apache/spark/pull/29413#issuecomment-673479231 Part of the problem with that is that in most cases some queues have higher priority, which is why they were split apart. you really want the executor management queue to

[GitHub] [spark] HyukjinKwon removed a comment on pull request #29333: [WIP][SPARK-32357][INFRA] Publish failed and succeeded test reports in GitHub Actions

2020-08-13 Thread GitBox
HyukjinKwon removed a comment on pull request #29333: URL: https://github.com/apache/spark/pull/29333#issuecomment-673477836 https://github.com/HyukjinKwon/spark/runs/980576471 should show the example of this PR. Before this PR is merged, the test results would not be reported because the

[GitHub] [spark] HyukjinKwon commented on pull request #29333: [WIP][SPARK-32357][INFRA] Publish failed and succeeded test reports in GitHub Actions

2020-08-13 Thread GitBox
HyukjinKwon commented on pull request #29333: URL: https://github.com/apache/spark/pull/29333#issuecomment-673479039 https://github.com/HyukjinKwon/spark/runs/980576471 should show the example of this PR. Once this example shows the results correctly, this PR should be good to go.

<    1   2   3   4   5   >