[GitHub] [spark] maropu commented on a change in pull request #29831: [SPARK-32351][SQL] Show partially pushed down partition filters in explain()

2020-09-28 Thread GitBox
maropu commented on a change in pull request #29831: URL: https://github.com/apache/spark/pull/29831#discussion_r496432526 ## File path: sql/hive/src/test/scala/org/apache/spark/sql/hive/execution/PrunePartitionSuiteBase.scala ## @@ -46,30 +46,39 @@ abstract class

[GitHub] [spark] SparkQA commented on pull request #29831: [SPARK-32351][SQL] Show partially pushed down partition filters in explain()

2020-09-28 Thread GitBox
SparkQA commented on pull request #29831: URL: https://github.com/apache/spark/pull/29831#issuecomment-700451882 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/33828/

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29898: [SPARK-33021][PYTHON][TESTS] Move functions related test cases into test_functions.py

2020-09-28 Thread GitBox
AmplabJenkins removed a comment on pull request #29898: URL: https://github.com/apache/spark/pull/29898#issuecomment-700444612 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29899: [SPARK-33020][PYTHON] Add nth_value as a PySpark function

2020-09-28 Thread GitBox
AmplabJenkins removed a comment on pull request #29899: URL: https://github.com/apache/spark/pull/29899#issuecomment-700444599 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29871: [SPARK-32995][SQL] CostBasedJoinReorder optimizer rule should be idempotent

2020-09-28 Thread GitBox
AmplabJenkins removed a comment on pull request #29871: URL: https://github.com/apache/spark/pull/29871#issuecomment-700444719 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] SparkQA commented on pull request #29898: [SPARK-33021][PYTHON][TESTS] Move functions related test cases into test_functions.py

2020-09-28 Thread GitBox
SparkQA commented on pull request #29898: URL: https://github.com/apache/spark/pull/29898#issuecomment-700444178 Kubernetes integration test status success URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/33826/

[GitHub] [spark] AmplabJenkins commented on pull request #29899: [SPARK-33020][PYTHON] Add nth_value as a PySpark function

2020-09-28 Thread GitBox
AmplabJenkins commented on pull request #29899: URL: https://github.com/apache/spark/pull/29899#issuecomment-700444599 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins commented on pull request #29898: [SPARK-33021][PYTHON][TESTS] Move functions related test cases into test_functions.py

2020-09-28 Thread GitBox
AmplabJenkins commented on pull request #29898: URL: https://github.com/apache/spark/pull/29898#issuecomment-700444612 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins commented on pull request #29871: [SPARK-32995][SQL] CostBasedJoinReorder optimizer rule should be idempotent

2020-09-28 Thread GitBox
AmplabJenkins commented on pull request #29871: URL: https://github.com/apache/spark/pull/29871#issuecomment-700444694 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] SparkQA commented on pull request #29871: [SPARK-32995][SQL] CostBasedJoinReorder optimizer rule should be idempotent

2020-09-28 Thread GitBox
SparkQA commented on pull request #29871: URL: https://github.com/apache/spark/pull/29871#issuecomment-700444652 Kubernetes integration test status success URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/33827/

[GitHub] [spark] SparkQA commented on pull request #29899: [SPARK-33020][PYTHON] Add nth_value as a PySpark function

2020-09-28 Thread GitBox
SparkQA commented on pull request #29899: URL: https://github.com/apache/spark/pull/29899#issuecomment-700443463 Kubernetes integration test status success URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/33825/

[GitHub] [spark] HyukjinKwon commented on a change in pull request #29895: [SPARK-33019][CORE] Use spark.hadoop.mapreduce.fileoutputcommitter.algorithm.version=1 by default

2020-09-28 Thread GitBox
HyukjinKwon commented on a change in pull request #29895: URL: https://github.com/apache/spark/pull/29895#discussion_r496427310 ## File path: core/src/main/scala/org/apache/spark/deploy/SparkHadoopUtil.scala ## @@ -462,6 +462,9 @@ private[spark] object SparkHadoopUtil {

[GitHub] [spark] dongjoon-hyun commented on a change in pull request #29888: [SPARK-33012][BUILD][K8S] Upgrade fabric8 to 4.10.3

2020-09-28 Thread GitBox
dongjoon-hyun commented on a change in pull request #29888: URL: https://github.com/apache/spark/pull/29888#discussion_r496424135 ## File path: resource-managers/kubernetes/core/pom.xml ## @@ -89,6 +88,12 @@ + Review comment: I agree with @srowen .

[GitHub] [spark] dongjoon-hyun closed pull request #29828: [SPARK-32948][SQL] Optimize to_json and from_json expression chain

2020-09-28 Thread GitBox
dongjoon-hyun closed pull request #29828: URL: https://github.com/apache/spark/pull/29828 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to

[GitHub] [spark] SparkQA commented on pull request #29899: [SPARK-33020][PYTHON] Add nth_value as a PySpark function

2020-09-28 Thread GitBox
SparkQA commented on pull request #29899: URL: https://github.com/apache/spark/pull/29899#issuecomment-700433263 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/33825/

[GitHub] [spark] maropu commented on a change in pull request #29894: [SPARK-33018][SQL] Fix compute statistics issue

2020-09-28 Thread GitBox
maropu commented on a change in pull request #29894: URL: https://github.com/apache/spark/pull/29894#discussion_r496417058 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/plans/logical/statsEstimation/SizeInBytesOnlyStatsPlanVisitor.scala ## @@ -53,7

[GitHub] [spark] cloud-fan closed pull request #29892: [MINOR][DOCS] Document when `current_date` and `current_timestamp` are evaluated

2020-09-28 Thread GitBox
cloud-fan closed pull request #29892: URL: https://github.com/apache/spark/pull/29892 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go

[GitHub] [spark] SparkQA commented on pull request #29898: [SPARK-33021][PYTHON][TESTS] Move functions related test cases into test_functions.py

2020-09-28 Thread GitBox
SparkQA commented on pull request #29898: URL: https://github.com/apache/spark/pull/29898#issuecomment-700432798 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/33826/

[GitHub] [spark] cloud-fan commented on pull request #29892: [MINOR][DOCS] Document when `current_date` and `current_timestamp` are evaluated

2020-09-28 Thread GitBox
cloud-fan commented on pull request #29892: URL: https://github.com/apache/spark/pull/29892#issuecomment-700432847 thanks, merging to master/3.0! This is an automated message from the Apache Git Service. To respond to the

[GitHub] [spark] SparkQA commented on pull request #29871: [SPARK-32995][SQL] CostBasedJoinReorder optimizer rule should be idempotent

2020-09-28 Thread GitBox
SparkQA commented on pull request #29871: URL: https://github.com/apache/spark/pull/29871#issuecomment-700431912 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/33827/

[GitHub] [spark] HyukjinKwon commented on pull request #29899: [SPARK-33020][PYTHON] Add nth_value as a PySpark function

2020-09-28 Thread GitBox
HyukjinKwon commented on pull request #29899: URL: https://github.com/apache/spark/pull/29899#issuecomment-700431700 Thank you @dongjoon-hyun. This is an automated message from the Apache Git Service. To respond to the

[GitHub] [spark] dongjoon-hyun closed pull request #29899: [SPARK-33020][PYTHON] Add nth_value as a PySpark function

2020-09-28 Thread GitBox
dongjoon-hyun closed pull request #29899: URL: https://github.com/apache/spark/pull/29899 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to

[GitHub] [spark] dongjoon-hyun commented on pull request #29899: [SPARK-33020][PYTHON] Add nth_value as a PySpark function

2020-09-28 Thread GitBox
dongjoon-hyun commented on pull request #29899: URL: https://github.com/apache/spark/pull/29899#issuecomment-700431300 Merged to master. This is an automated message from the Apache Git Service. To respond to the message,

[GitHub] [spark] dongjoon-hyun removed a comment on pull request #29899: [SPARK-33020][PYTHON] Add nth_value as a PySpark function

2020-09-28 Thread GitBox
dongjoon-hyun removed a comment on pull request #29899: URL: https://github.com/apache/spark/pull/29899#issuecomment-700430638 Merged to master. This is an automated message from the Apache Git Service. To respond to the

[GitHub] [spark] cloud-fan commented on pull request #29889: [SPARK-33015][SQL] Compute the current date only once

2020-09-28 Thread GitBox
cloud-fan commented on pull request #29889: URL: https://github.com/apache/spark/pull/29889#issuecomment-700430758 thanks, merging to master/3.0! This is an automated message from the Apache Git Service. To respond to the

[GitHub] [spark] cloud-fan closed pull request #29889: [SPARK-33015][SQL] Compute the current date only once

2020-09-28 Thread GitBox
cloud-fan closed pull request #29889: URL: https://github.com/apache/spark/pull/29889 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go

[GitHub] [spark] dongjoon-hyun commented on pull request #29899: [SPARK-33020][PYTHON] Add nth_value as a PySpark function

2020-09-28 Thread GitBox
dongjoon-hyun commented on pull request #29899: URL: https://github.com/apache/spark/pull/29899#issuecomment-700430638 Merged to master. This is an automated message from the Apache Git Service. To respond to the message,

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29800: [SPARK-32934][SQL] Improve the performance for NTH_VALUE and reactor the OffsetWindowFunction

2020-09-28 Thread GitBox
AmplabJenkins removed a comment on pull request #29800: URL: https://github.com/apache/spark/pull/29800#issuecomment-700430175 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] dongjoon-hyun edited a comment on pull request #29895: [SPARK-33019][CORE] Use spark.hadoop.mapreduce.fileoutputcommitter.algorithm.version=1 by default

2020-09-28 Thread GitBox
dongjoon-hyun edited a comment on pull request #29895: URL: https://github.com/apache/spark/pull/29895#issuecomment-700429110 I labeled SPARK-33019 as a correctness issue because a working Apache Spark 2.4 PySpark program can generate a wrong result with Apache Spark 3.0 with Hadoop 3.2

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29800: [SPARK-32934][SQL] Improve the performance for NTH_VALUE and reactor the OffsetWindowFunction

2020-09-28 Thread GitBox
AmplabJenkins removed a comment on pull request #29800: URL: https://github.com/apache/spark/pull/29800#issuecomment-700430170 Merged build finished. Test FAILed. This is an automated message from the Apache Git Service. To

[GitHub] [spark] dongjoon-hyun edited a comment on pull request #29895: [SPARK-33019][CORE] Use spark.hadoop.mapreduce.fileoutputcommitter.algorithm.version=1 by default

2020-09-28 Thread GitBox
dongjoon-hyun edited a comment on pull request #29895: URL: https://github.com/apache/spark/pull/29895#issuecomment-700429110 I labeled SPARK-33019 as a correctness issue because a working Apache Spark 2.4 PySpark program can generate a wrong result with Apache Spark 3.0 with Hadoop 3.2

[GitHub] [spark] AmplabJenkins commented on pull request #29800: [SPARK-32934][SQL] Improve the performance for NTH_VALUE and reactor the OffsetWindowFunction

2020-09-28 Thread GitBox
AmplabJenkins commented on pull request #29800: URL: https://github.com/apache/spark/pull/29800#issuecomment-700430170 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] dongjoon-hyun edited a comment on pull request #29895: [SPARK-33019][CORE] Use spark.hadoop.mapreduce.fileoutputcommitter.algorithm.version=1 by default

2020-09-28 Thread GitBox
dongjoon-hyun edited a comment on pull request #29895: URL: https://github.com/apache/spark/pull/29895#issuecomment-700429110 I labeled SPARK-33019 as a correctness issue because a working Apache Spark 2.4 PySpark program can generate a wrong result with Apache Spark 3.0 with Hadoop 3.2

[GitHub] [spark] SparkQA commented on pull request #29800: [SPARK-32934][SQL] Improve the performance for NTH_VALUE and reactor the OffsetWindowFunction

2020-09-28 Thread GitBox
SparkQA commented on pull request #29800: URL: https://github.com/apache/spark/pull/29800#issuecomment-700429952 Kubernetes integration test status failure URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/33824/

[GitHub] [spark] dongjoon-hyun commented on a change in pull request #29895: [SPARK-33019][CORE] Use spark.hadoop.mapreduce.fileoutputcommitter.algorithm.version=1 by default

2020-09-28 Thread GitBox
dongjoon-hyun commented on a change in pull request #29895: URL: https://github.com/apache/spark/pull/29895#discussion_r496405283 ## File path: core/src/main/scala/org/apache/spark/deploy/SparkHadoopUtil.scala ## @@ -462,6 +462,9 @@ private[spark] object SparkHadoopUtil {

[GitHub] [spark] dongjoon-hyun commented on a change in pull request #29895: [SPARK-33019][CORE] Use spark.hadoop.mapreduce.fileoutputcommitter.algorithm.version=1 by default

2020-09-28 Thread GitBox
dongjoon-hyun commented on a change in pull request #29895: URL: https://github.com/apache/spark/pull/29895#discussion_r496405283 ## File path: core/src/main/scala/org/apache/spark/deploy/SparkHadoopUtil.scala ## @@ -462,6 +462,9 @@ private[spark] object SparkHadoopUtil {

[GitHub] [spark] dongjoon-hyun edited a comment on pull request #29895: [SPARK-33019][CORE] Use spark.hadoop.mapreduce.fileoutputcommitter.algorithm.version=1 by default

2020-09-28 Thread GitBox
dongjoon-hyun edited a comment on pull request #29895: URL: https://github.com/apache/spark/pull/29895#issuecomment-700429110 I labeled this issue as a correctness issue because a working Apache Spark 2.4 PySpark program can generate a wrong result with Apache Spark 3.0 with Hadoop 3.2

[GitHub] [spark] dongjoon-hyun edited a comment on pull request #29895: [SPARK-33019][CORE] Use spark.hadoop.mapreduce.fileoutputcommitter.algorithm.version=1 by default

2020-09-28 Thread GitBox
dongjoon-hyun edited a comment on pull request #29895: URL: https://github.com/apache/spark/pull/29895#issuecomment-700429110 I labeled this issue as a correctness issue because a working Apache Spark 2.4 PySpark program can generate a wrong result in Apache Spark 3.0 with Hadoop 3.2

[GitHub] [spark] dongjoon-hyun commented on pull request #29895: [SPARK-33019][CORE] Use spark.hadoop.mapreduce.fileoutputcommitter.algorithm.version=1 by default

2020-09-28 Thread GitBox
dongjoon-hyun commented on pull request #29895: URL: https://github.com/apache/spark/pull/29895#issuecomment-700429110 I labeled this issue as a correctness issue because a working Apache Spark 2.4 PySpark program can generate a wrong result in Apache Spark 3.0 with Hadoop 3.2

[GitHub] [spark] dongjoon-hyun commented on a change in pull request #29895: [SPARK-33019][CORE] Use spark.hadoop.mapreduce.fileoutputcommitter.algorithm.version=1 by default

2020-09-28 Thread GitBox
dongjoon-hyun commented on a change in pull request #29895: URL: https://github.com/apache/spark/pull/29895#discussion_r496405283 ## File path: core/src/main/scala/org/apache/spark/deploy/SparkHadoopUtil.scala ## @@ -462,6 +462,9 @@ private[spark] object SparkHadoopUtil {

[GitHub] [spark] AmplabJenkins commented on pull request #29883: [SPARK-31753][SQL][DOCS][FOLLOW-UP] Add missing keywords in the SQL docs

2020-09-28 Thread GitBox
AmplabJenkins commented on pull request #29883: URL: https://github.com/apache/spark/pull/29883#issuecomment-700427613 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29883: [SPARK-31753][SQL][DOCS][FOLLOW-UP] Add missing keywords in the SQL docs

2020-09-28 Thread GitBox
AmplabJenkins removed a comment on pull request #29883: URL: https://github.com/apache/spark/pull/29883#issuecomment-700427613 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] SparkQA commented on pull request #29883: [SPARK-31753][SQL][DOCS][FOLLOW-UP] Add missing keywords in the SQL docs

2020-09-28 Thread GitBox
SparkQA commented on pull request #29883: URL: https://github.com/apache/spark/pull/29883#issuecomment-700427295 Kubernetes integration test status success URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/33823/

[GitHub] [spark] AmplabJenkins commented on pull request #29899: [SPARK-33020][PYTHON] Add nth_value as a PySpark function

2020-09-28 Thread GitBox
AmplabJenkins commented on pull request #29899: URL: https://github.com/apache/spark/pull/29899#issuecomment-700426470 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29899: [SPARK-33020][PYTHON] Add nth_value as a PySpark function

2020-09-28 Thread GitBox
AmplabJenkins removed a comment on pull request #29899: URL: https://github.com/apache/spark/pull/29899#issuecomment-700426470 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] HyukjinKwon commented on pull request #29898: [SPARK-33021][PYTHON][TESTS] Move functions related test cases into test_functions.py

2020-09-28 Thread GitBox
HyukjinKwon commented on pull request #29898: URL: https://github.com/apache/spark/pull/29898#issuecomment-700425941 Thank you @dongjoon-hyun! This is an automated message from the Apache Git Service. To respond to the

[GitHub] [spark] SparkQA removed a comment on pull request #29899: [SPARK-33020][PYTHON] Add nth_value as a PySpark function

2020-09-28 Thread GitBox
SparkQA removed a comment on pull request #29899: URL: https://github.com/apache/spark/pull/29899#issuecomment-700419470 **[Test build #129210 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/129210/testReport)** for PR 29899 at commit

[GitHub] [spark] SparkQA commented on pull request #29899: [SPARK-33020][PYTHON] Add nth_value as a PySpark function

2020-09-28 Thread GitBox
SparkQA commented on pull request #29899: URL: https://github.com/apache/spark/pull/29899#issuecomment-700425862 **[Test build #129210 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/129210/testReport)** for PR 29899 at commit

[GitHub] [spark] SparkQA commented on pull request #29831: [SPARK-32351][SQL] Show partially pushed down partition filters in explain()

2020-09-28 Thread GitBox
SparkQA commented on pull request #29831: URL: https://github.com/apache/spark/pull/29831#issuecomment-700425678 **[Test build #129213 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/129213/testReport)** for PR 29831 at commit

[GitHub] [spark] dongjoon-hyun closed pull request #29898: [SPARK-33021][PYTHON][TESTS] Move functions related test cases into test_functions.py

2020-09-28 Thread GitBox
dongjoon-hyun closed pull request #29898: URL: https://github.com/apache/spark/pull/29898 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to

[GitHub] [spark] AmplabJenkins commented on pull request #29898: [SPARK-33021][PYTHON][TESTS] Move functions related test cases into test_functions.py

2020-09-28 Thread GitBox
AmplabJenkins commented on pull request #29898: URL: https://github.com/apache/spark/pull/29898#issuecomment-700425151 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29898: [SPARK-33021][PYTHON][TESTS] Move functions related test cases into test_functions.py

2020-09-28 Thread GitBox
AmplabJenkins removed a comment on pull request #29898: URL: https://github.com/apache/spark/pull/29898#issuecomment-700425151 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] SparkQA removed a comment on pull request #29898: [SPARK-33021][PYTHON][TESTS] Move functions related test cases into test_functions.py

2020-09-28 Thread GitBox
SparkQA removed a comment on pull request #29898: URL: https://github.com/apache/spark/pull/29898#issuecomment-700419748 **[Test build #129211 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/129211/testReport)** for PR 29898 at commit

[GitHub] [spark] SparkQA commented on pull request #29898: [SPARK-33021][PYTHON][TESTS] Move functions related test cases into test_functions.py

2020-09-28 Thread GitBox
SparkQA commented on pull request #29898: URL: https://github.com/apache/spark/pull/29898#issuecomment-700424946 **[Test build #129211 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/129211/testReport)** for PR 29898 at commit

[GitHub] [spark] SparkQA commented on pull request #29800: [SPARK-32934][SQL] Improve the performance for NTH_VALUE and reactor the OffsetWindowFunction

2020-09-28 Thread GitBox
SparkQA commented on pull request #29800: URL: https://github.com/apache/spark/pull/29800#issuecomment-700423413 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/33824/

[GitHub] [spark] SparkQA commented on pull request #29883: [SPARK-31753][SQL][DOCS][FOLLOW-UP] Add missing keywords in the SQL docs

2020-09-28 Thread GitBox
SparkQA commented on pull request #29883: URL: https://github.com/apache/spark/pull/29883#issuecomment-700422983 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/33823/

[GitHub] [spark] SparkQA commented on pull request #29871: [SPARK-32995][SQL] CostBasedJoinReorder optimizer rule should be idempotent

2020-09-28 Thread GitBox
SparkQA commented on pull request #29871: URL: https://github.com/apache/spark/pull/29871#issuecomment-700419832 **[Test build #129212 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/129212/testReport)** for PR 29871 at commit

[GitHub] [spark] SparkQA commented on pull request #29898: [SPARK-33021][PYTHON][TESTS] Move functions related test cases into test_functions.py

2020-09-28 Thread GitBox
SparkQA commented on pull request #29898: URL: https://github.com/apache/spark/pull/29898#issuecomment-700419748 **[Test build #129211 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/129211/testReport)** for PR 29898 at commit

[GitHub] [spark] SparkQA commented on pull request #29899: [SPARK-33020][PYTHON] Add nth_value as a PySpark function

2020-09-28 Thread GitBox
SparkQA commented on pull request #29899: URL: https://github.com/apache/spark/pull/29899#issuecomment-700419470 **[Test build #129210 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/129210/testReport)** for PR 29899 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29899: [SPARK-33020][PYTHON] Add nth_value as a PySpark function

2020-09-28 Thread GitBox
AmplabJenkins removed a comment on pull request #29899: URL: https://github.com/apache/spark/pull/29899#issuecomment-700419123 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins commented on pull request #29899: [SPARK-33020][PYTHON] Add nth_value as a PySpark function

2020-09-28 Thread GitBox
AmplabJenkins commented on pull request #29899: URL: https://github.com/apache/spark/pull/29899#issuecomment-700419123 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] SparkQA commented on pull request #29899: [SPARK-33020][PYTHON] Add nth_value as a PySpark function

2020-09-28 Thread GitBox
SparkQA commented on pull request #29899: URL: https://github.com/apache/spark/pull/29899#issuecomment-700418910 Kubernetes integration test status success URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/33822/

[GitHub] [spark] tanelk commented on a change in pull request #29871: [SPARK-32995][SQL] CostBasedJoinReorder optimizer rule should be idempotent

2020-09-28 Thread GitBox
tanelk commented on a change in pull request #29871: URL: https://github.com/apache/spark/pull/29871#discussion_r496352591 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/optimizer/CostBasedJoinReorder.scala ## @@ -206,13 +206,15 @@ object

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29891: [WIP][SPARK-30796][SQL] Add parameter position for REGEXP_REPLACE

2020-09-28 Thread GitBox
AmplabJenkins removed a comment on pull request #29891: URL: https://github.com/apache/spark/pull/29891#issuecomment-700416747 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins commented on pull request #29891: [WIP][SPARK-30796][SQL] Add parameter position for REGEXP_REPLACE

2020-09-28 Thread GitBox
AmplabJenkins commented on pull request #29891: URL: https://github.com/apache/spark/pull/29891#issuecomment-700416747 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] SparkQA commented on pull request #29891: [WIP][SPARK-30796][SQL] Add parameter position for REGEXP_REPLACE

2020-09-28 Thread GitBox
SparkQA commented on pull request #29891: URL: https://github.com/apache/spark/pull/29891#issuecomment-700416619 Kubernetes integration test status success URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/33821/

[GitHub] [spark] AmplabJenkins commented on pull request #29898: [SPARK-33021][PYTHON][TESTS] Move functions related test cases into test_functions.py

2020-09-28 Thread GitBox
AmplabJenkins commented on pull request #29898: URL: https://github.com/apache/spark/pull/29898#issuecomment-700414163 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29883: [SPARK-31753][SQL][DOCS][FOLLOW-UP] Add missing keywords in the SQL docs

2020-09-28 Thread GitBox
AmplabJenkins removed a comment on pull request #29883: URL: https://github.com/apache/spark/pull/29883#issuecomment-700414097 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29898: [SPARK-33021][PYTHON][TESTS] Move functions related test cases into test_functions.py

2020-09-28 Thread GitBox
AmplabJenkins removed a comment on pull request #29898: URL: https://github.com/apache/spark/pull/29898#issuecomment-700414163 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] SparkQA commented on pull request #29898: [SPARK-33021][PYTHON][TESTS] Move functions related test cases into test_functions.py

2020-09-28 Thread GitBox
SparkQA commented on pull request #29898: URL: https://github.com/apache/spark/pull/29898#issuecomment-700414147 Kubernetes integration test status success URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/33820/

[GitHub] [spark] SparkQA removed a comment on pull request #29883: [SPARK-31753][SQL][DOCS][FOLLOW-UP] Add missing keywords in the SQL docs

2020-09-28 Thread GitBox
SparkQA removed a comment on pull request #29883: URL: https://github.com/apache/spark/pull/29883#issuecomment-700411801 **[Test build #129208 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/129208/testReport)** for PR 29883 at commit

[GitHub] [spark] AmplabJenkins commented on pull request #29883: [SPARK-31753][SQL][DOCS][FOLLOW-UP] Add missing keywords in the SQL docs

2020-09-28 Thread GitBox
AmplabJenkins commented on pull request #29883: URL: https://github.com/apache/spark/pull/29883#issuecomment-700414097 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] SparkQA commented on pull request #29883: [SPARK-31753][SQL][DOCS][FOLLOW-UP] Add missing keywords in the SQL docs

2020-09-28 Thread GitBox
SparkQA commented on pull request #29883: URL: https://github.com/apache/spark/pull/29883#issuecomment-700413988 **[Test build #129208 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/129208/testReport)** for PR 29883 at commit

[GitHub] [spark] HyukjinKwon commented on a change in pull request #29899: [SPARK-33020][PYTHON] Add nth_value as a PySpark function

2020-09-28 Thread GitBox
HyukjinKwon commented on a change in pull request #29899: URL: https://github.com/apache/spark/pull/29899#discussion_r496365651 ## File path: python/pyspark/sql/functions.py ## @@ -934,6 +934,25 @@ def lead(col, offset=1, default=None): return

[GitHub] [spark] SparkQA commented on pull request #29899: [SPARK-33020][PYTHON] Add nth_value as a PySpark function

2020-09-28 Thread GitBox
SparkQA commented on pull request #29899: URL: https://github.com/apache/spark/pull/29899#issuecomment-700412707 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/33822/

[GitHub] [spark] SparkQA commented on pull request #29891: [WIP][SPARK-30796][SQL] Add parameter position for REGEXP_REPLACE

2020-09-28 Thread GitBox
SparkQA commented on pull request #29891: URL: https://github.com/apache/spark/pull/29891#issuecomment-700412115 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/33821/

[GitHub] [spark] SparkQA commented on pull request #29883: [SPARK-31753][SQL][DOCS][FOLLOW-UP] Add missing keywords in the SQL docs

2020-09-28 Thread GitBox
SparkQA commented on pull request #29883: URL: https://github.com/apache/spark/pull/29883#issuecomment-700411801 **[Test build #129208 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/129208/testReport)** for PR 29883 at commit

[GitHub] [spark] SparkQA commented on pull request #29800: [SPARK-32934][SQL] Improve the performance for NTH_VALUE and reactor the OffsetWindowFunction

2020-09-28 Thread GitBox
SparkQA commented on pull request #29800: URL: https://github.com/apache/spark/pull/29800#issuecomment-700411822 **[Test build #129209 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/129209/testReport)** for PR 29800 at commit

[GitHub] [spark] ulysses-you commented on a change in pull request #29403: [SPARK-32585][SQL] Support scala enumeration in ScalaReflection

2020-09-28 Thread GitBox
ulysses-you commented on a change in pull request #29403: URL: https://github.com/apache/spark/pull/29403#discussion_r496363878 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/ScalaReflection.scala ## @@ -377,6 +378,29 @@ object ScalaReflection extends

[GitHub] [spark] ulysses-you commented on a change in pull request #29403: [SPARK-32585][SQL] Support scala enumeration in ScalaReflection

2020-09-28 Thread GitBox
ulysses-you commented on a change in pull request #29403: URL: https://github.com/apache/spark/pull/29403#discussion_r496363773 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/ScalaReflection.scala ## @@ -739,6 +771,8 @@ object ScalaReflection extends

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29893: [WIP][SPARK-32976][SQL]Support column list in INSERT statement

2020-09-28 Thread GitBox
AmplabJenkins removed a comment on pull request #29893: URL: https://github.com/apache/spark/pull/29893#issuecomment-700409576 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29893: [WIP][SPARK-32976][SQL]Support column list in INSERT statement

2020-09-28 Thread GitBox
AmplabJenkins removed a comment on pull request #29893: URL: https://github.com/apache/spark/pull/29893#issuecomment-700409574 Merged build finished. Test FAILed. This is an automated message from the Apache Git Service. To

[GitHub] [spark] SparkQA commented on pull request #29898: [SPARK-33021][PYTHON][TESTS] Move functions related test cases into test_functions.py

2020-09-28 Thread GitBox
SparkQA commented on pull request #29898: URL: https://github.com/apache/spark/pull/29898#issuecomment-700409531 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/33820/

[GitHub] [spark] AmplabJenkins commented on pull request #29893: [WIP][SPARK-32976][SQL]Support column list in INSERT statement

2020-09-28 Thread GitBox
AmplabJenkins commented on pull request #29893: URL: https://github.com/apache/spark/pull/29893#issuecomment-700409574 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins commented on pull request #29899: [SPARK-33020][PYTHON] Add nth_value as a PySpark function

2020-09-28 Thread GitBox
AmplabJenkins commented on pull request #29899: URL: https://github.com/apache/spark/pull/29899#issuecomment-700409209 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] SparkQA commented on pull request #29893: [WIP][SPARK-32976][SQL]Support column list in INSERT statement

2020-09-28 Thread GitBox
SparkQA commented on pull request #29893: URL: https://github.com/apache/spark/pull/29893#issuecomment-700409106 **[Test build #129203 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/129203/testReport)** for PR 29893 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29899: [SPARK-33020][PYTHON] Add nth_value as a PySpark function

2020-09-28 Thread GitBox
AmplabJenkins removed a comment on pull request #29899: URL: https://github.com/apache/spark/pull/29899#issuecomment-700409209 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] SparkQA removed a comment on pull request #29893: [WIP][SPARK-32976][SQL]Support column list in INSERT statement

2020-09-28 Thread GitBox
SparkQA removed a comment on pull request #29893: URL: https://github.com/apache/spark/pull/29893#issuecomment-700388776 **[Test build #129203 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/129203/testReport)** for PR 29893 at commit

[GitHub] [spark] SparkQA commented on pull request #29899: [SPARK-33020][PYTHON] Add nth_value as a PySpark function

2020-09-28 Thread GitBox
SparkQA commented on pull request #29899: URL: https://github.com/apache/spark/pull/29899#issuecomment-700408943 Kubernetes integration test status success URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/33819/

[GitHub] [spark] GuoPhilipse commented on pull request #29883: [SPARK-31753][SQL][DOCS][FOLLOW-UP] Add missing keywords in the SQL docs

2020-09-28 Thread GitBox
GuoPhilipse commented on pull request #29883: URL: https://github.com/apache/spark/pull/29883#issuecomment-700407439 Thanks@maropu @huaxingao ,have updated :) This is an automated message from the Apache Git Service. To

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29286: [SPARK-21708][BUILD] Migrate build to sbt 1.x

2020-09-28 Thread GitBox
AmplabJenkins removed a comment on pull request #29286: URL: https://github.com/apache/spark/pull/29286#issuecomment-700407249 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins commented on pull request #29286: [SPARK-21708][BUILD] Migrate build to sbt 1.x

2020-09-28 Thread GitBox
AmplabJenkins commented on pull request #29286: URL: https://github.com/apache/spark/pull/29286#issuecomment-700407249 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29893: [WIP][SPARK-32976][SQL]Support column list in INSERT statement

2020-09-28 Thread GitBox
AmplabJenkins removed a comment on pull request #29893: URL: https://github.com/apache/spark/pull/29893#issuecomment-700406369 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29893: [WIP][SPARK-32976][SQL]Support column list in INSERT statement

2020-09-28 Thread GitBox
AmplabJenkins removed a comment on pull request #29893: URL: https://github.com/apache/spark/pull/29893#issuecomment-700406362 Merged build finished. Test FAILed. This is an automated message from the Apache Git Service. To

[GitHub] [spark] AmplabJenkins commented on pull request #29893: [WIP][SPARK-32976][SQL]Support column list in INSERT statement

2020-09-28 Thread GitBox
AmplabJenkins commented on pull request #29893: URL: https://github.com/apache/spark/pull/29893#issuecomment-700406362 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] SparkQA commented on pull request #29893: [WIP][SPARK-32976][SQL]Support column list in INSERT statement

2020-09-28 Thread GitBox
SparkQA commented on pull request #29893: URL: https://github.com/apache/spark/pull/29893#issuecomment-700406079 Kubernetes integration test status failure URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/33818/

[GitHub] [spark] AmplabJenkins commented on pull request #29899: [SPARK-33020][PYTHON] Add nth_value as a PySpark function

2020-09-28 Thread GitBox
AmplabJenkins commented on pull request #29899: URL: https://github.com/apache/spark/pull/29899#issuecomment-700406036 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins removed a comment on pull request #29899: [SPARK-33020][PYTHON] Add nth_value as a PySpark function

2020-09-28 Thread GitBox
AmplabJenkins removed a comment on pull request #29899: URL: https://github.com/apache/spark/pull/29899#issuecomment-700406036 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] SparkQA removed a comment on pull request #29286: [SPARK-21708][BUILD] Migrate build to sbt 1.x

2020-09-28 Thread GitBox
SparkQA removed a comment on pull request #29286: URL: https://github.com/apache/spark/pull/29286#issuecomment-700355039 **[Test build #129199 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/129199/testReport)** for PR 29286 at commit

[GitHub] [spark] SparkQA commented on pull request #29286: [SPARK-21708][BUILD] Migrate build to sbt 1.x

2020-09-28 Thread GitBox
SparkQA commented on pull request #29286: URL: https://github.com/apache/spark/pull/29286#issuecomment-700405096 **[Test build #129199 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/129199/testReport)** for PR 29286 at commit

  1   2   3   4   5   6   7   >