[GitHub] [spark] cloud-fan commented on a change in pull request #28725: [SPARK-31905][SS] Add compatibility tests for streaming state store format

2020-06-19 Thread GitBox
cloud-fan commented on a change in pull request #28725: URL: https://github.com/apache/spark/pull/28725#discussion_r442723369 ## File path: sql/core/src/test/scala/org/apache/spark/sql/streaming/StreamingStateStoreFormatCompatibilitySuite.scala ## @@ -0,0 +1,249 @@ +/* + *

[GitHub] [spark] AmplabJenkins commented on pull request #28871: [SPARK-32033][SS][DSTEAMS]Use new poll API in Kafka connector executor side to avoid infinite wait

2020-06-19 Thread GitBox
AmplabJenkins commented on pull request #28871: URL: https://github.com/apache/spark/pull/28871#issuecomment-646534266 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] SparkQA commented on pull request #28870: [SPARK-32034][SQL] Port HIVE-14817: Shutdown the SessionManager timeoutChecker thread properly upon shutdown

2020-06-19 Thread GitBox
SparkQA commented on pull request #28870: URL: https://github.com/apache/spark/pull/28870#issuecomment-646534485 **[Test build #124277 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/124277/testReport)** for PR 28870 at commit

[GitHub] [spark] SparkQA removed a comment on pull request #28870: [SPARK-32034][SQL] Port HIVE-14817: Shutdown the SessionManager timeoutChecker thread properly upon shutdown

2020-06-19 Thread GitBox
SparkQA removed a comment on pull request #28870: URL: https://github.com/apache/spark/pull/28870#issuecomment-646520825 **[Test build #124277 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/124277/testReport)** for PR 28870 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28871: [SPARK-32033][SS][DSTEAMS]Use new poll API in Kafka connector executor side to avoid infinite wait

2020-06-19 Thread GitBox
AmplabJenkins removed a comment on pull request #28871: URL: https://github.com/apache/spark/pull/28871#issuecomment-646534266 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins commented on pull request #28870: [SPARK-32034][SQL] Port HIVE-14817: Shutdown the SessionManager timeoutChecker thread properly upon shutdown

2020-06-19 Thread GitBox
AmplabJenkins commented on pull request #28870: URL: https://github.com/apache/spark/pull/28870#issuecomment-646534890 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins commented on pull request #28856: [SPARK-31982][SQL]Function sequence doesn't handle date increments that cross DST

2020-06-19 Thread GitBox
AmplabJenkins commented on pull request #28856: URL: https://github.com/apache/spark/pull/28856#issuecomment-646540880 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] maropu commented on a change in pull request #28869: [SPARK-32031][SQL] Fix the wrong references of the PartialMerge/Final AggregateExpression

2020-06-19 Thread GitBox
maropu commented on a change in pull request #28869: URL: https://github.com/apache/spark/pull/28869#discussion_r442761506 ## File path: sql/core/src/main/scala/org/apache/spark/sql/execution/aggregate/BaseAggregateExec.scala ## @@ -53,15 +53,24 @@ trait BaseAggregateExec

[GitHub] [spark] maropu commented on a change in pull request #28869: [SPARK-32031][SQL] Fix the wrong references of the PartialMerge/Final AggregateExpression

2020-06-19 Thread GitBox
maropu commented on a change in pull request #28869: URL: https://github.com/apache/spark/pull/28869#discussion_r442761087 ## File path: sql/core/src/main/scala/org/apache/spark/sql/execution/aggregate/BaseAggregateExec.scala ## @@ -53,15 +53,24 @@ trait BaseAggregateExec

[GitHub] [spark] HyukjinKwon closed pull request #27805: [SPARK-31056][SQL] Add CalendarIntervals division

2020-06-19 Thread GitBox
HyukjinKwon closed pull request #27805: URL: https://github.com/apache/spark/pull/27805 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to

[GitHub] [spark] AmplabJenkins commented on pull request #28853: [SPARK-32019][SQL] Add spark.sql.files.minPartitionNum config

2020-06-19 Thread GitBox
AmplabJenkins commented on pull request #28853: URL: https://github.com/apache/spark/pull/28853#issuecomment-646586055 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28853: [SPARK-32019][SQL] Add spark.sql.files.minPartitionNum config

2020-06-19 Thread GitBox
AmplabJenkins removed a comment on pull request #28853: URL: https://github.com/apache/spark/pull/28853#issuecomment-646586055 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] SparkQA commented on pull request #28853: [SPARK-32019][SQL] Add spark.sql.files.minPartitionNum config

2020-06-19 Thread GitBox
SparkQA commented on pull request #28853: URL: https://github.com/apache/spark/pull/28853#issuecomment-646585600 **[Test build #124287 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/124287/testReport)** for PR 28853 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28805: [SPARK-28169][SQL] Convert scan predicate condition to CNF

2020-06-19 Thread GitBox
AmplabJenkins removed a comment on pull request #28805: URL: https://github.com/apache/spark/pull/28805#issuecomment-646597461 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins commented on pull request #28805: [SPARK-28169][SQL] Convert scan predicate condition to CNF

2020-06-19 Thread GitBox
AmplabJenkins commented on pull request #28805: URL: https://github.com/apache/spark/pull/28805#issuecomment-646597461 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] SparkQA removed a comment on pull request #28123: [SPARK-31350][SQL] Coalesce bucketed tables for sort merge join if applicable

2020-06-19 Thread GitBox
SparkQA removed a comment on pull request #28123: URL: https://github.com/apache/spark/pull/28123#issuecomment-646478735 **[Test build #124271 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/124271/testReport)** for PR 28123 at commit

[GitHub] [spark] AmplabJenkins commented on pull request #28853: [SPARK-32019][SQL] Add spark.sql.files.minPartitionNum config

2020-06-19 Thread GitBox
AmplabJenkins commented on pull request #28853: URL: https://github.com/apache/spark/pull/28853#issuecomment-646604490 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] SparkQA commented on pull request #28123: [SPARK-31350][SQL] Coalesce bucketed tables for sort merge join if applicable

2020-06-19 Thread GitBox
SparkQA commented on pull request #28123: URL: https://github.com/apache/spark/pull/28123#issuecomment-646604145 **[Test build #124271 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/124271/testReport)** for PR 28123 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28853: [SPARK-32019][SQL] Add spark.sql.files.minPartitionNum config

2020-06-19 Thread GitBox
AmplabJenkins removed a comment on pull request #28853: URL: https://github.com/apache/spark/pull/28853#issuecomment-646604490 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AngersZhuuuu opened a new pull request #28872: [WIP][SPARK-11150][SQL][FOLLOW-UP]Support Dynamic Partition pruning for HiveTableScanExec

2020-06-19 Thread GitBox
AngersZh opened a new pull request #28872: URL: https://github.com/apache/spark/pull/28872 ### What changes were proposed in this pull request? Current code just support dynamic partition pruning for DataSourceScan, here we support HiveTableScan ### Why are the changes

[GitHub] [spark] AmplabJenkins commented on pull request #28853: [SPARK-32019][SQL] Add spark.sql.files.minPartitionNum config

2020-06-19 Thread GitBox
AmplabJenkins commented on pull request #28853: URL: https://github.com/apache/spark/pull/28853#issuecomment-646537639 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] SparkQA commented on pull request #28853: [SPARK-32019][SQL] Add spark.sql.files.minPartitionNum config

2020-06-19 Thread GitBox
SparkQA commented on pull request #28853: URL: https://github.com/apache/spark/pull/28853#issuecomment-646537084 **[Test build #124279 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/124279/testReport)** for PR 28853 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28853: [SPARK-32019][SQL] Add spark.sql.files.minPartitionNum config

2020-06-19 Thread GitBox
AmplabJenkins removed a comment on pull request #28853: URL: https://github.com/apache/spark/pull/28853#issuecomment-646537639 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] SparkQA commented on pull request #28856: [SPARK-31982][SQL]Function sequence doesn't handle date increments that cross DST

2020-06-19 Thread GitBox
SparkQA commented on pull request #28856: URL: https://github.com/apache/spark/pull/28856#issuecomment-646543294 **[Test build #124281 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/124281/testReport)** for PR 28856 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28856: [SPARK-31982][SQL]Function sequence doesn't handle date increments that cross DST

2020-06-19 Thread GitBox
AmplabJenkins removed a comment on pull request #28856: URL: https://github.com/apache/spark/pull/28856#issuecomment-646543330 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] SparkQA removed a comment on pull request #28856: [SPARK-31982][SQL]Function sequence doesn't handle date increments that cross DST

2020-06-19 Thread GitBox
SparkQA removed a comment on pull request #28856: URL: https://github.com/apache/spark/pull/28856#issuecomment-646540244 **[Test build #124281 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/124281/testReport)** for PR 28856 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28856: [SPARK-31982][SQL]Function sequence doesn't handle date increments that cross DST

2020-06-19 Thread GitBox
AmplabJenkins removed a comment on pull request #28856: URL: https://github.com/apache/spark/pull/28856#issuecomment-646543318 Merged build finished. Test FAILed. This is an automated message from the Apache Git Service. To

[GitHub] [spark] TJX2014 edited a comment on pull request #28856: [SPARK-31982][SQL]Function sequence doesn't handle date increments that cross DST

2020-06-19 Thread GitBox
TJX2014 edited a comment on pull request #28856: URL: https://github.com/apache/spark/pull/28856#issuecomment-646547844 > **[Test build #124281 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/124281/testReport)** for PR 28856 at commit

[GitHub] [spark] MaxGekk commented on pull request #28856: [SPARK-31982][SQL]Function sequence doesn't handle date increments that cross DST

2020-06-19 Thread GitBox
MaxGekk commented on pull request #28856: URL: https://github.com/apache/spark/pull/28856#issuecomment-646548938 The function `epochDaysToMicros ` was removed by https://github.com/apache/spark/pull/27617. Use `daysToMicros` instead of it.

[GitHub] [spark] maropu commented on a change in pull request #28869: [SPARK-32031][SQL] Fix the wrong references of the PartialMerge/Final AggregateExpression

2020-06-19 Thread GitBox
maropu commented on a change in pull request #28869: URL: https://github.com/apache/spark/pull/28869#discussion_r442753564 ## File path: sql/core/src/main/scala/org/apache/spark/sql/execution/aggregate/BaseAggregateExec.scala ## @@ -53,15 +53,24 @@ trait BaseAggregateExec

[GitHub] [spark] SparkQA commented on pull request #28856: [SPARK-31982][SQL]Function sequence doesn't handle date increments that cross DST

2020-06-19 Thread GitBox
SparkQA commented on pull request #28856: URL: https://github.com/apache/spark/pull/28856#issuecomment-646565549 **[Test build #124286 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/124286/testReport)** for PR 28856 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28856: [SPARK-31982][SQL]Function sequence doesn't handle date increments that cross DST

2020-06-19 Thread GitBox
AmplabJenkins removed a comment on pull request #28856: URL: https://github.com/apache/spark/pull/28856#issuecomment-646566075 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins commented on pull request #28856: [SPARK-31982][SQL]Function sequence doesn't handle date increments that cross DST

2020-06-19 Thread GitBox
AmplabJenkins commented on pull request #28856: URL: https://github.com/apache/spark/pull/28856#issuecomment-646566075 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28853: [SPARK-32019][SQL] Add spark.sql.files.minPartitionNum config

2020-06-19 Thread GitBox
AmplabJenkins removed a comment on pull request #28853: URL: https://github.com/apache/spark/pull/28853#issuecomment-646578022 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] SparkQA commented on pull request #28853: [SPARK-32019][SQL] Add spark.sql.files.minPartitionNum config

2020-06-19 Thread GitBox
SparkQA commented on pull request #28853: URL: https://github.com/apache/spark/pull/28853#issuecomment-646577925 **[Test build #124279 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/124279/testReport)** for PR 28853 at commit

[GitHub] [spark] ulysses-you commented on a change in pull request #28853: [SPARK-32019][SQL] Add spark.sql.files.minPartitionNum config

2020-06-19 Thread GitBox
ulysses-you commented on a change in pull request #28853: URL: https://github.com/apache/spark/pull/28853#discussion_r442784986 ## File path: sql/core/src/test/scala/org/apache/spark/sql/execution/datasources/FileSourceStrategySuite.scala ## @@ -528,6 +528,41 @@ class

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28860: [SPARK-32002][SQL]Support Extract valve from nested ArrayStruct

2020-06-19 Thread GitBox
AmplabJenkins removed a comment on pull request #28860: URL: https://github.com/apache/spark/pull/28860#issuecomment-646591042 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] SparkQA removed a comment on pull request #28860: [SPARK-32002][SQL]Support Extract valve from nested ArrayStruct

2020-06-19 Thread GitBox
SparkQA removed a comment on pull request #28860: URL: https://github.com/apache/spark/pull/28860#issuecomment-646478666 **[Test build #124268 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/124268/testReport)** for PR 28860 at commit

[GitHub] [spark] SparkQA commented on pull request #28860: [SPARK-32002][SQL]Support Extract valve from nested ArrayStruct

2020-06-19 Thread GitBox
SparkQA commented on pull request #28860: URL: https://github.com/apache/spark/pull/28860#issuecomment-646590169 **[Test build #124268 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/124268/testReport)** for PR 28860 at commit

[GitHub] [spark] AmplabJenkins commented on pull request #28860: [SPARK-32002][SQL]Support Extract valve from nested ArrayStruct

2020-06-19 Thread GitBox
AmplabJenkins commented on pull request #28860: URL: https://github.com/apache/spark/pull/28860#issuecomment-646591042 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins commented on pull request #28645: [SPARK-31826][SQL] Support composed type of case class for typed Scala UDF

2020-06-19 Thread GitBox
AmplabJenkins commented on pull request #28645: URL: https://github.com/apache/spark/pull/28645#issuecomment-646593252 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] SparkQA removed a comment on pull request #28645: [SPARK-31826][SQL] Support composed type of case class for typed Scala UDF

2020-06-19 Thread GitBox
SparkQA removed a comment on pull request #28645: URL: https://github.com/apache/spark/pull/28645#issuecomment-646475672 **[Test build #124267 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/124267/testReport)** for PR 28645 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28856: [SPARK-31982][SQL]Function sequence doesn't handle date increments that cross DST

2020-06-19 Thread GitBox
AmplabJenkins removed a comment on pull request #28856: URL: https://github.com/apache/spark/pull/28856#issuecomment-646516124 Merged build finished. Test FAILed. This is an automated message from the Apache Git Service. To

[GitHub] [spark] SparkQA removed a comment on pull request #28856: [SPARK-31982][SQL]Function sequence doesn't handle date increments that cross DST

2020-06-19 Thread GitBox
SparkQA removed a comment on pull request #28856: URL: https://github.com/apache/spark/pull/28856#issuecomment-646514135 **[Test build #124275 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/124275/testReport)** for PR 28856 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28856: [SPARK-31982][SQL]Function sequence doesn't handle date increments that cross DST

2020-06-19 Thread GitBox
AmplabJenkins removed a comment on pull request #28856: URL: https://github.com/apache/spark/pull/28856#issuecomment-646516133 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on pull request #28870: [SPARK-32034][SQL] Port HIVE-14817: Shutdown the SessionManager timeoutChecker thread properly upon shutdown

2020-06-19 Thread GitBox
AmplabJenkins commented on pull request #28870: URL: https://github.com/apache/spark/pull/28870#issuecomment-646521354 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28870: [SPARK-32034][SQL] Port HIVE-14817: Shutdown the SessionManager timeoutChecker thread properly upon shutdown

2020-06-19 Thread GitBox
AmplabJenkins removed a comment on pull request #28870: URL: https://github.com/apache/spark/pull/28870#issuecomment-646521354 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] cloud-fan commented on a change in pull request #28853: [SPARK-32019][SQL] Add spark.sql.files.minPartitionNum config

2020-06-19 Thread GitBox
cloud-fan commented on a change in pull request #28853: URL: https://github.com/apache/spark/pull/28853#discussion_r442717100 ## File path: sql/core/src/test/scala/org/apache/spark/sql/execution/datasources/FileSourceStrategySuite.scala ## @@ -528,6 +528,28 @@ class

[GitHub] [spark] gaborgsomogyi opened a new pull request #28871: [SPARK-32033][SS][DSTEAMS]Use new poll API in Kafka connector executor side to avoid infinite wait

2020-06-19 Thread GitBox
gaborgsomogyi opened a new pull request #28871: URL: https://github.com/apache/spark/pull/28871 ### What changes were proposed in this pull request? Spark uses an old and deprecated API named `KafkaConsumer.poll(long)` which never returns and stays in live lock if metadata is not

[GitHub] [spark] gaborgsomogyi commented on pull request #28871: [SPARK-32033][SS][DSTEAMS]Use new poll API in Kafka connector executor side to avoid infinite wait

2020-06-19 Thread GitBox
gaborgsomogyi commented on pull request #28871: URL: https://github.com/apache/spark/pull/28871#issuecomment-646531491 cc @zsxwing @HeartSaVioR This is an automated message from the Apache Git Service. To respond to the

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28870: [SPARK-32034][SQL] Port HIVE-14817: Shutdown the SessionManager timeoutChecker thread properly upon shutdown

2020-06-19 Thread GitBox
AmplabJenkins removed a comment on pull request #28870: URL: https://github.com/apache/spark/pull/28870#issuecomment-646534890 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28872: [WIP][SPARK-11150][SQL][FOLLOW-UP]Support Dynamic Partition pruning for HiveTableScanExec

2020-06-19 Thread GitBox
AmplabJenkins removed a comment on pull request #28872: URL: https://github.com/apache/spark/pull/28872#issuecomment-646544291 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins commented on pull request #28872: [WIP][SPARK-11150][SQL][FOLLOW-UP]Support Dynamic Partition pruning for HiveTableScanExec

2020-06-19 Thread GitBox
AmplabJenkins commented on pull request #28872: URL: https://github.com/apache/spark/pull/28872#issuecomment-646544291 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] SparkQA commented on pull request #28871: [SPARK-32033][SS][DSTEAMS]Use new poll API in Kafka connector executor side to avoid infinite wait

2020-06-19 Thread GitBox
SparkQA commented on pull request #28871: URL: https://github.com/apache/spark/pull/28871#issuecomment-646550353 **[Test build #124278 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/124278/testReport)** for PR 28871 at commit

[GitHub] [spark] SparkQA removed a comment on pull request #28871: [SPARK-32033][SS][DSTEAMS]Use new poll API in Kafka connector executor side to avoid infinite wait

2020-06-19 Thread GitBox
SparkQA removed a comment on pull request #28871: URL: https://github.com/apache/spark/pull/28871#issuecomment-646533593 **[Test build #124278 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/124278/testReport)** for PR 28871 at commit

[GitHub] [spark] AmplabJenkins commented on pull request #28871: [SPARK-32033][SS][DSTEAMS]Use new poll API in Kafka connector executor side to avoid infinite wait

2020-06-19 Thread GitBox
AmplabJenkins commented on pull request #28871: URL: https://github.com/apache/spark/pull/28871#issuecomment-646550513 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] stijndehaes commented on a change in pull request #28423: [SPARK-24266][k8s] Restart the watcher when we receive a version changed from k8s

2020-06-19 Thread GitBox
stijndehaes commented on a change in pull request #28423: URL: https://github.com/apache/spark/pull/28423#discussion_r442749571 ## File path: resource-managers/kubernetes/core/src/main/scala/org/apache/spark/deploy/k8s/submit/LoggingPodStatusWatcher.scala ## @@ -42,17 +44,24

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28871: [SPARK-32033][SS][DSTEAMS]Use new poll API in Kafka connector executor side to avoid infinite wait

2020-06-19 Thread GitBox
AmplabJenkins removed a comment on pull request #28871: URL: https://github.com/apache/spark/pull/28871#issuecomment-646550513 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] maropu commented on a change in pull request #28869: [SPARK-32031][SQL] Fix the wrong references of the PartialMerge/Final AggregateExpression

2020-06-19 Thread GitBox
maropu commented on a change in pull request #28869: URL: https://github.com/apache/spark/pull/28869#discussion_r442757181 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/aggregate/interfaces.scala ## @@ -140,7 +140,7 @@ case class

[GitHub] [spark] TJX2014 removed a comment on pull request #28856: [SPARK-31982][SQL]Function sequence doesn't handle date increments that cross DST

2020-06-19 Thread GitBox
TJX2014 removed a comment on pull request #28856: URL: https://github.com/apache/spark/pull/28856#issuecomment-646547844 > **[Test build #124281 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/124281/testReport)** for PR 28856 at commit

[GitHub] [spark] HyukjinKwon commented on pull request #27805: [SPARK-31056][SQL] Add CalendarIntervals division

2020-06-19 Thread GitBox
HyukjinKwon commented on pull request #27805: URL: https://github.com/apache/spark/pull/27805#issuecomment-646573627 I am closing this per ^. This is an automated message from the Apache Git Service. To respond to the

[GitHub] [spark] AmplabJenkins commented on pull request #28423: [SPARK-24266][k8s] Restart the watcher when we receive a version changed from k8s

2020-06-19 Thread GitBox
AmplabJenkins commented on pull request #28423: URL: https://github.com/apache/spark/pull/28423#issuecomment-646581709 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] SparkQA commented on pull request #28423: [SPARK-24266][k8s] Restart the watcher when we receive a version changed from k8s

2020-06-19 Thread GitBox
SparkQA commented on pull request #28423: URL: https://github.com/apache/spark/pull/28423#issuecomment-646581689 Kubernetes integration test status success URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/28902/

[GitHub] [spark] SparkQA commented on pull request #28805: [SPARK-28169][SQL] Convert scan predicate condition to CNF

2020-06-19 Thread GitBox
SparkQA commented on pull request #28805: URL: https://github.com/apache/spark/pull/28805#issuecomment-646596472 **[Test build #124270 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/124270/testReport)** for PR 28805 at commit

[GitHub] [spark] SparkQA commented on pull request #28856: [SPARK-31982][SQL]Function sequence doesn't handle date increments that cross DST

2020-06-19 Thread GitBox
SparkQA commented on pull request #28856: URL: https://github.com/apache/spark/pull/28856#issuecomment-646516105 **[Test build #124275 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/124275/testReport)** for PR 28856 at commit

[GitHub] [spark] AmplabJenkins commented on pull request #28856: [SPARK-31982][SQL]Function sequence doesn't handle date increments that cross DST

2020-06-19 Thread GitBox
AmplabJenkins commented on pull request #28856: URL: https://github.com/apache/spark/pull/28856#issuecomment-646516124 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] SparkQA commented on pull request #28872: [WIP][SPARK-11150][SQL][FOLLOW-UP]Support Dynamic Partition pruning for HiveTableScanExec

2020-06-19 Thread GitBox
SparkQA commented on pull request #28872: URL: https://github.com/apache/spark/pull/28872#issuecomment-646543615 **[Test build #124282 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/124282/testReport)** for PR 28872 at commit

[GitHub] [spark] AmplabJenkins commented on pull request #28856: [SPARK-31982][SQL]Function sequence doesn't handle date increments that cross DST

2020-06-19 Thread GitBox
AmplabJenkins commented on pull request #28856: URL: https://github.com/apache/spark/pull/28856#issuecomment-646543318 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] TJX2014 removed a comment on pull request #28856: [SPARK-31982][SQL]Function sequence doesn't handle date increments that cross DST

2020-06-19 Thread GitBox
TJX2014 removed a comment on pull request #28856: URL: https://github.com/apache/spark/pull/28856#issuecomment-646545519 > **[Test build #124281 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/124281/testReport)** for PR 28856 at commit

[GitHub] [spark] ulysses-you commented on pull request #26875: [SPARK-30245][SQL] Add cache for Like and RLike when pattern is not static

2020-06-19 Thread GitBox
ulysses-you commented on pull request #26875: URL: https://github.com/apache/spark/pull/26875#issuecomment-646556878 @HyukjinKwon sorry, I missed many things. And thanks @beliefer do the benchmark, but it seems something wrong, the right part should not be a foldable value. The PR

[GitHub] [spark] maropu commented on a change in pull request #28869: [SPARK-32031][SQL] Fix the wrong references of the PartialMerge/Final AggregateExpression

2020-06-19 Thread GitBox
maropu commented on a change in pull request #28869: URL: https://github.com/apache/spark/pull/28869#discussion_r442756818 ## File path: sql/core/src/main/scala/org/apache/spark/sql/execution/aggregate/BaseAggregateExec.scala ## @@ -53,15 +53,24 @@ trait BaseAggregateExec

[GitHub] [spark] HyukjinKwon commented on a change in pull request #28858: [WIP][SPARK-7101][SQL] support java.sql.Time

2020-06-19 Thread GitBox
HyukjinKwon commented on a change in pull request #28858: URL: https://github.com/apache/spark/pull/28858#discussion_r442765441 ## File path: sql/catalyst/src/main/java/org/apache/spark/sql/catalyst/expressions/UnsafeRow.java ## @@ -90,7 +90,8 @@ public static int

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28423: [SPARK-24266][k8s] Restart the watcher when we receive a version changed from k8s

2020-06-19 Thread GitBox
AmplabJenkins removed a comment on pull request #28423: URL: https://github.com/apache/spark/pull/28423#issuecomment-646581709 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] SparkQA commented on pull request #28869: [SPARK-32031][SQL] Fix the wrong references of the PartialMerge/Final AggregateExpression

2020-06-19 Thread GitBox
SparkQA commented on pull request #28869: URL: https://github.com/apache/spark/pull/28869#issuecomment-646598545 **[Test build #124272 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/124272/testReport)** for PR 28869 at commit

[GitHub] [spark] AmplabJenkins commented on pull request #28725: [WIP][SPARK-31905][SS] Add compatibility tests for streaming state store format

2020-06-19 Thread GitBox
AmplabJenkins commented on pull request #28725: URL: https://github.com/apache/spark/pull/28725#issuecomment-646514690 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] SparkQA commented on pull request #28725: [WIP][SPARK-31905][SS] Add compatibility tests for streaming state store format

2020-06-19 Thread GitBox
SparkQA commented on pull request #28725: URL: https://github.com/apache/spark/pull/28725#issuecomment-646514143 **[Test build #124276 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/124276/testReport)** for PR 28725 at commit

[GitHub] [spark] SparkQA commented on pull request #28856: [SPARK-31982][SQL]Function sequence doesn't handle date increments that cross DST

2020-06-19 Thread GitBox
SparkQA commented on pull request #28856: URL: https://github.com/apache/spark/pull/28856#issuecomment-646514135 **[Test build #124275 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/124275/testReport)** for PR 28856 at commit

[GitHub] [spark] xuanyuanking commented on pull request #28725: [WIP][SPARK-31905][SS] Add compatibility tests for streaming state store format

2020-06-19 Thread GitBox
xuanyuanking commented on pull request #28725: URL: https://github.com/apache/spark/pull/28725#issuecomment-646515571 #28707 has been merged, these integration tests are ready for review. cc @cloud-fan @HeartSaVioR for taking a look when you have time.

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28856: [SPARK-31982][SQL]Function sequence doesn't handle date increments that cross DST

2020-06-19 Thread GitBox
AmplabJenkins removed a comment on pull request #28856: URL: https://github.com/apache/spark/pull/28856#issuecomment-646514646 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins commented on pull request #28856: [SPARK-31982][SQL]Function sequence doesn't handle date increments that cross DST

2020-06-19 Thread GitBox
AmplabJenkins commented on pull request #28856: URL: https://github.com/apache/spark/pull/28856#issuecomment-646514646 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28725: [WIP][SPARK-31905][SS] Add compatibility tests for streaming state store format

2020-06-19 Thread GitBox
AmplabJenkins removed a comment on pull request #28725: URL: https://github.com/apache/spark/pull/28725#issuecomment-646514690 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] cloud-fan commented on a change in pull request #28853: [SPARK-32019][SQL] Add spark.sql.files.minPartitionNum config

2020-06-19 Thread GitBox
cloud-fan commented on a change in pull request #28853: URL: https://github.com/apache/spark/pull/28853#discussion_r442717100 ## File path: sql/core/src/test/scala/org/apache/spark/sql/execution/datasources/FileSourceStrategySuite.scala ## @@ -528,6 +528,28 @@ class

[GitHub] [spark] SparkQA commented on pull request #28870: [SPARK-32034][SQL] Port HIVE-14817: Shutdown the SessionManager timeoutChecker thread properly upon shutdown

2020-06-19 Thread GitBox
SparkQA commented on pull request #28870: URL: https://github.com/apache/spark/pull/28870#issuecomment-646520825 **[Test build #124277 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/124277/testReport)** for PR 28870 at commit

[GitHub] [spark] SparkQA commented on pull request #28872: [WIP][SPARK-11150][SQL][FOLLOW-UP]Support Dynamic Partition pruning for HiveTableScanExec

2020-06-19 Thread GitBox
SparkQA commented on pull request #28872: URL: https://github.com/apache/spark/pull/28872#issuecomment-646540992 **[Test build #124280 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/124280/testReport)** for PR 28872 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28856: [SPARK-31982][SQL]Function sequence doesn't handle date increments that cross DST

2020-06-19 Thread GitBox
AmplabJenkins removed a comment on pull request #28856: URL: https://github.com/apache/spark/pull/28856#issuecomment-646540880 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins commented on pull request #28872: [WIP][SPARK-11150][SQL][FOLLOW-UP]Support Dynamic Partition pruning for HiveTableScanExec

2020-06-19 Thread GitBox
AmplabJenkins commented on pull request #28872: URL: https://github.com/apache/spark/pull/28872#issuecomment-646540945 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28872: [WIP][SPARK-11150][SQL][FOLLOW-UP]Support Dynamic Partition pruning for HiveTableScanExec

2020-06-19 Thread GitBox
AmplabJenkins removed a comment on pull request #28872: URL: https://github.com/apache/spark/pull/28872#issuecomment-646540945 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] SparkQA removed a comment on pull request #28872: [WIP][SPARK-11150][SQL][FOLLOW-UP]Support Dynamic Partition pruning for HiveTableScanExec

2020-06-19 Thread GitBox
SparkQA removed a comment on pull request #28872: URL: https://github.com/apache/spark/pull/28872#issuecomment-646540230 **[Test build #124280 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/124280/testReport)** for PR 28872 at commit

[GitHub] [spark] ulysses-you closed pull request #28304: [SPARK-31523][SQL] LogicalPlan doCanonicalize should throw exception if not resolved

2020-06-19 Thread GitBox
ulysses-you closed pull request #28304: URL: https://github.com/apache/spark/pull/28304 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28872: [WIP][SPARK-11150][SQL][FOLLOW-UP]Support Dynamic Partition pruning for HiveTableScanExec

2020-06-19 Thread GitBox
AmplabJenkins removed a comment on pull request #28872: URL: https://github.com/apache/spark/pull/28872#issuecomment-646541016 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] TJX2014 commented on pull request #28856: [SPARK-31982][SQL]Function sequence doesn't handle date increments that cross DST

2020-06-19 Thread GitBox
TJX2014 commented on pull request #28856: URL: https://github.com/apache/spark/pull/28856#issuecomment-646545519 > **[Test build #124281 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/124281/testReport)** for PR 28856 at commit

[GitHub] [spark] HyukjinKwon commented on pull request #26875: [SPARK-30245][SQL] Add cache for Like and RLike when pattern is not static

2020-06-19 Thread GitBox
HyukjinKwon commented on pull request #26875: URL: https://github.com/apache/spark/pull/26875#issuecomment-646560676 @ulysses-you, thank you so much. Feel free to reopen the PR. This is an automated message from the Apache

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28856: [SPARK-31982][SQL]Function sequence doesn't handle date increments that cross DST

2020-06-19 Thread GitBox
AmplabJenkins removed a comment on pull request #28856: URL: https://github.com/apache/spark/pull/28856#issuecomment-646563213 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] SparkQA commented on pull request #28645: [SPARK-31826][SQL] Support composed type of case class for typed Scala UDF

2020-06-19 Thread GitBox
SparkQA commented on pull request #28645: URL: https://github.com/apache/spark/pull/28645#issuecomment-646592361 **[Test build #124267 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/124267/testReport)** for PR 28645 at commit

[GitHub] [spark] SparkQA removed a comment on pull request #28805: [SPARK-28169][SQL] Convert scan predicate condition to CNF

2020-06-19 Thread GitBox
SparkQA removed a comment on pull request #28805: URL: https://github.com/apache/spark/pull/28805#issuecomment-646478690 **[Test build #124270 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/124270/testReport)** for PR 28805 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #28123: [SPARK-31350][SQL] Coalesce bucketed tables for sort merge join if applicable

2020-06-19 Thread GitBox
AmplabJenkins removed a comment on pull request #28123: URL: https://github.com/apache/spark/pull/28123#issuecomment-646605119 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins commented on pull request #28123: [SPARK-31350][SQL] Coalesce bucketed tables for sort merge join if applicable

2020-06-19 Thread GitBox
AmplabJenkins commented on pull request #28123: URL: https://github.com/apache/spark/pull/28123#issuecomment-646605119 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] ulysses-you commented on a change in pull request #28840: [SPARK-31999][SQL] Add REFRESH FUNCTION command

2020-06-19 Thread GitBox
ulysses-you commented on a change in pull request #28840: URL: https://github.com/apache/spark/pull/28840#discussion_r442706595 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/connector/catalog/LookupCatalog.scala ## @@ -155,4 +155,37 @@ private[sql] trait

[GitHub] [spark] SparkQA commented on pull request #28872: [WIP][SPARK-11150][SQL][FOLLOW-UP]Support Dynamic Partition pruning for HiveTableScanExec

2020-06-19 Thread GitBox
SparkQA commented on pull request #28872: URL: https://github.com/apache/spark/pull/28872#issuecomment-646540230 **[Test build #124280 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/124280/testReport)** for PR 28872 at commit

[GitHub] [spark] SparkQA commented on pull request #28856: [SPARK-31982][SQL]Function sequence doesn't handle date increments that cross DST

2020-06-19 Thread GitBox
SparkQA commented on pull request #28856: URL: https://github.com/apache/spark/pull/28856#issuecomment-646540244 **[Test build #124281 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/124281/testReport)** for PR 28856 at commit

  1   2   3   4   5   6   7   >