[jira] [Commented] (SPARK-33348) Use scala.jdk.CollectionConverters replace scala.collection.JavaConverters

2020-12-06 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33348?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17245029#comment-17245029 ] Yang Jie commented on SPARK-33348: -- Yes, need to wait until Scala 2.12 is no longer supported   > Use

[jira] [Updated] (SPARK-33687) ANALYZE command support analyze every tables in a specific database

2020-12-06 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33687?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-33687: Parent: SPARK-30374 Issue Type: Sub-task (was: Improvement) > ANALYZE command support

[jira] [Created] (SPARK-33687) ANALYZE command support analyze every tables in a specific database

2020-12-06 Thread Yuming Wang (Jira)
Yuming Wang created SPARK-33687: --- Summary: ANALYZE command support analyze every tables in a specific database Key: SPARK-33687 URL: https://issues.apache.org/jira/browse/SPARK-33687 Project: Spark

[jira] [Resolved] (SPARK-33671) Remove VIEW checks from V1 table commands

2020-12-06 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33671?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-33671. --- Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 30620

[jira] [Assigned] (SPARK-33671) Remove VIEW checks from V1 table commands

2020-12-06 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33671?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-33671: - Assignee: Maxim Gekk > Remove VIEW checks from V1 table commands >

[jira] [Resolved] (SPARK-33684) Upgrade httpclient from 4.5.6 to 4.5.13

2020-12-06 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33684?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-33684. --- Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 30634

[jira] [Updated] (SPARK-33677) LikeSimplification should be skipped if pattern contains any escapeChar

2020-12-06 Thread Lu Lu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33677?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lu Lu updated SPARK-33677: -- Summary: LikeSimplification should be skipped if pattern contains any escapeChar (was: LikeSimplification

[jira] [Updated] (SPARK-33677) LikeSimplification should be skipped if escape is a wildcard character

2020-12-06 Thread Lu Lu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33677?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lu Lu updated SPARK-33677: -- Description: LikeSimplification rule does not work correctly for many cases that have patterns containing

[jira] [Commented] (SPARK-31412) New Adaptive Query Execution in Spark SQL

2020-12-06 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31412?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17244958#comment-17244958 ] Dongjoon Hyun commented on SPARK-31412: --- Thank you so much, [~cloud_fan]! > New Adaptive Query

[jira] [Commented] (SPARK-31953) Add Spark Structured Streaming History Server Support

2020-12-06 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31953?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17244956#comment-17244956 ] Apache Spark commented on SPARK-31953: -- User 'HyukjinKwon' has created a pull request for this

[jira] [Commented] (SPARK-31953) Add Spark Structured Streaming History Server Support

2020-12-06 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31953?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17244955#comment-17244955 ] Apache Spark commented on SPARK-31953: -- User 'HyukjinKwon' has created a pull request for this

[jira] [Commented] (SPARK-31677) Use KVStore to cache stream query progress

2020-12-06 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31677?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17244940#comment-17244940 ] Apache Spark commented on SPARK-31677: -- User 'uncleGen' has created a pull request for this issue:

[jira] [Resolved] (SPARK-33680) Fix PrunePartitionSuiteBase/BucketedReadWithHiveSupportSuite not to depend on the default conf

2020-12-06 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33680?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-33680. --- Fix Version/s: 3.1.0 Resolution: Fixed Issue resolved by pull request 30631

[jira] [Assigned] (SPARK-33680) Fix PrunePartitionSuiteBase/BucketedReadWithHiveSupportSuite not to depend on the default conf

2020-12-06 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33680?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-33680: - Assignee: Dongjoon Hyun > Fix PrunePartitionSuiteBase/BucketedReadWithHiveSupportSuite

[jira] [Commented] (SPARK-33673) Do not push down partition filters to ParquetScan for DataSourceV2

2020-12-06 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33673?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17244925#comment-17244925 ] Wenchen Fan commented on SPARK-33673: - Seems like a blocker for 3.2 if we are going to use parquet

[jira] [Closed] (SPARK-31412) New Adaptive Query Execution in Spark SQL

2020-12-06 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31412?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan closed SPARK-31412. --- > New Adaptive Query Execution in Spark SQL > - > >

[jira] [Commented] (SPARK-31412) New Adaptive Query Execution in Spark SQL

2020-12-06 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31412?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17244924#comment-17244924 ] Wenchen Fan commented on SPARK-31412: - Yea I think so, the only remaining sub-task is for more

[jira] [Updated] (SPARK-33686) Spark SQL unrecognized `db.tbl`

2020-12-06 Thread xiepengjie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33686?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] xiepengjie updated SPARK-33686: --- Description: When executing command like this: {code:java} create table 

[jira] [Commented] (SPARK-32680) CTAS with V2 catalog wrongly accessed unresolved query

2020-12-06 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32680?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17244919#comment-17244919 ] Apache Spark commented on SPARK-32680: -- User 'linhongliu-db' has created a pull request for this

[jira] [Created] (SPARK-33686) Spark SQL unrecognized `db.tbl`

2020-12-06 Thread xiepengjie (Jira)
xiepengjie created SPARK-33686: -- Summary: Spark SQL unrecognized `db.tbl` Key: SPARK-33686 URL: https://issues.apache.org/jira/browse/SPARK-33686 Project: Spark Issue Type: Improvement

[jira] [Assigned] (SPARK-33685) Migrate DROP VIEW to the new resolution framework

2020-12-06 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33685?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33685: Assignee: Apache Spark > Migrate DROP VIEW to the new resolution framework >

[jira] [Assigned] (SPARK-33685) Migrate DROP VIEW to the new resolution framework

2020-12-06 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33685?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33685: Assignee: (was: Apache Spark) > Migrate DROP VIEW to the new resolution framework >

[jira] [Commented] (SPARK-33685) Migrate DROP VIEW to the new resolution framework

2020-12-06 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33685?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17244916#comment-17244916 ] Apache Spark commented on SPARK-33685: -- User 'imback82' has created a pull request for this issue:

[jira] [Created] (SPARK-33685) Migrate DROP VIEW to the new resolution framework

2020-12-06 Thread Terry Kim (Jira)
Terry Kim created SPARK-33685: - Summary: Migrate DROP VIEW to the new resolution framework Key: SPARK-33685 URL: https://issues.apache.org/jira/browse/SPARK-33685 Project: Spark Issue Type:

[jira] [Commented] (SPARK-33675) Add GitHub Action job to publish snapshot

2020-12-06 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33675?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17244904#comment-17244904 ] Apache Spark commented on SPARK-33675: -- User 'dongjoon-hyun' has created a pull request for this

[jira] [Commented] (SPARK-31510) Set setwd in R documentation build

2020-12-06 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31510?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17244898#comment-17244898 ] Apache Spark commented on SPARK-31510: -- User 'HyukjinKwon' has created a pull request for this

[jira] [Commented] (SPARK-31510) Set setwd in R documentation build

2020-12-06 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31510?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17244897#comment-17244897 ] Apache Spark commented on SPARK-31510: -- User 'HyukjinKwon' has created a pull request for this

[jira] [Assigned] (SPARK-33684) Upgrade httpclient from 4.5.6 to 4.5.13

2020-12-06 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33684?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33684: Assignee: Kousuke Saruta (was: Apache Spark) > Upgrade httpclient from 4.5.6 to 4.5.13

[jira] [Assigned] (SPARK-33684) Upgrade httpclient from 4.5.6 to 4.5.13

2020-12-06 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33684?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33684: Assignee: Apache Spark (was: Kousuke Saruta) > Upgrade httpclient from 4.5.6 to 4.5.13

[jira] [Commented] (SPARK-33684) Upgrade httpclient from 4.5.6 to 4.5.13

2020-12-06 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33684?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17244896#comment-17244896 ] Apache Spark commented on SPARK-33684: -- User 'sarutak' has created a pull request for this issue:

[jira] [Created] (SPARK-33684) Upgrade httpclient from 4.5.6 to 4.5.13

2020-12-06 Thread Kousuke Saruta (Jira)
Kousuke Saruta created SPARK-33684: -- Summary: Upgrade httpclient from 4.5.6 to 4.5.13 Key: SPARK-33684 URL: https://issues.apache.org/jira/browse/SPARK-33684 Project: Spark Issue Type:

[jira] [Resolved] (SPARK-33683) Remove -Djava.version=11 from Scala 2.13 build in GitHub Actions

2020-12-06 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33683?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-33683. --- Fix Version/s: 3.1.0 Resolution: Fixed Issue resolved by pull request 30633

[jira] [Commented] (SPARK-33683) Remove -Djava.version=11 from Scala 2.13 build in GitHub Actions

2020-12-06 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33683?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17244890#comment-17244890 ] Apache Spark commented on SPARK-33683: -- User 'sarutak' has created a pull request for this issue:

[jira] [Assigned] (SPARK-33683) Remove -Djava.version=11 from Scala 2.13 build in GitHub Actions

2020-12-06 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33683?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33683: Assignee: Kousuke Saruta (was: Apache Spark) > Remove -Djava.version=11 from Scala 2.13

[jira] [Assigned] (SPARK-33683) Remove -Djava.version=11 from Scala 2.13 build in GitHub Actions

2020-12-06 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33683?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33683: Assignee: Apache Spark (was: Kousuke Saruta) > Remove -Djava.version=11 from Scala 2.13

[jira] [Resolved] (SPARK-33682) Add Scala, Maven and Zinc caches to GitHub Action job to publish snapshot

2020-12-06 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33682?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-33682. -- Resolution: Later Other jobs have the same issues too. I will take a look later with a new

[jira] [Updated] (SPARK-33683) Remove -Djava.version=11 from Scala 2.13 build in GitHub Actions

2020-12-06 Thread Kousuke Saruta (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33683?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-33683: --- Issue Type: Bug (was: Improvement) > Remove -Djava.version=11 from Scala 2.13 build in

[jira] [Created] (SPARK-33683) Remove -Djava.version=11 from Scala 2.13 build in GitHub Actions

2020-12-06 Thread Kousuke Saruta (Jira)
Kousuke Saruta created SPARK-33683: -- Summary: Remove -Djava.version=11 from Scala 2.13 build in GitHub Actions Key: SPARK-33683 URL: https://issues.apache.org/jira/browse/SPARK-33683 Project: Spark

[jira] [Created] (SPARK-33682) Add Scala, Maven and Zinc caches to GitHub Action job to publish snapshot

2020-12-06 Thread Hyukjin Kwon (Jira)
Hyukjin Kwon created SPARK-33682: Summary: Add Scala, Maven and Zinc caches to GitHub Action job to publish snapshot Key: SPARK-33682 URL: https://issues.apache.org/jira/browse/SPARK-33682 Project:

[jira] [Updated] (SPARK-33670) Verify the partition provider is Hive in v1 SHOW TABLE EXTENDED

2020-12-06 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33670?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-33670: - Fix Version/s: 3.1.0 > Verify the partition provider is Hive in v1 SHOW TABLE EXTENDED >

[jira] [Resolved] (SPARK-33681) Increase K8s IT timeout to 3 minutes

2020-12-06 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33681?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-33681. -- Fix Version/s: 2.4.8 3.0.2 Resolution: Fixed Issue resolved by pull

[jira] [Assigned] (SPARK-33681) Increase K8s IT timeout to 3 minutes

2020-12-06 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33681?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-33681: Assignee: Dongjoon Hyun > Increase K8s IT timeout to 3 minutes >

[jira] [Resolved] (SPARK-33675) Add GitHub Action job to publish snapshot

2020-12-06 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33675?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-33675. -- Fix Version/s: 2.4.8 3.0.2 3.1.0 Resolution:

[jira] [Assigned] (SPARK-33675) Add GitHub Action job to publish snapshot

2020-12-06 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33675?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-33675: Assignee: Dongjoon Hyun > Add GitHub Action job to publish snapshot >

[jira] [Resolved] (SPARK-33663) Fix misleading message for uncaching when createOrReplaceTempView is called

2020-12-06 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33663?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-33663. -- Fix Version/s: 3.1.0 Resolution: Fixed Issue resolved by pull request 30608

[jira] [Assigned] (SPARK-33663) Fix misleading message for uncaching when createOrReplaceTempView is called

2020-12-06 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33663?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-33663: Assignee: Terry Kim > Fix misleading message for uncaching when createOrReplaceTempView

[jira] [Commented] (SPARK-33681) Increase K8s IT timeout to 3 minutes

2020-12-06 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33681?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17244878#comment-17244878 ] Apache Spark commented on SPARK-33681: -- User 'dongjoon-hyun' has created a pull request for this

[jira] [Assigned] (SPARK-33681) Increase K8s IT timeout to 3 minutes

2020-12-06 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33681?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33681: Assignee: Apache Spark > Increase K8s IT timeout to 3 minutes >

[jira] [Assigned] (SPARK-33681) Increase K8s IT timeout to 3 minutes

2020-12-06 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33681?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33681: Assignee: (was: Apache Spark) > Increase K8s IT timeout to 3 minutes >

[jira] [Commented] (SPARK-33681) Increase K8s IT timeout to 3 minutes

2020-12-06 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33681?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17244877#comment-17244877 ] Apache Spark commented on SPARK-33681: -- User 'dongjoon-hyun' has created a pull request for this

[jira] [Updated] (SPARK-33681) Increase K8s IT timeout to 3 minutes

2020-12-06 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33681?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-33681: -- Description: We are using 3 minutes in master/branch-3.1. This issue only happens at

[jira] [Updated] (SPARK-33681) Increase K8s IT timeout to 3 minutes

2020-12-06 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33681?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-33681: -- Affects Version/s: 3.0.1 > Increase K8s IT timeout to 3 minutes >

[jira] [Updated] (SPARK-33681) Increase K8s IT timeout to 3 minutes

2020-12-06 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33681?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-33681: -- Summary: Increase K8s IT timeout to 3 minutes (was: Increase K8s IT timeout) > Increase K8s

[jira] [Created] (SPARK-33681) Increase K8s IT timeout

2020-12-06 Thread Dongjoon Hyun (Jira)
Dongjoon Hyun created SPARK-33681: - Summary: Increase K8s IT timeout Key: SPARK-33681 URL: https://issues.apache.org/jira/browse/SPARK-33681 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-33680) Fix PrunePartitionSuiteBase/BucketedReadWithHiveSupportSuite not to depend on the default conf

2020-12-06 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33680?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17244876#comment-17244876 ] Apache Spark commented on SPARK-33680: -- User 'dongjoon-hyun' has created a pull request for this

[jira] [Assigned] (SPARK-33680) Fix PrunePartitionSuiteBase/BucketedReadWithHiveSupportSuite not to depend on the default conf

2020-12-06 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33680?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33680: Assignee: Apache Spark > Fix PrunePartitionSuiteBase/BucketedReadWithHiveSupportSuite

[jira] [Assigned] (SPARK-33680) Fix PrunePartitionSuiteBase/BucketedReadWithHiveSupportSuite not to depend on the default conf

2020-12-06 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33680?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33680: Assignee: (was: Apache Spark) > Fix

[jira] [Created] (SPARK-33680) Fix PrunePartitionSuiteBase/BucketedReadWithHiveSupportSuite not to depend on the default conf

2020-12-06 Thread Dongjoon Hyun (Jira)
Dongjoon Hyun created SPARK-33680: - Summary: Fix PrunePartitionSuiteBase/BucketedReadWithHiveSupportSuite not to depend on the default conf Key: SPARK-33680 URL: https://issues.apache.org/jira/browse/SPARK-33680

[jira] [Commented] (SPARK-33675) Add GitHub Action job to publish snapshot

2020-12-06 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33675?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17244867#comment-17244867 ] Apache Spark commented on SPARK-33675: -- User 'dongjoon-hyun' has created a pull request for this

[jira] [Commented] (SPARK-33675) Add GitHub Action job to publish snapshot

2020-12-06 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33675?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17244866#comment-17244866 ] Apache Spark commented on SPARK-33675: -- User 'dongjoon-hyun' has created a pull request for this

[jira] [Commented] (SPARK-33675) Add GitHub Action job to publish snapshot

2020-12-06 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33675?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17244865#comment-17244865 ] Apache Spark commented on SPARK-33675: -- User 'dongjoon-hyun' has created a pull request for this

[jira] [Updated] (SPARK-33667) Respect case sensitivity in V1 SHOW PARTITIONS

2020-12-06 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33667?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-33667: -- Fix Version/s: 2.4.8 > Respect case sensitivity in V1 SHOW PARTITIONS >

[jira] [Updated] (SPARK-33667) Respect case sensitivity in V1 SHOW PARTITIONS

2020-12-06 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33667?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-33667: -- Affects Version/s: (was: 3.0.2) (was: 2.4.8)

[jira] [Updated] (SPARK-33667) Respect case sensitivity in V1 SHOW PARTITIONS

2020-12-06 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33667?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-33667: -- Fix Version/s: 3.0.2 > Respect case sensitivity in V1 SHOW PARTITIONS >

[jira] [Commented] (SPARK-33044) Add a Jenkins build and test job for Scala 2.13

2020-12-06 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33044?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17244860#comment-17244860 ] Dongjoon Hyun commented on SPARK-33044: --- Unfortunately, GitHub Action Scala 2.13 job only do the

[jira] [Assigned] (SPARK-33679) Enable spark.sql.adaptive.enabled true by default

2020-12-06 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33679?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33679: Assignee: (was: Apache Spark) > Enable spark.sql.adaptive.enabled true by default >

[jira] [Assigned] (SPARK-33679) Enable spark.sql.adaptive.enabled true by default

2020-12-06 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33679?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33679: Assignee: Apache Spark > Enable spark.sql.adaptive.enabled true by default >

[jira] [Commented] (SPARK-33679) Enable spark.sql.adaptive.enabled true by default

2020-12-06 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33679?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17244854#comment-17244854 ] Apache Spark commented on SPARK-33679: -- User 'dongjoon-hyun' has created a pull request for this

[jira] [Created] (SPARK-33679) Enable spark.sql.adaptive.enabled true by default

2020-12-06 Thread Dongjoon Hyun (Jira)
Dongjoon Hyun created SPARK-33679: - Summary: Enable spark.sql.adaptive.enabled true by default Key: SPARK-33679 URL: https://issues.apache.org/jira/browse/SPARK-33679 Project: Spark Issue

[jira] [Updated] (SPARK-32830) Optimize Skewed BroadcastNestedLoopJoin with AE

2020-12-06 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32830?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-32830: -- Affects Version/s: (was: 3.1.0) 3.2.0 > Optimize Skewed

[jira] [Commented] (SPARK-32830) Optimize Skewed BroadcastNestedLoopJoin with AE

2020-12-06 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32830?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17244853#comment-17244853 ] Dongjoon Hyun commented on SPARK-32830: --- Hi, [~angerszhuuu]. I converted this to a new improvement

[jira] [Updated] (SPARK-32830) Optimize Skewed BroadcastNestedLoopJoin with AE

2020-12-06 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32830?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-32830: -- Parent: (was: SPARK-31412) Issue Type: Improvement (was: Sub-task) > Optimize

[jira] [Commented] (SPARK-31412) New Adaptive Query Execution in Spark SQL

2020-12-06 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31412?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17244852#comment-17244852 ] Dongjoon Hyun commented on SPARK-31412: --- Hi, [~cloud_fan] and [~smilegator] Shall we resolve this

[jira] [Comment Edited] (SPARK-31412) New Adaptive Query Execution in Spark SQL

2020-12-06 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31412?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17244852#comment-17244852 ] Dongjoon Hyun edited comment on SPARK-31412 at 12/6/20, 9:23 PM: - Hi,

[jira] [Resolved] (SPARK-31206) AQE will use the same SubqueryExec even if subqueryReuseEnabled=false

2020-12-06 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31206?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-31206. --- Resolution: Incomplete The PR is closed. Feel free to reopen this if this is still valid >

[jira] [Commented] (SPARK-33668) Fix flaky test "Verify logging configuration is picked from the provided SPARK_CONF_DIR/log4j.properties."

2020-12-06 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33668?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17244848#comment-17244848 ] Dongjoon Hyun commented on SPARK-33668: --- This landed `branch-3.1`, too. > Fix flaky test "Verify

[jira] [Updated] (SPARK-33668) Fix flaky test "Verify logging configuration is picked from the provided SPARK_CONF_DIR/log4j.properties."

2020-12-06 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33668?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-33668: -- Fix Version/s: (was: 3.2.0) 3.1.0 > Fix flaky test "Verify logging

[jira] [Updated] (SPARK-33678) Numerical product aggregation

2020-12-06 Thread Richard Penney (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33678?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Richard Penney updated SPARK-33678: --- Description: There is currently no facility in {{spark.sql.functions}} to allow computation

[jira] [Assigned] (SPARK-32991) RESET can clear StaticSQLConfs

2020-12-06 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32991?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32991: Assignee: Kent Yao (was: Apache Spark) > RESET can clear StaticSQLConfs >

[jira] [Assigned] (SPARK-32991) RESET can clear StaticSQLConfs

2020-12-06 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32991?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32991: Assignee: Apache Spark (was: Kent Yao) > RESET can clear StaticSQLConfs >

[jira] [Commented] (SPARK-33667) Respect case sensitivity in V1 SHOW PARTITIONS

2020-12-06 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33667?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17244763#comment-17244763 ] Apache Spark commented on SPARK-33667: -- User 'MaxGekk' has created a pull request for this issue:

[jira] [Commented] (SPARK-33667) Respect case sensitivity in V1 SHOW PARTITIONS

2020-12-06 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33667?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17244759#comment-17244759 ] Apache Spark commented on SPARK-33667: -- User 'MaxGekk' has created a pull request for this issue:

[jira] [Commented] (SPARK-33667) Respect case sensitivity in V1 SHOW PARTITIONS

2020-12-06 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33667?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17244758#comment-17244758 ] Apache Spark commented on SPARK-33667: -- User 'MaxGekk' has created a pull request for this issue:

[jira] [Resolved] (SPARK-33674) Show Slowpoke notifications in SBT tests

2020-12-06 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33674?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang resolved SPARK-33674. - Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 30621

[jira] [Commented] (SPARK-33044) Add a Jenkins build and test job for Scala 2.13

2020-12-06 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33044?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17244735#comment-17244735 ] Sean R. Owen commented on SPARK-33044: -- Hm no my login doesn't work. OK this isn't covered by the

[jira] [Commented] (SPARK-33677) LikeSimplification should be skipped if escape is a wildcard character

2020-12-06 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33677?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17244734#comment-17244734 ] Apache Spark commented on SPARK-33677: -- User 'luluorta' has created a pull request for this issue:

[jira] [Assigned] (SPARK-33677) LikeSimplification should be skipped if escape is a wildcard character

2020-12-06 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33677?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33677: Assignee: Lu Lu (was: Apache Spark) > LikeSimplification should be skipped if escape is

[jira] [Assigned] (SPARK-33677) LikeSimplification should be skipped if escape is a wildcard character

2020-12-06 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33677?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33677: Assignee: Apache Spark (was: Lu Lu) > LikeSimplification should be skipped if escape is

[jira] [Updated] (SPARK-33678) Numerical product aggregation

2020-12-06 Thread Richard Penney (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33678?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Richard Penney updated SPARK-33678: --- Description: There is currently no facility in {{spark.sql.functions}} to allow computation

[jira] [Updated] (SPARK-33678) Numerical product aggregation

2020-12-06 Thread Richard Penney (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33678?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Richard Penney updated SPARK-33678: --- Description: There is currently no facility in {{spark.sql.functions}} to allow computation

[jira] [Updated] (SPARK-33678) Numerical product aggregation

2020-12-06 Thread Richard Penney (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33678?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Richard Penney updated SPARK-33678: --- Description: There is currently no facility in `spark.sql.functions` to allow computation

[jira] [Updated] (SPARK-33678) Numerical product aggregation

2020-12-06 Thread Richard Penney (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33678?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Richard Penney updated SPARK-33678: --- Description: There is currently no facility in `spark.sql.functions` to allow computation

[jira] [Updated] (SPARK-33678) Numerical product aggregation

2020-12-06 Thread Richard Penney (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33678?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Richard Penney updated SPARK-33678: --- Affects Version/s: 2.4.7 3.0.0 > Numerical product aggregation >

[jira] [Created] (SPARK-33678) Numerical product aggregation

2020-12-06 Thread Richard Penney (Jira)
Richard Penney created SPARK-33678: -- Summary: Numerical product aggregation Key: SPARK-33678 URL: https://issues.apache.org/jira/browse/SPARK-33678 Project: Spark Issue Type: Improvement

[jira] [Updated] (SPARK-33677) LikeSimplification should be skipped if escape is a wildcard character

2020-12-06 Thread Lu Lu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33677?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lu Lu updated SPARK-33677: -- Description: Spark SQL should throw exceptions when pattern string is invalid: {code:sql} SELECT a LIKE

[jira] [Updated] (SPARK-33677) LikeSimplification should be skipped if escape is a wildcard character

2020-12-06 Thread Lu Lu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33677?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lu Lu updated SPARK-33677: -- Fix Version/s: (was: 3.1.0) Affects Version/s: (was: 3.0.1) 3.1.0 >

[jira] [Created] (SPARK-33677) LikeSimplification should be skipped if escape is a wildcard character

2020-12-06 Thread Lu Lu (Jira)
Lu Lu created SPARK-33677: - Summary: LikeSimplification should be skipped if escape is a wildcard character Key: SPARK-33677 URL: https://issues.apache.org/jira/browse/SPARK-33677 Project: Spark

[jira] [Resolved] (SPARK-33667) Respect case sensitivity in V1 SHOW PARTITIONS

2020-12-06 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33667?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-33667. --- Fix Version/s: 3.1.0 Resolution: Fixed Issue resolved by pull request 30615

[jira] [Assigned] (SPARK-33667) Respect case sensitivity in V1 SHOW PARTITIONS

2020-12-06 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33667?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-33667: - Assignee: Maxim Gekk > Respect case sensitivity in V1 SHOW PARTITIONS >

[jira] [Assigned] (SPARK-33676) Require exact matched partition spec to schema in ADD/DROP PARTITION

2020-12-06 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33676?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33676: Assignee: (was: Apache Spark) > Require exact matched partition spec to schema in

  1   2   >