[jira] [Created] (SPARK-34155) Refine TPCDSBase to add partition columns

2021-01-18 Thread Yuming Wang (Jira)
Yuming Wang created SPARK-34155: --- Summary: Refine TPCDSBase to add partition columns Key: SPARK-34155 URL: https://issues.apache.org/jira/browse/SPARK-34155 Project: Spark Issue Type:

[jira] [Commented] (SPARK-34153) Remove unused `getRawTable()` from `HiveExternalCatalog.alterPartitions()`

2021-01-18 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34153?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17267716#comment-17267716 ] Apache Spark commented on SPARK-34153: -- User 'MaxGekk' has created a pull request for this issue:

[jira] [Commented] (SPARK-34153) Remove unused `getRawTable()` from `HiveExternalCatalog.alterPartitions()`

2021-01-18 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34153?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17267715#comment-17267715 ] Apache Spark commented on SPARK-34153: -- User 'MaxGekk' has created a pull request for this issue:

[jira] [Commented] (SPARK-34153) Remove unused `getRawTable()` from `HiveExternalCatalog.alterPartitions()`

2021-01-18 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34153?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17267700#comment-17267700 ] Apache Spark commented on SPARK-34153: -- User 'MaxGekk' has created a pull request for this issue:

[jira] [Commented] (SPARK-33888) JDBC SQL TIME type represents incorrectly as TimestampType, it should be physical Int in millis

2021-01-18 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33888?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17267698#comment-17267698 ] Wenchen Fan commented on SPARK-33888: - Hi [~stephenk] , thanks for reporting this issue! Your patch

[jira] [Commented] (SPARK-34153) Remove unused `getRawTable()` from `HiveExternalCatalog.alterPartitions()`

2021-01-18 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34153?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17267699#comment-17267699 ] Apache Spark commented on SPARK-34153: -- User 'MaxGekk' has created a pull request for this issue:

[jira] [Assigned] (SPARK-34119) Keep necessary stats after partition pruning

2021-01-18 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34119?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-34119: --- Assignee: Yuming Wang > Keep necessary stats after partition pruning >

[jira] [Resolved] (SPARK-34119) Keep necessary stats after partition pruning

2021-01-18 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34119?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-34119. - Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 31205

[jira] [Resolved] (SPARK-34143) Adding partitions to fully partitioned v2 table

2021-01-18 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34143?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-34143. - Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 31216

[jira] [Assigned] (SPARK-34143) Adding partitions to fully partitioned v2 table

2021-01-18 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34143?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-34143: --- Assignee: Maxim Gekk > Adding partitions to fully partitioned v2 table >

[jira] [Commented] (SPARK-12890) Spark SQL query related to only partition fields should not scan the whole data.

2021-01-18 Thread Nicholas Chammas (Jira)
[ https://issues.apache.org/jira/browse/SPARK-12890?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17267657#comment-17267657 ] Nicholas Chammas commented on SPARK-12890: -- Sure, will do. > Spark SQL query related to only

[jira] [Commented] (SPARK-34131) NPE when driver.podTemplateFile defines no containers

2021-01-18 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34131?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17267653#comment-17267653 ] Dongjoon Hyun commented on SPARK-34131: --- Hi, [~jlaskowski]. Does this bug exist in the latest

[jira] [Commented] (SPARK-34131) NPE when driver.podTemplateFile defines no containers

2021-01-18 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34131?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17267650#comment-17267650 ] Dongjoon Hyun commented on SPARK-34131: --- Thank you for pinging me, [~hyukjin.kwon]. > NPE when

[jira] [Updated] (SPARK-34154) Flaky Test: LocalityPlacementStrategySuite.handle large number of containers and tasks (SPARK-18750)

2021-01-18 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34154?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-34154: -- Description: `LocalityPlacementStrategySuite` hangs sometimes like the following. We can

[jira] [Updated] (SPARK-34154) Flaky Test: LocalityPlacementStrategySuite.handle large number of containers and tasks (SPARK-18750)

2021-01-18 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34154?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-34154: -- Description: `LocalityPlacementStrategySuite` hangs sometimes like the following. We can

[jira] [Updated] (SPARK-34154) Flaky Test: LocalityPlacementStrategySuite.handle large number of containers and tasks (SPARK-18750)

2021-01-18 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34154?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-34154: -- Description: `LocalityPlacementStrategySuite` hangs frequently.

[jira] [Created] (SPARK-34154) Flaky Test: LocalityPlacementStrategySuite.handle large number of containers and tasks (SPARK-18750)

2021-01-18 Thread Dongjoon Hyun (Jira)
Dongjoon Hyun created SPARK-34154: - Summary: Flaky Test: LocalityPlacementStrategySuite.handle large number of containers and tasks (SPARK-18750) Key: SPARK-34154 URL:

[jira] [Updated] (SPARK-34154) Flaky Test: LocalityPlacementStrategySuite.handle large number of containers and tasks (SPARK-18750)

2021-01-18 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34154?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-34154: -- Description: `LocalityPlacementStrategySuite` hangs frequently. -

[jira] [Commented] (SPARK-34121) Intersect operator missing rowCount when CBO enabled

2021-01-18 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34121?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17267635#comment-17267635 ] Apache Spark commented on SPARK-34121: -- User 'AngersZh' has created a pull request for this

[jira] [Assigned] (SPARK-34121) Intersect operator missing rowCount when CBO enabled

2021-01-18 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34121?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34121: Assignee: (was: Apache Spark) > Intersect operator missing rowCount when CBO enabled

[jira] [Commented] (SPARK-34121) Intersect operator missing rowCount when CBO enabled

2021-01-18 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34121?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17267633#comment-17267633 ] Apache Spark commented on SPARK-34121: -- User 'AngersZh' has created a pull request for this

[jira] [Assigned] (SPARK-34121) Intersect operator missing rowCount when CBO enabled

2021-01-18 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34121?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34121: Assignee: Apache Spark > Intersect operator missing rowCount when CBO enabled >

[jira] [Resolved] (SPARK-34150) Strip Null literal.sql in resolve alias

2021-01-18 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34150?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-34150. - Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 31233

[jira] [Assigned] (SPARK-34150) Strip Null literal.sql in resolve alias

2021-01-18 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34150?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-34150: --- Assignee: ulysses you > Strip Null literal.sql in resolve alias >

[jira] [Commented] (SPARK-33730) Standardize warning types

2021-01-18 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33730?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17267619#comment-17267619 ] Apache Spark commented on SPARK-33730: -- User 'HyukjinKwon' has created a pull request for this

[jira] [Updated] (SPARK-34027) ALTER TABLE .. RECOVER PARTITIONS doesn't refresh cache

2021-01-18 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34027?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan updated SPARK-34027: Fix Version/s: 3.1.1 3.0.2 > ALTER TABLE .. RECOVER PARTITIONS doesn't refresh

[jira] [Commented] (SPARK-33730) Standardize warning types

2021-01-18 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33730?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17267618#comment-17267618 ] Apache Spark commented on SPARK-33730: -- User 'HyukjinKwon' has created a pull request for this

[jira] [Resolved] (SPARK-34153) Remove unused `getRawTable()` from `HiveExternalCatalog.alterPartitions()`

2021-01-18 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34153?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-34153. -- Fix Version/s: 3.2.0 Assignee: Maxim Gekk Resolution: Fixed > Remove unused

[jira] [Commented] (SPARK-34153) Remove unused `getRawTable()` from `HiveExternalCatalog.alterPartitions()`

2021-01-18 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34153?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17267603#comment-17267603 ] Hyukjin Kwon commented on SPARK-34153: -- Fixed in https://github.com/apache/spark/pull/31234 >

[jira] [Commented] (SPARK-33888) JDBC SQL TIME type represents incorrectly as TimestampType, it should be physical Int in millis

2021-01-18 Thread Stephen Kestle (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33888?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17267575#comment-17267575 ] Stephen Kestle commented on SPARK-33888: The change introduces a bug wrt Postgres loading of

[jira] [Resolved] (SPARK-33913) Upgrade Kafka to 2.7.0

2021-01-18 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33913?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-33913. --- Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 31223

[jira] [Assigned] (SPARK-33913) Upgrade Kafka to 2.7.0

2021-01-18 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33913?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-33913: - Assignee: Dongjoon Hyun > Upgrade Kafka to 2.7.0 > -- > >

[jira] [Resolved] (SPARK-31168) Upgrade Scala to 2.12.13

2021-01-18 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31168?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-31168. --- Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 31223

[jira] [Assigned] (SPARK-31168) Upgrade Scala to 2.12.13

2021-01-18 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31168?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-31168: - Assignee: Dongjoon Hyun > Upgrade Scala to 2.12.13 > > >

[jira] [Commented] (SPARK-32194) Standardize exceptions in PySpark

2021-01-18 Thread Liel Bach (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32194?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17267513#comment-17267513 ] Liel Bach commented on SPARK-32194: --- Opened a PR [here|https://github.com/apache/spark/pull/31238]  

[jira] [Commented] (SPARK-32194) Standardize exceptions in PySpark

2021-01-18 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32194?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17267514#comment-17267514 ] Apache Spark commented on SPARK-32194: -- User 'LielBach' has created a pull request for this issue:

[jira] [Assigned] (SPARK-32194) Standardize exceptions in PySpark

2021-01-18 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32194?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32194: Assignee: Apache Spark > Standardize exceptions in PySpark >

[jira] [Assigned] (SPARK-32194) Standardize exceptions in PySpark

2021-01-18 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32194?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32194: Assignee: (was: Apache Spark) > Standardize exceptions in PySpark >

[jira] [Commented] (SPARK-34074) Update stats when table size changes

2021-01-18 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34074?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17267489#comment-17267489 ] Apache Spark commented on SPARK-34074: -- User 'MaxGekk' has created a pull request for this issue:

[jira] [Commented] (SPARK-34074) Update stats when table size changes

2021-01-18 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34074?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17267490#comment-17267490 ] Apache Spark commented on SPARK-34074: -- User 'MaxGekk' has created a pull request for this issue:

[jira] [Assigned] (SPARK-34093) param maxDepth should check upper bound

2021-01-18 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34093?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen reassigned SPARK-34093: Assignee: zhengruifeng > param maxDepth should check upper bound >

[jira] [Resolved] (SPARK-34093) param maxDepth should check upper bound

2021-01-18 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34093?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-34093. -- Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 31163

[jira] [Commented] (SPARK-34152) CreateViewStatement.child should be a real child

2021-01-18 Thread Terry Kim (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34152?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17267416#comment-17267416 ] Terry Kim commented on SPARK-34152: --- [~cloud_fan] Yes, I will take a look. Thanks. >

[jira] [Commented] (SPARK-32582) Spark SQL Infer Schema Performance

2021-01-18 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32582?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17267408#comment-17267408 ] Steve Loughran commented on SPARK-32582: Returning to this. The incremental

[jira] [Commented] (SPARK-33605) Add GCS FS/connector config (dependencies?) akin to S3

2021-01-18 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33605?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17267398#comment-17267398 ] Steve Loughran commented on SPARK-33605: hadoop-aws and aws-sdk JARs come if you build

[jira] [Commented] (SPARK-34027) ALTER TABLE .. RECOVER PARTITIONS doesn't refresh cache

2021-01-18 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34027?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17267377#comment-17267377 ] Apache Spark commented on SPARK-34027: -- User 'MaxGekk' has created a pull request for this issue:

[jira] [Commented] (SPARK-34027) ALTER TABLE .. RECOVER PARTITIONS doesn't refresh cache

2021-01-18 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34027?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17267375#comment-17267375 ] Apache Spark commented on SPARK-34027: -- User 'MaxGekk' has created a pull request for this issue:

[jira] [Commented] (SPARK-34027) ALTER TABLE .. RECOVER PARTITIONS doesn't refresh cache

2021-01-18 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34027?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17267356#comment-17267356 ] Apache Spark commented on SPARK-34027: -- User 'MaxGekk' has created a pull request for this issue:

[jira] [Commented] (SPARK-34027) ALTER TABLE .. RECOVER PARTITIONS doesn't refresh cache

2021-01-18 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34027?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17267343#comment-17267343 ] Apache Spark commented on SPARK-34027: -- User 'MaxGekk' has created a pull request for this issue:

[jira] [Assigned] (SPARK-34153) Remove unused `getRawTable()` from `HiveExternalCatalog.alterPartitions()`

2021-01-18 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34153?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34153: Assignee: (was: Apache Spark) > Remove unused `getRawTable()` from

[jira] [Assigned] (SPARK-34153) Remove unused `getRawTable()` from `HiveExternalCatalog.alterPartitions()`

2021-01-18 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34153?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34153: Assignee: Apache Spark > Remove unused `getRawTable()` from

[jira] [Commented] (SPARK-34153) Remove unused `getRawTable()` from `HiveExternalCatalog.alterPartitions()`

2021-01-18 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34153?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17267299#comment-17267299 ] Apache Spark commented on SPARK-34153: -- User 'MaxGekk' has created a pull request for this issue:

[jira] [Resolved] (SPARK-34027) ALTER TABLE .. RECOVER PARTITIONS doesn't refresh cache

2021-01-18 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34027?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-34027. - Resolution: Fixed Issue resolved by pull request 31066

[jira] [Created] (SPARK-34153) Remove unused `getRawTable()` from `HiveExternalCatalog.alterPartitions()`

2021-01-18 Thread Maxim Gekk (Jira)
Maxim Gekk created SPARK-34153: -- Summary: Remove unused `getRawTable()` from `HiveExternalCatalog.alterPartitions()` Key: SPARK-34153 URL: https://issues.apache.org/jira/browse/SPARK-34153 Project:

[jira] [Commented] (SPARK-34078) Provide async variants for Dataset APIs

2021-01-18 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34078?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17267260#comment-17267260 ] Wenchen Fan commented on SPARK-34078: - I think it's a good idea and we can probably follow some

[jira] [Commented] (SPARK-29890) Unable to fill na with 0 with duplicate columns

2021-01-18 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29890?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17267251#comment-17267251 ] Wenchen Fan commented on SPARK-29890: - I think failing makes more sense than silently ignore it. >

[jira] [Resolved] (SPARK-34151) Replaces `java.io.FIle.toURL` with `java.io.File.toURI.toURL`

2021-01-18 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34151?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-34151. -- Fix Version/s: 3.1.2 Resolution: Fixed Issue resolved by pull request 31230

[jira] [Assigned] (SPARK-34151) Replaces `java.io.FIle.toURL` with `java.io.File.toURI.toURL`

2021-01-18 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34151?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-34151: Assignee: Yang Jie > Replaces `java.io.FIle.toURL` with `java.io.File.toURI.toURL` >

[jira] [Updated] (SPARK-34111) Deconflict the jars jakarta.servlet-api-4.0.3.jar and javax.servlet-api-3.1.0.jar

2021-01-18 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34111?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-34111: - Fix Version/s: (was: 3.1.0) 3.1.2 > Deconflict the jars

[jira] [Resolved] (SPARK-34111) Deconflict the jars jakarta.servlet-api-4.0.3.jar and javax.servlet-api-3.1.0.jar

2021-01-18 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34111?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-34111. -- Fix Version/s: (was: 3.1.2) 3.1.0 Resolution: Fixed Issue

[jira] [Updated] (SPARK-34111) Deconflict the jars jakarta.servlet-api-4.0.3.jar and javax.servlet-api-3.1.0.jar

2021-01-18 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34111?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-34111: - Fix Version/s: 3.1.2 > Deconflict the jars jakarta.servlet-api-4.0.3.jar and >

[jira] [Updated] (SPARK-34111) Deconflict the jars jakarta.servlet-api-4.0.3.jar and javax.servlet-api-3.1.0.jar

2021-01-18 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34111?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-34111: - Target Version/s: (was: 3.1.1) > Deconflict the jars jakarta.servlet-api-4.0.3.jar and >

[jira] [Commented] (SPARK-34152) CreateViewStatement.child should be a real child

2021-01-18 Thread Juliusz Sompolski (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34152?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17267166#comment-17267166 ] Juliusz Sompolski commented on SPARK-34152: --- Same applies to AlterViewStatement. >

[jira] [Comment Edited] (SPARK-34115) Long runtime on many environment variables

2021-01-18 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34115?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17267161#comment-17267161 ] Hyukjin Kwon edited comment on SPARK-34115 at 1/18/21, 10:42 AM: - I see,

[jira] [Commented] (SPARK-34115) Long runtime on many environment variables

2021-01-18 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34115?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17267163#comment-17267163 ] Hyukjin Kwon commented on SPARK-34115: -- Let's see if tests pass first. and we can also get some

[jira] [Comment Edited] (SPARK-34115) Long runtime on many environment variables

2021-01-18 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34115?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17267163#comment-17267163 ] Hyukjin Kwon edited comment on SPARK-34115 at 1/18/21, 10:42 AM: - Let's

[jira] [Commented] (SPARK-34115) Long runtime on many environment variables

2021-01-18 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34115?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17267161#comment-17267161 ] Hyukjin Kwon commented on SPARK-34115: -- I see, okay. That makes sense. Can you try to open a PR?

[jira] [Assigned] (SPARK-34150) Strip Null literal.sql in resolve alias

2021-01-18 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34150?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34150: Assignee: (was: Apache Spark) > Strip Null literal.sql in resolve alias >

[jira] [Commented] (SPARK-34150) Strip Null literal.sql in resolve alias

2021-01-18 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34150?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17267137#comment-17267137 ] Apache Spark commented on SPARK-34150: -- User 'ulysses-you' has created a pull request for this

[jira] [Assigned] (SPARK-34150) Strip Null literal.sql in resolve alias

2021-01-18 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34150?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34150: Assignee: Apache Spark > Strip Null literal.sql in resolve alias >

[jira] [Created] (SPARK-34152) CreateViewStatement.child should be a real child

2021-01-18 Thread Wenchen Fan (Jira)
Wenchen Fan created SPARK-34152: --- Summary: CreateViewStatement.child should be a real child Key: SPARK-34152 URL: https://issues.apache.org/jira/browse/SPARK-34152 Project: Spark Issue Type:

[jira] [Commented] (SPARK-34152) CreateViewStatement.child should be a real child

2021-01-18 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34152?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17267132#comment-17267132 ] Wenchen Fan commented on SPARK-34152: - Hi [~imback82] , do you want to make a try? >

[jira] [Commented] (SPARK-27733) Upgrade to Avro 1.10.1

2021-01-18 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-27733?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17267129#comment-17267129 ] Apache Spark commented on SPARK-27733: -- User 'iemejia' has created a pull request for this issue:

[jira] [Commented] (SPARK-34115) Long runtime on many environment variables

2021-01-18 Thread Norbert Schultz (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34115?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17267126#comment-17267126 ] Norbert Schultz commented on SPARK-34115: - Just tried it {code:java} diff --git

[jira] [Resolved] (SPARK-32331) Keep advanced statistics when pruning partitions

2021-01-18 Thread Peter Toth (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32331?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Toth resolved SPARK-32331. Resolution: Duplicate > Keep advanced statistics when pruning partitions >

[jira] [Commented] (SPARK-34087) a memory leak occurs when we clone the spark session

2021-01-18 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34087?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17267091#comment-17267091 ] Apache Spark commented on SPARK-34087: -- User 'cfmcgrady' has created a pull request for this issue:

[jira] [Updated] (SPARK-34150) Strip Null literal.sql in resolve alias

2021-01-18 Thread ulysses you (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34150?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ulysses you updated SPARK-34150: Description: We will convert `Literal(null)` to target data type during analysis. Then the

[jira] [Assigned] (SPARK-34151) Replaces `java.io.FIle.toURL` with `java.io.File.toURI.toURL`

2021-01-18 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34151?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34151: Assignee: (was: Apache Spark) > Replaces `java.io.FIle.toURL` with

[jira] [Assigned] (SPARK-34151) Replaces `java.io.FIle.toURL` with `java.io.File.toURI.toURL`

2021-01-18 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34151?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34151: Assignee: Apache Spark > Replaces `java.io.FIle.toURL` with `java.io.File.toURI.toURL` >

[jira] [Commented] (SPARK-34151) Replaces `java.io.FIle.toURL` with `java.io.File.toURI.toURL`

2021-01-18 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34151?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17267085#comment-17267085 ] Apache Spark commented on SPARK-34151: -- User 'LuciferYang' has created a pull request for this

[jira] [Created] (SPARK-34151) Replaces `java.io.FIle.toURL` with `java.io.File.toURI.toURL`

2021-01-18 Thread Yang Jie (Jira)
Yang Jie created SPARK-34151: Summary: Replaces `java.io.FIle.toURL` with `java.io.File.toURI.toURL` Key: SPARK-34151 URL: https://issues.apache.org/jira/browse/SPARK-34151 Project: Spark Issue

[jira] [Assigned] (SPARK-34149) DSv2: `ALTER TABLE .. ADD PARTITION` does not refresh table cache

2021-01-18 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34149?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34149: Assignee: Apache Spark > DSv2: `ALTER TABLE .. ADD PARTITION` does not refresh table

[jira] [Assigned] (SPARK-34149) DSv2: `ALTER TABLE .. ADD PARTITION` does not refresh table cache

2021-01-18 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34149?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34149: Assignee: (was: Apache Spark) > DSv2: `ALTER TABLE .. ADD PARTITION` does not

[jira] [Commented] (SPARK-34149) DSv2: `ALTER TABLE .. ADD PARTITION` does not refresh table cache

2021-01-18 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34149?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17267064#comment-17267064 ] Apache Spark commented on SPARK-34149: -- User 'MaxGekk' has created a pull request for this issue:

[jira] [Commented] (SPARK-33541) Group exception messages in catalyst/expressions

2021-01-18 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33541?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17267061#comment-17267061 ] Apache Spark commented on SPARK-33541: -- User 'beliefer' has created a pull request for this issue:

[jira] [Commented] (SPARK-33541) Group exception messages in catalyst/expressions

2021-01-18 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33541?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17267060#comment-17267060 ] Apache Spark commented on SPARK-33541: -- User 'beliefer' has created a pull request for this issue: