[jira] [Created] (SPARK-34312) Support partition truncation by `SupportsPartitionManagement`

2021-02-01 Thread Maxim Gekk (Jira)
Maxim Gekk created SPARK-34312: -- Summary: Support partition truncation by `SupportsPartitionManagement` Key: SPARK-34312 URL: https://issues.apache.org/jira/browse/SPARK-34312 Project: Spark Is

[jira] [Commented] (SPARK-34161) Check re-caching of v2 table dependents after table altering

2021-01-31 Thread Maxim Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34161?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17275958#comment-17275958 ] Maxim Gekk commented on SPARK-34161: This was resolved by https://github.com/apache/

[jira] [Commented] (SPARK-29391) Default year-month units

2021-01-31 Thread Maxim Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29391?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17275933#comment-17275933 ] Maxim Gekk commented on SPARK-29391: For now, I am not sure that we are still going

[jira] [Updated] (SPARK-34303) Migrate ALTER TABLE ... SET LOCATION to new resolution framework

2021-01-31 Thread Maxim Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34303?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maxim Gekk updated SPARK-34303: --- Description: # Create the Command logical node for ALTER TABLE ... SET LOCATION # Remove AlterTableS

[jira] [Updated] (SPARK-34302) Migrate ALTER TABLE .. CHANGE COLUMN to new resolution framework

2021-01-31 Thread Maxim Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34302?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maxim Gekk updated SPARK-34302: --- Description: # Create the Command logical node for ALTER TABLE .. CHANGE COLUMN # Remove AlterTableA

[jira] [Created] (SPARK-34305) Unify v1 and v2 ALTER TABLE .. SET SERDE tests

2021-01-31 Thread Maxim Gekk (Jira)
Maxim Gekk created SPARK-34305: -- Summary: Unify v1 and v2 ALTER TABLE .. SET SERDE tests Key: SPARK-34305 URL: https://issues.apache.org/jira/browse/SPARK-34305 Project: Spark Issue Type: Sub-ta

[jira] [Updated] (SPARK-34305) Unify v1 and v2 ALTER TABLE .. SET SERDE tests

2021-01-31 Thread Maxim Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34305?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maxim Gekk updated SPARK-34305: --- Description: Extract ALTER TABLE .. SET SERDE tests to the common place to run them for V1 and v2 da

[jira] [Created] (SPARK-34304) Remove view checks in v1 alter table commands

2021-01-31 Thread Maxim Gekk (Jira)
Maxim Gekk created SPARK-34304: -- Summary: Remove view checks in v1 alter table commands Key: SPARK-34304 URL: https://issues.apache.org/jira/browse/SPARK-34304 Project: Spark Issue Type: Sub-tas

[jira] [Created] (SPARK-34303) Migrate ALTER TABLE ... SET LOCATION to new resolution framework

2021-01-31 Thread Maxim Gekk (Jira)
Maxim Gekk created SPARK-34303: -- Summary: Migrate ALTER TABLE ... SET LOCATION to new resolution framework Key: SPARK-34303 URL: https://issues.apache.org/jira/browse/SPARK-34303 Project: Spark

[jira] [Updated] (SPARK-34303) Migrate ALTER TABLE ... SET LOCATION to new resolution framework

2021-01-31 Thread Maxim Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34303?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maxim Gekk updated SPARK-34303: --- Description: # Create the Command logical node for ALTER TABLE ... SET LOCATION # Remove AlterTableS

[jira] [Updated] (SPARK-34302) Migrate ALTER TABLE .. CHANGE COLUMN to new resolution framework

2021-01-31 Thread Maxim Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34302?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maxim Gekk updated SPARK-34302: --- Description: # Create the Command logical node for ALTER TABLE .. CHANGE COLUMN # Remove AlterTableA

[jira] [Created] (SPARK-34302) Migrate ALTER TABLE .. CHANGE COLUMN to new resolution framework

2021-01-31 Thread Maxim Gekk (Jira)
Maxim Gekk created SPARK-34302: -- Summary: Migrate ALTER TABLE .. CHANGE COLUMN to new resolution framework Key: SPARK-34302 URL: https://issues.apache.org/jira/browse/SPARK-34302 Project: Spark

[jira] [Created] (SPARK-34301) Use logical plan of alter table in `CatalogImpl.recoverPartitions()`

2021-01-31 Thread Maxim Gekk (Jira)
Maxim Gekk created SPARK-34301: -- Summary: Use logical plan of alter table in `CatalogImpl.recoverPartitions()` Key: SPARK-34301 URL: https://issues.apache.org/jira/browse/SPARK-34301 Project: Spark

[jira] [Commented] (SPARK-34290) Support v2 TRUNCATE TABLE

2021-01-29 Thread Maxim Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34290?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17274247#comment-17274247 ] Maxim Gekk commented on SPARK-34290: I am working on this. > Support v2 TRUNCATE TA

[jira] [Created] (SPARK-34290) Support v2 TRUNCATE TABLE

2021-01-29 Thread Maxim Gekk (Jira)
Maxim Gekk created SPARK-34290: -- Summary: Support v2 TRUNCATE TABLE Key: SPARK-34290 URL: https://issues.apache.org/jira/browse/SPARK-34290 Project: Spark Issue Type: Sub-task Componen

[jira] [Updated] (SPARK-34282) Unify v1 and v2 TRUNCATE TABLE tests

2021-01-28 Thread Maxim Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34282?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maxim Gekk updated SPARK-34282: --- Description: Extract TRUNCATE TABLE tests to the common place to run them for V1 and v2 datasources.

[jira] [Created] (SPARK-34282) Unify v1 and v2 TRUNCATE TABLE tests

2021-01-28 Thread Maxim Gekk (Jira)
Maxim Gekk created SPARK-34282: -- Summary: Unify v1 and v2 TRUNCATE TABLE tests Key: SPARK-34282 URL: https://issues.apache.org/jira/browse/SPARK-34282 Project: Spark Issue Type: Sub-task

[jira] [Updated] (SPARK-34267) Remove `refreshTable()` from `SessionState`

2021-01-27 Thread Maxim Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34267?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maxim Gekk updated SPARK-34267: --- Description: Spark already has `SessionCatalog.refreshTable` and `CatalogImpl.refreshTable`. One mor

[jira] [Created] (SPARK-34267) Remove `refreshTable()` from `SessionState`

2021-01-27 Thread Maxim Gekk (Jira)
Maxim Gekk created SPARK-34267: -- Summary: Remove `refreshTable()` from `SessionState` Key: SPARK-34267 URL: https://issues.apache.org/jira/browse/SPARK-34267 Project: Spark Issue Type: Sub-task

[jira] [Created] (SPARK-34266) Update comments for `SessionCatalog.refreshTable()` and `CatalogImpl.refreshTable()`

2021-01-27 Thread Maxim Gekk (Jira)
Maxim Gekk created SPARK-34266: -- Summary: Update comments for `SessionCatalog.refreshTable()` and `CatalogImpl.refreshTable()` Key: SPARK-34266 URL: https://issues.apache.org/jira/browse/SPARK-34266 Proj

[jira] [Updated] (SPARK-34262) ALTER TABLE .. SET LOCATION doesn't refresh v1 table cache

2021-01-27 Thread Maxim Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34262?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maxim Gekk updated SPARK-34262: --- Description: The example below portraits the issue: 1. Create a source table: {code:sql} spark-sql>

[jira] [Created] (SPARK-34262) ALTER TABLE .. SET LOCATION doesn't refresh v1 table cache

2021-01-27 Thread Maxim Gekk (Jira)
Maxim Gekk created SPARK-34262: -- Summary: ALTER TABLE .. SET LOCATION doesn't refresh v1 table cache Key: SPARK-34262 URL: https://issues.apache.org/jira/browse/SPARK-34262 Project: Spark Issue

[jira] [Created] (SPARK-34251) TRUNCATE TABLE resets stats for non-empty v1 table

2021-01-26 Thread Maxim Gekk (Jira)
Maxim Gekk created SPARK-34251: -- Summary: TRUNCATE TABLE resets stats for non-empty v1 table Key: SPARK-34251 URL: https://issues.apache.org/jira/browse/SPARK-34251 Project: Spark Issue Type: Bu

[jira] [Commented] (SPARK-34251) TRUNCATE TABLE resets stats for non-empty v1 table

2021-01-26 Thread Maxim Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34251?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17272231#comment-17272231 ] Maxim Gekk commented on SPARK-34251: I am working on bug fix. > TRUNCATE TABLE rese

[jira] [Created] (SPARK-34215) Keep table cached after truncation

2021-01-24 Thread Maxim Gekk (Jira)
Maxim Gekk created SPARK-34215: -- Summary: Keep table cached after truncation Key: SPARK-34215 URL: https://issues.apache.org/jira/browse/SPARK-34215 Project: Spark Issue Type: Sub-task

[jira] [Created] (SPARK-34213) LOAD DATA doesn't refresh v1 table cache

2021-01-23 Thread Maxim Gekk (Jira)
Maxim Gekk created SPARK-34213: -- Summary: LOAD DATA doesn't refresh v1 table cache Key: SPARK-34213 URL: https://issues.apache.org/jira/browse/SPARK-34213 Project: Spark Issue Type: Sub-task

[jira] [Commented] (SPARK-34213) LOAD DATA doesn't refresh v1 table cache

2021-01-23 Thread Maxim Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34213?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17270722#comment-17270722 ] Maxim Gekk commented on SPARK-34213: I am working on the issue. > LOAD DATA doesn't

[jira] [Updated] (SPARK-34207) Rename `isTemporaryTable` to `isTempView` in `SessionCatalog`

2021-01-22 Thread Maxim Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34207?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maxim Gekk updated SPARK-34207: --- Priority: Trivial (was: Major) > Rename `isTemporaryTable` to `isTempView` in `SessionCatalog` > --

[jira] [Created] (SPARK-34207) Rename `isTemporaryTable` to `isTempView` in `SessionCatalog`

2021-01-22 Thread Maxim Gekk (Jira)
Maxim Gekk created SPARK-34207: -- Summary: Rename `isTemporaryTable` to `isTempView` in `SessionCatalog` Key: SPARK-34207 URL: https://issues.apache.org/jira/browse/SPARK-34207 Project: Spark Is

[jira] [Created] (SPARK-34197) refreshTable() should not invalidate the relation cache for temporary views

2021-01-21 Thread Maxim Gekk (Jira)
Maxim Gekk created SPARK-34197: -- Summary: refreshTable() should not invalidate the relation cache for temporary views Key: SPARK-34197 URL: https://issues.apache.org/jira/browse/SPARK-34197 Project: Spar

[jira] [Updated] (SPARK-34161) Check re-caching of v2 table dependents after table altering

2021-01-19 Thread Maxim Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34161?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maxim Gekk updated SPARK-34161: --- Description: Add tests to unified test suites and check that dependants of v2 table are still cached

[jira] [Created] (SPARK-34161) Check re-caching of v2 table dependents after table altering

2021-01-19 Thread Maxim Gekk (Jira)
Maxim Gekk created SPARK-34161: -- Summary: Check re-caching of v2 table dependents after table altering Key: SPARK-34161 URL: https://issues.apache.org/jira/browse/SPARK-34161 Project: Spark Iss

[jira] [Created] (SPARK-34153) Remove unused `getRawTable()` from `HiveExternalCatalog.alterPartitions()`

2021-01-18 Thread Maxim Gekk (Jira)
Maxim Gekk created SPARK-34153: -- Summary: Remove unused `getRawTable()` from `HiveExternalCatalog.alterPartitions()` Key: SPARK-34153 URL: https://issues.apache.org/jira/browse/SPARK-34153 Project: Spark

[jira] [Updated] (SPARK-34149) DSv2: `ALTER TABLE .. ADD PARTITION` does not refresh table cache

2021-01-17 Thread Maxim Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34149?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maxim Gekk updated SPARK-34149: --- Description: For example, the test below: {code:scala} test("SPARK-X: refresh cache in partiti

[jira] [Created] (SPARK-34149) DSv2: `ALTER TABLE .. ADD PARTITION` does not refresh table cache

2021-01-17 Thread Maxim Gekk (Jira)
Maxim Gekk created SPARK-34149: -- Summary: DSv2: `ALTER TABLE .. ADD PARTITION` does not refresh table cache Key: SPARK-34149 URL: https://issues.apache.org/jira/browse/SPARK-34149 Project: Spark

[jira] [Created] (SPARK-34143) Adding partitions to fully partitioned v2 table

2021-01-17 Thread Maxim Gekk (Jira)
Maxim Gekk created SPARK-34143: -- Summary: Adding partitions to fully partitioned v2 table Key: SPARK-34143 URL: https://issues.apache.org/jira/browse/SPARK-34143 Project: Spark Issue Type: Bug

[jira] [Created] (SPARK-34138) Keep dependants cached while refreshing v1 tables

2021-01-16 Thread Maxim Gekk (Jira)
Maxim Gekk created SPARK-34138: -- Summary: Keep dependants cached while refreshing v1 tables Key: SPARK-34138 URL: https://issues.apache.org/jira/browse/SPARK-34138 Project: Spark Issue Type: Sub

[jira] [Created] (SPARK-34099) Refactor table caching in `DataSourceV2Strategy`

2021-01-13 Thread Maxim Gekk (Jira)
Maxim Gekk created SPARK-34099: -- Summary: Refactor table caching in `DataSourceV2Strategy` Key: SPARK-34099 URL: https://issues.apache.org/jira/browse/SPARK-34099 Project: Spark Issue Type: Impr

[jira] [Resolved] (SPARK-34062) Call updateTableStats() from AlterTableAddPartitionCommand

2021-01-13 Thread Maxim Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34062?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maxim Gekk resolved SPARK-34062. Resolution: Won't Do > Call updateTableStats() from AlterTableAddPartitionCommand > --

[jira] [Created] (SPARK-34084) ALTER TABLE .. ADD PARTITION does not update table stats

2021-01-12 Thread Maxim Gekk (Jira)
Maxim Gekk created SPARK-34084: -- Summary: ALTER TABLE .. ADD PARTITION does not update table stats Key: SPARK-34084 URL: https://issues.apache.org/jira/browse/SPARK-34084 Project: Spark Issue Ty

[jira] [Created] (SPARK-34074) Update stats when table size changes

2021-01-11 Thread Maxim Gekk (Jira)
Maxim Gekk created SPARK-34074: -- Summary: Update stats when table size changes Key: SPARK-34074 URL: https://issues.apache.org/jira/browse/SPARK-34074 Project: Spark Issue Type: Improvement

[jira] [Updated] (SPARK-34071) Check stats of cached table after altering

2021-01-11 Thread Maxim Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34071?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maxim Gekk updated SPARK-34071: --- Description: 1. Port the test added by https://github.com/apache/spark/pull/31112 for `ALTER TABLE

[jira] [Created] (SPARK-34071) Check stats of cached table after altering

2021-01-11 Thread Maxim Gekk (Jira)
Maxim Gekk created SPARK-34071: -- Summary: Check stats of cached table after altering Key: SPARK-34071 URL: https://issues.apache.org/jira/browse/SPARK-34071 Project: Spark Issue Type: Sub-task

[jira] [Updated] (SPARK-33950) ALTER TABLE .. DROP PARTITION doesn't refresh cache

2021-01-11 Thread Maxim Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33950?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maxim Gekk updated SPARK-33950: --- Parent: SPARK-33507 Issue Type: Sub-task (was: Bug) > ALTER TABLE .. DROP PARTITION doesn't

[jira] [Updated] (SPARK-33941) ALTER TABLE .. DROP PARTITION doesn't invalidate the cache

2021-01-11 Thread Maxim Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33941?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maxim Gekk updated SPARK-33941: --- Parent: SPARK-33507 Issue Type: Sub-task (was: Bug) > ALTER TABLE .. DROP PARTITION doesn't

[jira] [Updated] (SPARK-33963) `isCached` return `false` for cached Hive table

2021-01-11 Thread Maxim Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33963?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maxim Gekk updated SPARK-33963: --- Parent: SPARK-33507 Issue Type: Sub-task (was: Bug) > `isCached` return `false` for cached

[jira] [Updated] (SPARK-34011) ALTER TABLE .. RENAME TO PARTITION doesn't refresh cache

2021-01-11 Thread Maxim Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34011?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maxim Gekk updated SPARK-34011: --- Parent: SPARK-33507 Issue Type: Sub-task (was: Bug) > ALTER TABLE .. RENAME TO PARTITION do

[jira] [Updated] (SPARK-34027) ALTER TABLE .. RECOVER PARTITIONS doesn't refresh cache

2021-01-11 Thread Maxim Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34027?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maxim Gekk updated SPARK-34027: --- Parent: SPARK-33507 Issue Type: Sub-task (was: Bug) > ALTER TABLE .. RECOVER PARTITIONS doe

[jira] [Updated] (SPARK-34055) ALTER TABLE .. ADD PARTITION doesn't refresh cache

2021-01-11 Thread Maxim Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34055?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maxim Gekk updated SPARK-34055: --- Parent: SPARK-33507 Issue Type: Sub-task (was: Bug) > ALTER TABLE .. ADD PARTITION doesn't

[jira] [Updated] (SPARK-34060) ALTER TABLE .. DROP PARTITION uncaches Hive table while updating table stats

2021-01-11 Thread Maxim Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34060?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maxim Gekk updated SPARK-34060: --- Parent: SPARK-33507 Issue Type: Sub-task (was: Bug) > ALTER TABLE .. DROP PARTITION uncache

[jira] [Updated] (SPARK-34062) Call updateTableStats() from AlterTableAddPartitionCommand

2021-01-11 Thread Maxim Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34062?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maxim Gekk updated SPARK-34062: --- Parent: SPARK-33507 Issue Type: Sub-task (was: Improvement) > Call updateTableStats() from

[jira] [Created] (SPARK-34062) Call updateTableStats() from AlterTableAddPartitionCommand

2021-01-10 Thread Maxim Gekk (Jira)
Maxim Gekk created SPARK-34062: -- Summary: Call updateTableStats() from AlterTableAddPartitionCommand Key: SPARK-34062 URL: https://issues.apache.org/jira/browse/SPARK-34062 Project: Spark Issue

[jira] [Created] (SPARK-34060) ALTER TABLE .. DROP PARTITION uncaches Hive table while updating table stats

2021-01-10 Thread Maxim Gekk (Jira)
Maxim Gekk created SPARK-34060: -- Summary: ALTER TABLE .. DROP PARTITION uncaches Hive table while updating table stats Key: SPARK-34060 URL: https://issues.apache.org/jira/browse/SPARK-34060 Project: Spa

[jira] [Updated] (SPARK-34056) Unify v1 and v2 ALTER TABLE .. RECOVER PARTITIONS tests

2021-01-09 Thread Maxim Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34056?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maxim Gekk updated SPARK-34056: --- Description: Extract ALTER TABLE .. RECOVER PARTITIONS tests to the common place to run them for V1

[jira] [Created] (SPARK-34056) Unify v1 and v2 ALTER TABLE .. RECOVER PARTITIONS tests

2021-01-09 Thread Maxim Gekk (Jira)
Maxim Gekk created SPARK-34056: -- Summary: Unify v1 and v2 ALTER TABLE .. RECOVER PARTITIONS tests Key: SPARK-34056 URL: https://issues.apache.org/jira/browse/SPARK-34056 Project: Spark Issue Typ

[jira] [Updated] (SPARK-34055) ALTER TABLE .. ADD PARTITION doesn't refresh cache

2021-01-08 Thread Maxim Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34055?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maxim Gekk updated SPARK-34055: --- Description: Here is the example to reproduce the issue: {code:sql} spark-sql> create table tbl2 (co

[jira] [Created] (SPARK-34055) ALTER TABLE .. ADD PARTITION doesn't refresh cache

2021-01-08 Thread Maxim Gekk (Jira)
Maxim Gekk created SPARK-34055: -- Summary: ALTER TABLE .. ADD PARTITION doesn't refresh cache Key: SPARK-34055 URL: https://issues.apache.org/jira/browse/SPARK-34055 Project: Spark Issue Type: Bu

[jira] [Created] (SPARK-34048) Check the amount of calls to Hive external catalog

2021-01-08 Thread Maxim Gekk (Jira)
Maxim Gekk created SPARK-34048: -- Summary: Check the amount of calls to Hive external catalog Key: SPARK-34048 URL: https://issues.apache.org/jira/browse/SPARK-34048 Project: Spark Issue Type: Su

[jira] [Updated] (SPARK-34027) ALTER TABLE .. RECOVER PARTITIONS doesn't refresh cache

2021-01-06 Thread Maxim Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34027?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maxim Gekk updated SPARK-34027: --- Description: Here is the example to reproduce the issue: {code:sql} spark-sql> create table tbl (col

[jira] [Updated] (SPARK-34027) ALTER TABLE .. RECOVER PARTITIONS doesn't refresh cache

2021-01-06 Thread Maxim Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34027?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maxim Gekk updated SPARK-34027: --- Description: Here is the example to reproduce the issue: {code:sql} spark-sql> create table tbl (col

[jira] [Created] (SPARK-34027) ALTER TABLE .. RECOVER PARTITIONS doesn't refresh cache

2021-01-06 Thread Maxim Gekk (Jira)
Maxim Gekk created SPARK-34027: -- Summary: ALTER TABLE .. RECOVER PARTITIONS doesn't refresh cache Key: SPARK-34027 URL: https://issues.apache.org/jira/browse/SPARK-34027 Project: Spark Issue Typ

[jira] [Issue Comment Deleted] (SPARK-34011) ALTER TABLE .. RENAME TO PARTITION doesn't refresh cache

2021-01-05 Thread Maxim Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34011?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maxim Gekk updated SPARK-34011: --- Comment: was deleted (was: I am working on the issue.) > ALTER TABLE .. RENAME TO PARTITION doesn't

[jira] [Created] (SPARK-34011) ALTER TABLE .. RENAME TO PARTITION doesn't refresh cache

2021-01-05 Thread Maxim Gekk (Jira)
Maxim Gekk created SPARK-34011: -- Summary: ALTER TABLE .. RENAME TO PARTITION doesn't refresh cache Key: SPARK-34011 URL: https://issues.apache.org/jira/browse/SPARK-34011 Project: Spark Issue Ty

[jira] [Commented] (SPARK-34011) ALTER TABLE .. RENAME TO PARTITION doesn't refresh cache

2021-01-05 Thread Maxim Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34011?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17258818#comment-17258818 ] Maxim Gekk commented on SPARK-34011: I am working on the issue. > ALTER TABLE .. RE

[jira] [Updated] (SPARK-34011) ALTER TABLE .. RENAME TO PARTITION doesn't refresh cache

2021-01-05 Thread Maxim Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34011?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maxim Gekk updated SPARK-34011: --- Description: Here is the example to reproduce the issue: {code:sql} spark-sql> CREATE TABLE tbl1 (co

[jira] [Commented] (SPARK-33995) Make datetime addition easier for years, weeks, hours, minutes, and seconds

2021-01-04 Thread Maxim Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33995?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17258718#comment-17258718 ] Maxim Gekk commented on SPARK-33995: > Option 1: Single make_interval function that

[jira] [Created] (SPARK-33990) v2 ALTER TABLE .. DROP PARTITION does not remove data from dropped partition

2021-01-04 Thread Maxim Gekk (Jira)
Maxim Gekk created SPARK-33990: -- Summary: v2 ALTER TABLE .. DROP PARTITION does not remove data from dropped partition Key: SPARK-33990 URL: https://issues.apache.org/jira/browse/SPARK-33990 Project: Spa

[jira] [Commented] (SPARK-33990) v2 ALTER TABLE .. DROP PARTITION does not remove data from dropped partition

2021-01-04 Thread Maxim Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33990?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17258183#comment-17258183 ] Maxim Gekk commented on SPARK-33990: I am working on the issue. > v2 ALTER TABLE ..

[jira] [Commented] (SPARK-33987) v2 ALTER TABLE .. DROP PARTITION does not refresh cached table

2021-01-04 Thread Maxim Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33987?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17258179#comment-17258179 ] Maxim Gekk commented on SPARK-33987: I am working on this > v2 ALTER TABLE .. DROP

[jira] [Created] (SPARK-33987) v2 ALTER TABLE .. DROP PARTITION does not refresh cached table

2021-01-04 Thread Maxim Gekk (Jira)
Maxim Gekk created SPARK-33987: -- Summary: v2 ALTER TABLE .. DROP PARTITION does not refresh cached table Key: SPARK-33987 URL: https://issues.apache.org/jira/browse/SPARK-33987 Project: Spark I

[jira] [Created] (SPARK-33965) CACHE TABLE does not support `spark_catalog` in Hive table names

2021-01-03 Thread Maxim Gekk (Jira)
Maxim Gekk created SPARK-33965: -- Summary: CACHE TABLE does not support `spark_catalog` in Hive table names Key: SPARK-33965 URL: https://issues.apache.org/jira/browse/SPARK-33965 Project: Spark

[jira] [Commented] (SPARK-33963) `isCached` return `false` for cached Hive table

2021-01-02 Thread Maxim Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33963?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17257483#comment-17257483 ] Maxim Gekk commented on SPARK-33963: I am working on a bug fix. > `isCached` return

[jira] [Created] (SPARK-33963) `isCached` return `false` for cached Hive table

2021-01-02 Thread Maxim Gekk (Jira)
Maxim Gekk created SPARK-33963: -- Summary: `isCached` return `false` for cached Hive table Key: SPARK-33963 URL: https://issues.apache.org/jira/browse/SPARK-33963 Project: Spark Issue Type: Bug

[jira] [Created] (SPARK-33950) ALTER TABLE .. DROP PARTITION doesn't refresh cache

2020-12-31 Thread Maxim Gekk (Jira)
Maxim Gekk created SPARK-33950: -- Summary: ALTER TABLE .. DROP PARTITION doesn't refresh cache Key: SPARK-33950 URL: https://issues.apache.org/jira/browse/SPARK-33950 Project: Spark Issue Type: B

[jira] [Updated] (SPARK-33941) ALTER TABLE .. DROP PARTITION doesn't invalidate the cache

2020-12-30 Thread Maxim Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33941?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maxim Gekk updated SPARK-33941: --- Affects Version/s: 2.4.7 > ALTER TABLE .. DROP PARTITION doesn't invalidate the cache >

[jira] [Commented] (SPARK-33941) ALTER TABLE .. DROP PARTITION doesn't invalidate the cache

2020-12-30 Thread Maxim Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33941?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17256403#comment-17256403 ] Maxim Gekk commented on SPARK-33941: I am working on a bug fix. > ALTER TABLE .. DR

[jira] [Created] (SPARK-33941) ALTER TABLE .. DROP PARTITION doesn't invalidate the cache

2020-12-30 Thread Maxim Gekk (Jira)
Maxim Gekk created SPARK-33941: -- Summary: ALTER TABLE .. DROP PARTITION doesn't invalidate the cache Key: SPARK-33941 URL: https://issues.apache.org/jira/browse/SPARK-33941 Project: Spark Issue

[jira] [Created] (SPARK-33936) Add the version when connector methods and interfaces were added

2020-12-29 Thread Maxim Gekk (Jira)
Maxim Gekk created SPARK-33936: -- Summary: Add the version when connector methods and interfaces were added Key: SPARK-33936 URL: https://issues.apache.org/jira/browse/SPARK-33936 Project: Spark

[jira] [Created] (SPARK-33926) Improve the error message in resolving of DSv1 multi-part identifiers

2020-12-28 Thread Maxim Gekk (Jira)
Maxim Gekk created SPARK-33926: -- Summary: Improve the error message in resolving of DSv1 multi-part identifiers Key: SPARK-33926 URL: https://issues.apache.org/jira/browse/SPARK-33926 Project: Spark

[jira] [Created] (SPARK-33924) v2 INSERT INTO .. PARTITION drops the partition location

2020-12-28 Thread Maxim Gekk (Jira)
Maxim Gekk created SPARK-33924: -- Summary: v2 INSERT INTO .. PARTITION drops the partition location Key: SPARK-33924 URL: https://issues.apache.org/jira/browse/SPARK-33924 Project: Spark Issue Ty

[jira] [Created] (SPARK-33919) Unify v1 and v2 SHOW NAMESPACES tests

2020-12-26 Thread Maxim Gekk (Jira)
Maxim Gekk created SPARK-33919: -- Summary: Unify v1 and v2 SHOW NAMESPACES tests Key: SPARK-33919 URL: https://issues.apache.org/jira/browse/SPARK-33919 Project: Spark Issue Type: Sub-task

[jira] [Created] (SPARK-33914) Describe the structure of unified v1 and v2 tests

2020-12-25 Thread Maxim Gekk (Jira)
Maxim Gekk created SPARK-33914: -- Summary: Describe the structure of unified v1 and v2 tests Key: SPARK-33914 URL: https://issues.apache.org/jira/browse/SPARK-33914 Project: Spark Issue Type: Sub

[jira] [Commented] (SPARK-33804) Cleanup "view bounds are deprecated" compilation warnings

2020-12-25 Thread Maxim Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33804?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17254767#comment-17254767 ] Maxim Gekk commented on SPARK-33804: [~LuciferYang] Could you convert this (and your

[jira] [Updated] (SPARK-33911) Update SQL migration guide about changes in HiveClientImpl

2020-12-24 Thread Maxim Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33911?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maxim Gekk updated SPARK-33911: --- Affects Version/s: 3.0.2 > Update SQL migration guide about changes in HiveClientImpl >

[jira] [Updated] (SPARK-33911) Update SQL migration guide about changes in HiveClientImpl

2020-12-24 Thread Maxim Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33911?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maxim Gekk updated SPARK-33911: --- Affects Version/s: 2.4.8 > Update SQL migration guide about changes in HiveClientImpl >

[jira] [Updated] (SPARK-33911) Update SQL migration guide about changes in HiveClientImpl

2020-12-24 Thread Maxim Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33911?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maxim Gekk updated SPARK-33911: --- Affects Version/s: 3.1.0 > Update SQL migration guide about changes in HiveClientImpl >

[jira] [Updated] (SPARK-33911) Update SQL migration guide about changes in HiveClientImpl

2020-12-24 Thread Maxim Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33911?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maxim Gekk updated SPARK-33911: --- Affects Version/s: (was: 2.4.8) (was: 3.1.0) > Update SQL migration g

[jira] [Created] (SPARK-33911) Update SQL migration guide about changes in HiveClientImpl

2020-12-24 Thread Maxim Gekk (Jira)
Maxim Gekk created SPARK-33911: -- Summary: Update SQL migration guide about changes in HiveClientImpl Key: SPARK-33911 URL: https://issues.apache.org/jira/browse/SPARK-33911 Project: Spark Issue

[jira] [Resolved] (SPARK-33830) Describe the PURGE option of ALTER TABLE .. DROP PARTITION

2020-12-24 Thread Maxim Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33830?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maxim Gekk resolved SPARK-33830. Resolution: Won't Fix > Describe the PURGE option of ALTER TABLE .. DROP PARTITION > -

[jira] [Created] (SPARK-33904) Recognize `spark_catalog` in `saveAsTable()` and `insertInto()`

2020-12-24 Thread Maxim Gekk (Jira)
Maxim Gekk created SPARK-33904: -- Summary: Recognize `spark_catalog` in `saveAsTable()` and `insertInto()` Key: SPARK-33904 URL: https://issues.apache.org/jira/browse/SPARK-33904 Project: Spark

[jira] [Created] (SPARK-33899) v1 SHOW TABLES fails with assert on spark_catalog

2020-12-24 Thread Maxim Gekk (Jira)
Maxim Gekk created SPARK-33899: -- Summary: v1 SHOW TABLES fails with assert on spark_catalog Key: SPARK-33899 URL: https://issues.apache.org/jira/browse/SPARK-33899 Project: Spark Issue Type: Sub

[jira] [Updated] (SPARK-33889) NPE from SHOW PARTITIONS for null partition values

2020-12-23 Thread Maxim Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33889?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maxim Gekk updated SPARK-33889: --- Description: The following test fails with NPE on V2 table: {code:scala} test("null and empty stri

[jira] [Created] (SPARK-33889) NPE from SHOW PARTITIONS for null partition values

2020-12-23 Thread Maxim Gekk (Jira)
Maxim Gekk created SPARK-33889: -- Summary: NPE from SHOW PARTITIONS for null partition values Key: SPARK-33889 URL: https://issues.apache.org/jira/browse/SPARK-33889 Project: Spark Issue Type: Su

[jira] [Created] (SPARK-33881) Check null and empty string as partition values in v1 and v2 tests

2020-12-22 Thread Maxim Gekk (Jira)
Maxim Gekk created SPARK-33881: -- Summary: Check null and empty string as partition values in v1 and v2 tests Key: SPARK-33881 URL: https://issues.apache.org/jira/browse/SPARK-33881 Project: Spark

[jira] [Updated] (SPARK-33787) Support partition purging by `SupportsPartitionManagement`

2020-12-22 Thread Maxim Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33787?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maxim Gekk updated SPARK-33787: --- Description: Add new method `purgePartition` in `SupportsPartitionManagement` and `purgePartitions`

[jira] [Updated] (SPARK-33787) Support partition purging by `SupportsPartitionManagement`

2020-12-22 Thread Maxim Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33787?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maxim Gekk updated SPARK-33787: --- Summary: Support partition purging by `SupportsPartitionManagement` (was: Add `purge` to `dropParti

[jira] [Created] (SPARK-33878) The test "SPARK-33305: DROP TABLE should also invalidate cache" fails for v1 Hive catalog

2020-12-21 Thread Maxim Gekk (Jira)
Maxim Gekk created SPARK-33878: -- Summary: The test "SPARK-33305: DROP TABLE should also invalidate cache" fails for v1 Hive catalog Key: SPARK-33878 URL: https://issues.apache.org/jira/browse/SPARK-33878

[jira] [Commented] (SPARK-33875) Implement DESCRIBE COLUMN for v2 catalog

2020-12-21 Thread Maxim Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33875?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17253291#comment-17253291 ] Maxim Gekk commented on SPARK-33875: [~imback82] Could you convert this to a sub-tas

[jira] [Created] (SPARK-33862) Throw `PartitionAlreadyExistsException` if the target partition exists in Hive v1 Table Catalog

2020-12-20 Thread Maxim Gekk (Jira)
Maxim Gekk created SPARK-33862: -- Summary: Throw `PartitionAlreadyExistsException` if the target partition exists in Hive v1 Table Catalog Key: SPARK-33862 URL: https://issues.apache.org/jira/browse/SPARK-33862

[jira] [Created] (SPARK-33859) Support V2 ALTER TABLE .. RENAME PARTITION

2020-12-20 Thread Maxim Gekk (Jira)
Maxim Gekk created SPARK-33859: -- Summary: Support V2 ALTER TABLE .. RENAME PARTITION Key: SPARK-33859 URL: https://issues.apache.org/jira/browse/SPARK-33859 Project: Spark Issue Type: Sub-task

<    1   2   3   4   5   6   7   8   9   10   >