kerwin-zk opened a new pull request, #7986:
URL: https://github.com/apache/paimon/pull/7986
### Purpose
When `SparkGenericCatalog` is configured as a named catalog, for example:
```sql
spark.sql.catalog.hive_metastore=org.apache.paimon.spark.SparkGenericCatalog
and a non-Paimon Hive table is created through the fallback session
catalog:
CREATE EXTERNAL TABLE hive_metastore.default.test_table (
id INT,
name STRING
)
USING PARQUET
PARTITIONED BY (dt STRING)
LOCATION '...';
ALTER TABLE hive_metastore.default.test_table ADD PARTITION ... fails with:
```
[INVALID_PARTITION_OPERATION.PARTITION_MANAGEMENT_IS_UNSUPPORTED]
Table ... does not support partition management.
This happens because hive_metastore is resolved as a V2 catalog. Spark
returns the fallback Hive table as a V1Table, but V2 partition DDL requires the
loaded table to implement
SupportsPartitionManagement. Unlike spark_catalog, Spark does not rewrite
partition commands for named catalogs through the V1 session catalog command
path.
### Tests
CI
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
