Adrian Wang created SPARK-46714:
-----------------------------------
Summary: Overwrite partitions with custom location should reset
partition locations
Key: SPARK-46714
URL: https://issues.apache.org/jira/browse/SPARK-46714
Project: Spark
Issue Type: Improvement
Components: SQL
Affects Versions: 3.5.0
Reporter: Adrian Wang
In hive metastore we support partitions to be outside of corresponding table
location.
When overwrite such partition with hive, the overwritten partitions should be
recreated under table location.
Also, currently if a partition is on a different fileystem from the table, when
overwriting spark will throw exception.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
