Zhu, Lipeng created SPARK-32541:
-----------------------------------
Summary: MSCK REPAIR TABLE should drop the missing partitions from
metastore
Key: SPARK-32541
URL: https://issues.apache.org/jira/browse/SPARK-32541
Project: Spark
Issue Type: Improvement
Components: SQL
Affects Versions: 3.0.0
Reporter: Zhu, Lipeng
{{msck repair table <tablename>}} alter table <tablename> recover partitions is
often used in environments where the new partitions are loaded as directories
on HDFS and users want to create the missing partitions in bulk. However,
currently it only supports addition of missing partitions. If there are any
partitions which are present in metastore but not on the FileSystem, it should
also delete them so that it truly repairs the table metadata.
In Hive, it already support the grammar `msck repair table drop partitions`.
https://issues.apache.org/jira/browse/HIVE-17824
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
