Taraka Rama Rao Lethavadla created HIVE-27072:
-------------------------------------------------
Summary: create an sql query to validate a given table for
partitions and list out any discrepancies in files/folders, list out empty
files etc
Key: HIVE-27072
URL: https://issues.apache.org/jira/browse/HIVE-27072
Project: Hive
Issue Type: New Feature
Components: HiveServer2
Reporter: Taraka Rama Rao Lethavadla
There are couple of issues when partitions were corrupted or have additional
unwanted files that will intervene query execution and fail.
If we run query like "validate table table_name [partition(partition=a,..)]",
the output should list
* any unwanted files like empty/metadata files(like _SUCCESS etc)
* any unwanted folders not confirming to the partition naming convention like
test_folder where actual partition name looks like test=23
* Too many staging directories, if we find many then cleanup is not happening
properly after query execution
* any file permission related issues like table has one owner, partition has
another owner etc(Optional)
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
