[
https://issues.apache.org/jira/browse/HIVE-18922?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Anant Mittal updated HIVE-18922:
--------------------------------
Description:
Hive is creating hdfs folders with format
<table_location>/.hive-staging_hive_<date>_<time>-xx/-ext-xxxxx
These are not being cleaned up even after long duration. The folder is used to
load to the table. Example:
Loading data to table default.tablename from
hdfs://clustermachine/apps/hive/warehouse/tablename/.hive-staging_hive_2018-01-31_11-45-14_005_1129336997995057804-51/-ext-10000
This might be covered to some extent by HIVE-11940 but, want to make sure all
cases are addressed.
Update: It seems HIVE-11940 did not cover this as the issue is seen in later
versions too.
was:
Hive is creating hdfs folders with format
<table_location>/.hive-staging_hive_<date>_<time>-xx/-ext-xxxxx
These are not being cleaned up even after long duration. The folder is used to
load to the table. Example:
Loading data to table default.tablename from
hdfs://clustermachine/apps/hive/warehouse/tablename/.hive-staging_hive_2018-01-31_11-45-14_005_1129336997995057804-51/-ext-10000
This might be covered to some extent by HIVE-11940 but, want to make sure all
cases are addressed.
> Hive is not cleaning up staging directories
> --------------------------------------------
>
> Key: HIVE-18922
> URL: https://issues.apache.org/jira/browse/HIVE-18922
> Project: Hive
> Issue Type: Bug
> Reporter: Anant Mittal
> Priority: Major
>
> Hive is creating hdfs folders with format
> <table_location>/.hive-staging_hive_<date>_<time>-xx/-ext-xxxxx
> These are not being cleaned up even after long duration. The folder is used
> to load to the table. Example:
> Loading data to table default.tablename from
> hdfs://clustermachine/apps/hive/warehouse/tablename/.hive-staging_hive_2018-01-31_11-45-14_005_1129336997995057804-51/-ext-10000
>
> This might be covered to some extent by HIVE-11940 but, want to make sure all
> cases are addressed.
> Update: It seems HIVE-11940 did not cover this as the issue is seen in later
> versions too.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
