[
https://issues.apache.org/jira/browse/HBASE-26067?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17442796#comment-17442796
]
Duo Zhang edited comment on HBASE-26067 at 11/12/21, 3:02 PM:
--------------------------------------------------------------
It depends on our goal. If the goal here is to remove all the renames, then
yes, HFile archiving is a problem.
But as you said, it is a bit challenging here. With store file tracker, it is
OK for us to leave the HFile there, without the actual 'archive operation'. And
when we reached the TTL, we just delete the HFile directly. But the problem is
as you said, how can we find out the 'archived' HFiles, as in our current
design, the 'archived' HFiles should be placed under the archive directory.
Changing this will need a very big refactoring.
So I think we'd better open another issue for this, and collect more feedbacks
to see if others in the community can have better abstraction and solution.
Thanks.
was (Author: apache9):
It depends on our goal. If the goal here is to remove all the renames, then
yes, HFile archiving is a problem.
But as you said, it is a bit challenging here. With store file tracker, it is
OK for us to leave the HFile there, without the actual 'archive operation'. And
when we reached the TTL, we just delete the HFile directly. But the problem as
you said, how can not find out the 'archived' HFiles, as in our current design,
the 'archived' HFiles should be plaved under the archive directory. Changing
this will need a very big refactoring.
So I think we'd better open another issue for this, and collect more feedbacks
to see if others in the community can have better abstraction and solution.
Thanks.
> Change the way on how we track store file list
> ----------------------------------------------
>
> Key: HBASE-26067
> URL: https://issues.apache.org/jira/browse/HBASE-26067
> Project: HBase
> Issue Type: Umbrella
> Components: HFile
> Reporter: Duo Zhang
> Assignee: Duo Zhang
> Priority: Major
>
> Open a separated jira to track the work since it can not be fully included in
> HBASE-24749.
> I think this could be a landed prior to HBASE-24749, as if this works, we
> could have different implementations for tracking store file list.
--
This message was sent by Atlassian Jira
(v8.20.1#820001)
