[
https://issues.apache.org/jira/browse/HDFS-6526?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14075238#comment-14075238
]
Zesheng Wu commented on HDFS-6526:
----------------------------------
Thanks for feedback, [~daryn].
# About scalability and performance issues: currently the default
implementation just simply traverses the whole directory tree, we can improve
this to that each instance traverses a sub directory tree, and can deploy
multiple instances on demand.
# About bugs: can you point out in details, I would like to figure them out as
soon as possible.
# bq. Would you please elaborate on whether you plan to simply have the trash
emptier and ttl manager run as distinct services in the same adjunct process?
Or do you plan on the emptier actually leveraging/relying on ttls?
As I mentioned in the design document in HDFS-6382, we want to supply a general
mechanism that can run various kinds of policies on the namespace, for example
TTL is one of the policies which is intended to clean expired files and
directories. In the same way, we can extend to implement a trash policy to
work in the way that is the same as the current trash emptier. If folks come to
an agreement that move the trash emptier is reasonable, we will change
'TtlManager' to a more general name.
# bq. As a general comment, a feature like this is attractive but may be highly
dangerous. You many want to consider means to safeguard against a severely
skewed system clock, else the ttl manager might go on mass murder spree in the
filesystem
Yes, I agree with you on this very much. The current patch is just an initial
implementation, we will improve to support this in the future iteration.
Hope that I expressed myself clearly:)
> Implement HDFS TtlManager
> -------------------------
>
> Key: HDFS-6526
> URL: https://issues.apache.org/jira/browse/HDFS-6526
> Project: Hadoop HDFS
> Issue Type: Sub-task
> Components: hdfs-client, namenode
> Affects Versions: 2.4.0
> Reporter: Zesheng Wu
> Assignee: Zesheng Wu
> Attachments: HDFS-6526.1.patch
>
>
> This issue is used to track development of HDFS TtlManager, for details see
> HDFS-6382.
--
This message was sent by Atlassian JIRA
(v6.2#6252)
