[
https://issues.apache.org/jira/browse/HDFS-12291?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16150812#comment-16150812
]
Uma Maheswara Rao G commented on HDFS-12291:
--------------------------------------------
Hi [~xiaochen], thank you for detailed review!
{quote}
The most headache for re-encryption was renames.
.....The difficulty here is to guarantee no inodes are lost in the iteration.
{quote}
We thought about this scenario, I think to make it simple at this stage, In
SPS, how about we make constraint to call SPS for every rename op? Later when
we enable automatic SPS, this should be handed automatically.
For any rename, user has to call SPS on destination to trigger the SPS. Now
irrespective of whether directory already under SPS call or not, it should be
fine to make users to call SPS. Because, if multiple users working on some
directory tree, one user may not know whether SPS already called on parent or
not. So, it is recommended to call SPS for rename ops. Once we enable SPS to do
automatic later, all renames will be tracked automatically. Does this make
sense?
> [SPS]: Provide a mechanism to recursively iterate and satisfy storage policy
> of all the files under the given dir
> -----------------------------------------------------------------------------------------------------------------
>
> Key: HDFS-12291
> URL: https://issues.apache.org/jira/browse/HDFS-12291
> Project: Hadoop HDFS
> Issue Type: Sub-task
> Components: datanode, namenode
> Reporter: Rakesh R
> Assignee: Surendra Singh Lilhore
> Attachments: HDFS-12291-HDFS-10285-01.patch,
> HDFS-12291-HDFS-10285-02.patch
>
>
> For the given source path directory, presently SPS consider only the files
> immediately under the directory(only one level of scanning) for satisfying
> the policy. It WON’T do recursive directory scanning and then schedules SPS
> tasks to satisfy the storage policy of all the files till the leaf node.
> The idea of this jira is to discuss & implement an efficient recursive
> directory iteration mechanism and satisfies storage policy for all the files
> under the given directory.
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
---------------------------------------------------------------------
To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org
