[
https://issues.apache.org/jira/browse/HDFS-12295?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16138002#comment-16138002
]
Yongjun Zhang commented on HDFS-12295:
--------------------------------------
Thanks a lot for your comment [~chris.douglas]! and [~asuresh] for the earlier
suggestion too!
I gave further thought, I now think this is a very interesting idea and
simplest to implement! Say, for a given dedicated user, we can just assume
external attribute provider is disconnected (we can add a check at HDFS instead
of letting the provider pass through), and the only thing this user can do is
distcp.
Some subtlety:
There are three cases:
1. distcp from one cluster to another, where the source cluster has external
attribute provider
2. distcp within the same cluster, where the source path is managed by the
external attribute provider
3. hadoop fs -cp command , arguments like in 2
Any of these cases could have the problem we try to solve here. But we can
require that if external attribute provider is enabled, files can only be
copied by the dedicated user to be safe. Like you said, we could provider a
service to do distcp, and "hadoop fs -cp", and run the service as a dedicated
user.
Let me explore this further.
> NameNode to support file path prefix /.reserved/bypassExtAttr
> -------------------------------------------------------------
>
> Key: HDFS-12295
> URL: https://issues.apache.org/jira/browse/HDFS-12295
> Project: Hadoop HDFS
> Issue Type: Sub-task
> Components: hdfs, namenode
> Reporter: Yongjun Zhang
> Assignee: Yongjun Zhang
> Attachments: HDFS-12295.001.patch, HDFS-12295.001.patch
>
>
> Let NameNode to support prefix /.reserved/bypassExtAttr, so client can add
> thisprefix to a path before calling getFileStatus, e.g. /ab/c becomes
> /.reserved/bypassExtAttr/a/b/c. NN will parse the path at the very beginning,
> and bypass external attribute provider if the prefix is there.
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
