[
https://issues.apache.org/jira/browse/HDFS-15714?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17343743#comment-17343743
]
Feilong He edited comment on HDFS-15714 at 5/13/21, 7:15 AM:
-------------------------------------------------------------
[~bpatel], thanks for your review.
As you know, add/remove/list mount are basic operations. We thought
merge/append mount operations are not very commonly used seemingly. Right? And
another thought is it is better to make the patch concise and less complex for
new feature's initial implementation, except for implementing very necessary
core functionalities. For merge/append mount, I think many factors need to be
considered. E.g., consider case: two mounts to be merged own some data with
same name. So based on the above reasons, the current version doesn't cover
merge/append mount operations. Any thought?
was (Author: philohe):
[~bpatel], thanks for your review.
As you know, add/remove/list mount are basic operations. We thought
merge/append mount operations are not very commonly used seemingly. Right? And
another thought is it is better to make patch concise and less complex for new
feature's initial implementation, except for implementing very necessary core
functionalities. For merge/append mount, I think many factors need to be
considered. E.g., consider case: two mounts to be merged own data with same
name. So based on the above reasons, the current version doesn't cover
merge/append mount operations. Any thought?
> HDFS Provided Storage Read/Write Mount Support On-the-fly
> ---------------------------------------------------------
>
> Key: HDFS-15714
> URL: https://issues.apache.org/jira/browse/HDFS-15714
> Project: Hadoop HDFS
> Issue Type: New Feature
> Components: datanode, namenode
> Affects Versions: 3.4.0
> Reporter: Feilong He
> Assignee: Feilong He
> Priority: Major
> Labels: pull-request-available
> Attachments: HDFS-15714-01.patch,
> HDFS_Provided_Storage_Design-V1.pdf, HDFS_Provided_Storage_Performance-V1.pdf
>
> Time Spent: 2.5h
> Remaining Estimate: 0h
>
> HDFS Provided Storage (PS) is a feature to tier HDFS over other file systems.
> In HDFS-9806, PROVIDED storage type was introduced to HDFS. Through
> configuring external storage with PROVIDED tag for DataNode, user can enable
> application to access data stored externally from HDFS side. However, there
> are two issues need to be addressed. Firstly, mounting external storage
> on-the-fly, namely dynamic mount, is lacking. It is necessary to get it
> supported to flexibly combine HDFS with an external storage at runtime.
> Secondly, PS write is not supported by current HDFS. But in real
> applications, it is common to transfer data bi-directionally for read/write
> between HDFS and external storage.
> Through this JIRA, we are presenting our work for PS write support and
> dynamic mount support for both read & write. Please note in the community
> several JIRAs have been filed for these topics. Our work is based on these
> previous community work, with new design & implementation to support called
> writeBack mount and enable admin to add any mount on-the-fly. We appreciate
> those folks in the community for their great contribution! See their pending
> JIRAs: HDFS-14805 & HDFS-12090.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
