Virajith Jalaparti created HDFS-14805:
-----------------------------------------

             Summary: Mounting external stores in HDFS on-the-fly
                 Key: HDFS-14805
                 URL: https://issues.apache.org/jira/browse/HDFS-14805
             Project: Hadoop HDFS
          Issue Type: Improvement
            Reporter: Virajith Jalaparti
         Attachments: dynamic-mounts-in-hdfs.pdf

Provided storage (HDFS-9806) allows HDFS to address data in external storage 
systems, including cloud stores. Data mounted in this manner, seamlessly, 
appears to be part of HDFS for applications/clients. The external data can also 
be cached by HDFS on local disks and SSDs, accelerating remote data reads 
(HDFS-13069). 

However, Provided storage was originally targeted at ephemeral HDFS deployments 
in the cloud (e.g., Azure HDInsight). Long running HDFS clusters are common in 
many other scenarios which can benefit from accessing data in remote stores. 
This JIRA targets such scenarios and aims to provide the ability to:
(a) Dynamically mount external stores in a HDFS cluster while supporting high 
availability.
(b) Mount multiple remote stores simultaneously.
(c) Reduce deployment overheads and simplify usability of Provided storage.



--
This message was sent by Atlassian Jira
(v8.3.2#803003)

---------------------------------------------------------------------
To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org

Reply via email to