[ https://issues.apache.org/jira/browse/HDFS-9666?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15109062#comment-15109062 ]
Arpit Agarwal commented on HDFS-9666: ------------------------------------- Hi [~aderen], thanks for filing this. We considered enabling this as part of HDFS-6581. However it looked like the benefits of reading from remote RAM were canceled by the RPC overhead, as compared to short-circuit reads from local disk. If you have any data that shows otherwise that would be great. > Enable hdfs-client to read even remote SSD/RAM prior to local disk replica to > improve random read > ------------------------------------------------------------------------------------------------- > > Key: HDFS-9666 > URL: https://issues.apache.org/jira/browse/HDFS-9666 > Project: Hadoop HDFS > Issue Type: Improvement > Components: hdfs-client > Affects Versions: 2.6.0, 2.7.0 > Reporter: ade > Assignee: ade > Fix For: 2.7.2 > > Attachments: HDFS-9666.0.patch > > > We want to improve random read performance of HDFS for HBase, so enabled the > heterogeneous storage in our cluster. But there are only ~50% of datanode & > regionserver hosts with SSD. we can set hfile with only ONE_SSD not ALL_SSD > storagepolicy and the regionserver on none-SSD host can only read the local > disk replica . So we developed this feature in hdfs client to read even > remote SSD/RAM prior to local disk replica. -- This message was sent by Atlassian JIRA (v6.3.4#6332)