[ 
https://issues.apache.org/jira/browse/HDFS-9666?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15109062#comment-15109062
 ] 

Arpit Agarwal commented on HDFS-9666:
-------------------------------------

Hi [~aderen], thanks for filing this. We considered enabling this as part of 
HDFS-6581. However it looked like the benefits of reading from remote RAM were 
canceled by the RPC overhead, as compared to short-circuit reads from local 
disk.

If you have any data that shows otherwise that would be great. 

> Enable hdfs-client to read even remote SSD/RAM prior to local disk replica to 
> improve random read
> -------------------------------------------------------------------------------------------------
>
>                 Key: HDFS-9666
>                 URL: https://issues.apache.org/jira/browse/HDFS-9666
>             Project: Hadoop HDFS
>          Issue Type: Improvement
>          Components: hdfs-client
>    Affects Versions: 2.6.0, 2.7.0
>            Reporter: ade
>            Assignee: ade
>             Fix For: 2.7.2
>
>         Attachments: HDFS-9666.0.patch
>
>
> We want to improve random read performance of HDFS for HBase, so enabled the 
> heterogeneous storage in our cluster. But there are only ~50% of datanode & 
> regionserver hosts with SSD. we can set hfile with only ONE_SSD not ALL_SSD 
> storagepolicy and the regionserver on none-SSD host can only read the local 
> disk replica . So we developed this feature in hdfs client to read even 
> remote SSD/RAM prior to local disk replica.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Reply via email to