[
https://issues.apache.org/jira/browse/HDFS-9666?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16040361#comment-16040361
]
Fangyuan Deng commented on HDFS-9666:
-------------------------------------
we have tested on three machines [ 32 core cpu, 128G mem , 1000M network,
1.2T HDD, 800G SSD(intel P3600) ].
with this feather, throughput of hbase table(ONE_SSD) is double of which
without this feather
> Enable hdfs-client to read even remote SSD/RAM prior to local disk replica to
> improve random read
> -------------------------------------------------------------------------------------------------
>
> Key: HDFS-9666
> URL: https://issues.apache.org/jira/browse/HDFS-9666
> Project: Hadoop HDFS
> Issue Type: Improvement
> Components: hdfs-client
> Affects Versions: 2.6.0, 2.7.0
> Reporter: ade
> Assignee: ade
> Attachments: HDFS-9666.0.patch
>
>
> We want to improve random read performance of HDFS for HBase, so enabled the
> heterogeneous storage in our cluster. But there are only ~50% of datanode &
> regionserver hosts with SSD. we can set hfile with only ONE_SSD not ALL_SSD
> storagepolicy and the regionserver on none-SSD host can only read the local
> disk replica . So we developed this feature in hdfs client to read even
> remote SSD/RAM prior to local disk replica.
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
