[
https://issues.apache.org/jira/browse/HDFS-8907?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Andrew Wang updated HDFS-8907:
------------------------------
Component/s: erasure-coding
> Configurable striping read buffer threhold
> ------------------------------------------
>
> Key: HDFS-8907
> URL: https://issues.apache.org/jira/browse/HDFS-8907
> Project: Hadoop HDFS
> Issue Type: Improvement
> Components: erasure-coding
> Reporter: Kai Zheng
> Assignee: Kai Zheng
>
> In striping input stream, positional read merges all the possible strips
> together, while stateful read reads a strip a time. The former is efficient
> but may incur too large chunk buffers for a client to afford, the latter is
> simple good but can be improved for better throughput. This would consolidate
> the both and use a configurable (new or existing) buffer threshold to control
> how it goes. Fixed chunk buffers for the read will be allocated accordingly
> and reused time and time, as existing stateful read does. The aligned strips
> to read a time may be computed against the threshold.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
