[
https://issues.apache.org/jira/browse/HDFS-8907?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Kai Zheng updated HDFS-8907:
----------------------------
Description: In striping input stream, positional read merges all the
possible strips together, while stateful read reads a strip a time. The former
is efficient but may incur too large chunk buffers for a client to afford, the
latter is simple good but can be improved for better throughput. This would
consolidate the both and use a configurable (new or existing) buffer threshold
to control how it goes. Fixed chunk buffers for the read will be allocated
accordingly and reused time and time, as existing stateful read does. The
aligned strips to read a time may be computed against the threshold. (was: In
striping input stream, positional read merges all the possible strips together,
while stateful read reads a strip a time. The former is efficient but may incur
too large chunk buffers for a client to afford, the latter is simple good but
can be improved for better throughput. This would consolidate the both and use
a configurable (new or existing) buffer threshold to control how it goes. Fixed
chunk buffers for the read will be allocated accordingly and reused time and
time. The aligned strips to read a time may be computed against the threshold. )
> Configurable striping read buffer threhold
> ------------------------------------------
>
> Key: HDFS-8907
> URL: https://issues.apache.org/jira/browse/HDFS-8907
> Project: Hadoop HDFS
> Issue Type: Sub-task
> Reporter: Kai Zheng
> Assignee: Kai Zheng
>
> In striping input stream, positional read merges all the possible strips
> together, while stateful read reads a strip a time. The former is efficient
> but may incur too large chunk buffers for a client to afford, the latter is
> simple good but can be improved for better throughput. This would consolidate
> the both and use a configurable (new or existing) buffer threshold to control
> how it goes. Fixed chunk buffers for the read will be allocated accordingly
> and reused time and time, as existing stateful read does. The aligned strips
> to read a time may be computed against the threshold.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
