[
https://issues.apache.org/jira/browse/HDFS-11939?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Chen Liang updated HDFS-11939:
------------------------------
Attachment: HDFS-11939-HDFS-7240.004.patch
Had an offline discussion with [~anu], post v004 patch to address the following:
- throw exception when position to location > total size
- for read, if dst buffer has remaining length 0 already, return 0 immediately
- for read path, order the chunks by their offsets first, then when locating a
chunk, do binary instead of iterating.
- earlier, the "undefined" part of data can be anything random. changed to zero
bytes.
> Ozone : add read/write random access to Chunks of a key
> -------------------------------------------------------
>
> Key: HDFS-11939
> URL: https://issues.apache.org/jira/browse/HDFS-11939
> Project: Hadoop HDFS
> Issue Type: Sub-task
> Reporter: Chen Liang
> Assignee: Chen Liang
> Attachments: HDFS-11939-HDFS-7240.001.patch,
> HDFS-11939-HDFS-7240.002.patch, HDFS-11939-HDFS-7240.003.patch,
> HDFS-11939-HDFS-7240.004.patch
>
>
> In Ozone, the value of a key is a sequence of container chunks. Currently,
> the only way to read/write the chunks is by using ChunkInputStream and
> ChunkOutputStream. However, by the nature of streams, these classes are
> currently implemented to only allow sequential read/write.
> Ideally we would like to support random access of the chunks. For example, we
> want to be able to seek to a specific offset and read/write some data. This
> will be critical for key range read/write feature, and potentially important
> for supporting parallel read/write.
> This JIRA tracks adding support by implementing FileChannel class on top
> Chunks.
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
---------------------------------------------------------------------
To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org
