[
https://issues.apache.org/jira/browse/HDFS-8320?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Zhe Zhang updated HDFS-8320:
----------------------------
Description:
Right now we are doing striping-based I/O in a number of places:
# Client output stream (HDFS-7889)
# Client input stream
#* pread (HDFS-7782, HDFS-7678)
#* stateful read (HDFS-8033, HDFS-8281, HDFS-8319)
# DN reconstruction (HDFS-7348)
In each place we use one or multiple of the following terminologies:
# Cell
# Stripe
# Block group
# Internal block
# Chunk
This JIRA aims to systematically define these terminologies in relation with
each other and in the context of the containing file. For example, a cell
belong to stripe _i_ and internal block _j_ can be indexed as {{(i, j)}} and
its logical index _k_ in the file can be calculated.
With the above consolidation, hopefully we can further consolidate striping I/O
codes.
was:
Right now we are doing striping-based I/O in a number of places:
# Client output stream (HDFS-7889)
# Client input stream
#* pread (HDFS-7782, HDFS-7678)
#* stateful read (HDFS-8033, HDFS-8281, HDFS-8319)
# DN reconstruction (HDFS-7348)
In each place we use one or multiple of the following terminologies:
# Cell
# Stripe
# Block group
# Internal block
This JIRA aims to systematically define these terminologies in relation with
each other and in the context of the containing file. For example, a cell
belong to stripe _i_ and internal block _j_ can be indexed as {{(i, j)}} and
its logical index _k_ in the file can be calculated.
With the above consolidation, hopefully we can further consolidate striping I/O
codes.
> Erasure coding: consolidate striping-related terminologies
> ----------------------------------------------------------
>
> Key: HDFS-8320
> URL: https://issues.apache.org/jira/browse/HDFS-8320
> Project: Hadoop HDFS
> Issue Type: Sub-task
> Reporter: Zhe Zhang
> Assignee: Zhe Zhang
>
> Right now we are doing striping-based I/O in a number of places:
> # Client output stream (HDFS-7889)
> # Client input stream
> #* pread (HDFS-7782, HDFS-7678)
> #* stateful read (HDFS-8033, HDFS-8281, HDFS-8319)
> # DN reconstruction (HDFS-7348)
> In each place we use one or multiple of the following terminologies:
> # Cell
> # Stripe
> # Block group
> # Internal block
> # Chunk
> This JIRA aims to systematically define these terminologies in relation with
> each other and in the context of the containing file. For example, a cell
> belong to stripe _i_ and internal block _j_ can be indexed as {{(i, j)}} and
> its logical index _k_ in the file can be calculated.
> With the above consolidation, hopefully we can further consolidate striping
> I/O codes.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
