[ https://issues.apache.org/jira/browse/HDFS-7678?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Zhe Zhang updated HDFS-7678: ---------------------------- Attachment: HDFS-7678-HDFS-7285.11.patch I originally planned to consolidate striping terminologies under HDFS-8320 but it seems necessary to do some of the consolidation now. 011 patch updates the definition of a {{Stripe}}, which covers an arbitrary range from all internal blocks (same coverage for each internal block), a {{StripingCell}}, a {{StripingChunk}}. Using these new tools {{DFSStripedInputStream}} has a much simpler logic to read a {{Stripe}}, which in turn reads individual {{StripingChunk}}'s. Right now the patch is not completed but posting here for some feedback on the direction. With this structure, all complexities are migrated to abstract number-crunching in {{StripedBlockUtil}}, which can be easily and extensively unit-tested. > Erasure coding: DFSInputStream with decode functionality (pread) > ---------------------------------------------------------------- > > Key: HDFS-7678 > URL: https://issues.apache.org/jira/browse/HDFS-7678 > Project: Hadoop HDFS > Issue Type: Sub-task > Affects Versions: HDFS-7285 > Reporter: Li Bo > Assignee: Zhe Zhang > Attachments: BlockGroupReader.patch, HDFS-7678-HDFS-7285.002.patch, > HDFS-7678-HDFS-7285.003.patch, HDFS-7678-HDFS-7285.004.patch, > HDFS-7678-HDFS-7285.005.patch, HDFS-7678-HDFS-7285.006.patch, > HDFS-7678-HDFS-7285.007.patch, HDFS-7678-HDFS-7285.008.patch, > HDFS-7678-HDFS-7285.009.patch, HDFS-7678-HDFS-7285.010.patch, > HDFS-7678-HDFS-7285.11.patch, HDFS-7678.000.patch, HDFS-7678.001.patch > > > A block group reader will read data from BlockGroup no matter in striping > layout or contiguous layout. The corrupt blocks can be known before > reading(told by namenode), or just be found during reading. The block group > reader needs to do decoding work when some blocks are found corrupt. -- This message was sent by Atlassian JIRA (v6.3.4#6332)