[
https://issues.apache.org/jira/browse/HDFS-16286?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17434741#comment-17434741
]
Stephen O'Donnell commented on HDFS-16286:
------------------------------------------
You may be interested in this tool which we developed to search for EC
corruptions:
https://github.com/sodonnel/hdfs-ec-validator
I have not had time to try to bring it into Hadoop as an official tool.
> Debug tool to verify the correctness of erasure coding on file
> --------------------------------------------------------------
>
> Key: HDFS-16286
> URL: https://issues.apache.org/jira/browse/HDFS-16286
> Project: Hadoop HDFS
> Issue Type: Improvement
> Components: erasure-coding, tools
> Affects Versions: 3.3.0, 3.3.1
> Reporter: daimin
> Assignee: daimin
> Priority: Minor
> Labels: pull-request-available
>
> Block data in erasure coded block group may corrupt and the block meta
> (checksum) is unable to discover the corruption in some cases such as EC
> reconstruction, related issues are: HDFS-14768, HDFS-15186, HDFS-15240.
> In addition to HDFS-15759, there needs a tool to check erasure coded file
> whether any block group has data corruption in case of other conditions
> rather than EC reconstruction, or the feature HDFS-15759(validation during EC
> reconstruction) is not open(which is close by default now).
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
