[
https://issues.apache.org/jira/browse/HDFS-3859?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13457247#comment-13457247
]
Todd Lipcon commented on HDFS-3859:
-----------------------------------
Actually this isn't committable yet. Before committing I ran it through the
randomized fault tests and found some issues -- mostly around the fact that two
log segments may be semantically equivalent but their md5sums may differ (due
to the padding at the end of the file after the transactions). It's looking
like working around this is going to be somewhat difficult... so I may just
remove the md5sum field for now until we have some better way of handling this.
> QJM: implement md5sum verification
> ----------------------------------
>
> Key: HDFS-3859
> URL: https://issues.apache.org/jira/browse/HDFS-3859
> Project: Hadoop HDFS
> Issue Type: Sub-task
> Affects Versions: QuorumJournalManager (HDFS-3077)
> Reporter: Todd Lipcon
> Assignee: Todd Lipcon
> Attachments: hdfs-3859-sha1.txt, hdfs-3859.txt
>
>
> When the QJM passes journal segments between nodes, it should use an md5sum
> field to make sure the data doesn't get corrupted during transit. This also
> serves as an extra safe-guard to make sure that the data is consistent across
> all nodes when finalizing a segment.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
