[
https://issues.apache.org/jira/browse/HDFS-8150?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Vinayakumar B updated HDFS-8150:
--------------------------------
Resolution: Fixed
Fix Version/s: 2.8.0
Hadoop Flags: Reviewed
Status: Resolved (was: Patch Available)
Committed to trunk and branch-2.
Thanks [~kihwal] for reporting.
Thanks [~andreina] for contribution,
and Thanks [~ajisakaa] for help in review.
> Make getFileChecksum fail for blocks under construction
> -------------------------------------------------------
>
> Key: HDFS-8150
> URL: https://issues.apache.org/jira/browse/HDFS-8150
> Project: Hadoop HDFS
> Issue Type: Bug
> Reporter: Kihwal Lee
> Assignee: J.Andreina
> Priority: Critical
> Fix For: 2.8.0
>
> Attachments: HDFS-8150.1.patch, HDFS-8150.2.patch, HDFS-8150.3.patch
>
>
> We have seen the cases of validating data copy using checksum then the
> content of target changing. It turns out the target wasn't closed
> successfully, so it was still under-construction. One hour later, a lease
> recovery kicked in and truncated the block.
> Although this can be prevented in many ways, if there is no valid use case
> for getting file checksum from under-construction blocks, can it be disabled?
> E.g. Datanode can throw an exception if the replica is not in the finalized
> state.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
