[
https://issues.apache.org/jira/browse/HDFS-8646?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Andrew Wang updated HDFS-8646:
------------------------------
Attachment: hdfs-8646.001.patch
Patch attached. We now prune in BlockManager#removeStoredBlock, which should be
pretty failsafe. New test exercises this logic, and I also added a failsafe
prune in CacheManager in case we missed some other similar case.
> Prune cached replicas from DatanodeDescriptor state on replica invalidation
> ---------------------------------------------------------------------------
>
> Key: HDFS-8646
> URL: https://issues.apache.org/jira/browse/HDFS-8646
> Project: Hadoop HDFS
> Issue Type: Bug
> Components: caching
> Affects Versions: 2.3.0
> Reporter: Andrew Wang
> Assignee: Andrew Wang
> Attachments: hdfs-8646.001.patch
>
>
> Currently we remove blocks from the DD's CachedBlockLists on node failure and
> on cache report, but not on replica invalidation. This can lead to an invalid
> situation where we return a LocatedBlock with cached locations that are not
> backed by an on-disk replica.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
