[
https://issues.apache.org/jira/browse/HDFS-12893?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16279309#comment-16279309
]
Virajith Jalaparti commented on HDFS-12893:
-------------------------------------------
The attached patch resolves a {{ProvidedDatanodeDescriptor}} to a physical
{{DatanodeDescriptor}} ({{node =
providedStorageMap.getDatanodeDescriptor(storage)}}) before a Provided block is
scheduled for replication (earlier implementation resolved this lazily on a
call to {{ProvidedDescriptor.addBlockToBeReplicated}}). The new approach
ensures that the location of the provided replica is handled correctly on calls
to {{BlockPlacementPolicy.chooseTargets}}. Further,
{{BlockManager.isPlacementPolicySatisfied}} is modified to always return
{{true}} for provided blocks (as long as the storage is {{NORMAL}}) as Provided
replicas are not local to HDFS, and thus, the placement policy isn't applicable.
The added test case {{testProvidedWithHierarchicalTopology}} fails without
these changes (as the location of the Provided DN cannot be properly resolved).
> [READ] Support replication of Provided blocks with non-default topologies.
> --------------------------------------------------------------------------
>
> Key: HDFS-12893
> URL: https://issues.apache.org/jira/browse/HDFS-12893
> Project: Hadoop HDFS
> Issue Type: Sub-task
> Reporter: Virajith Jalaparti
> Assignee: Virajith Jalaparti
> Attachments: HDFS-12893-HDFS-9806.001.patch
>
>
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
