[
https://issues.apache.org/jira/browse/HDFS-16283?focusedWorklogId=787725&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-787725
]
ASF GitHub Bot logged work on HDFS-16283:
-----------------------------------------
Author: ASF GitHub Bot
Created on: 05/Jul/22 03:27
Start Date: 05/Jul/22 03:27
Worklog Time Spent: 10m
Work Description: Hexiaoqiao commented on PR #4524:
URL: https://github.com/apache/hadoop/pull/4524#issuecomment-1174563715
> > For both create and renewLease (with file path), I think they will apply
the same MountTableResolver for same file.
>
> Although they all used MountTableResolver, create and append rpc can get
the NS which the file belongs, but renewlease can only obtain the full NSs
which the file mounted. So int this case, the renewlease rpc always forwarded
to some unnecessary nameservices.
Exactly true. For MultipleDestinationMount, it could forward to different NS
when request with file path only, especially for DestinationOrder.RANDOM and
related order. cc @ayushtkn @goiri Anymore feedback here? Thanks.
Issue Time Tracking
-------------------
Worklog Id: (was: 787725)
Time Spent: 5h (was: 4h 50m)
> RBF: improve renewLease() to call only a specific NameNode rather than make
> fan-out calls
> -----------------------------------------------------------------------------------------
>
> Key: HDFS-16283
> URL: https://issues.apache.org/jira/browse/HDFS-16283
> Project: Hadoop HDFS
> Issue Type: Sub-task
> Components: rbf
> Reporter: Aihua Xu
> Assignee: Aihua Xu
> Priority: Major
> Labels: pull-request-available
> Attachments: RBF_ improve renewLease() to call only a specific
> NameNode rather than make fan-out calls.pdf
>
> Time Spent: 5h
> Remaining Estimate: 0h
>
> Currently renewLease() against a router will make fan-out to all the
> NameNodes. Since renewLease() call is so frequent and if one of the NameNodes
> are slow, then eventually the router queues are blocked by all renewLease()
> and cause router degradation.
> We will make a change in the client side to keep track of NameNode Id in
> additional to current fileId so routers understand which NameNodes the client
> is renewing lease against.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
