[
https://issues.apache.org/jira/browse/HDFS-16283?focusedWorklogId=787398&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-787398
]
ASF GitHub Bot logged work on HDFS-16283:
-----------------------------------------
Author: ASF GitHub Bot
Created on: 03/Jul/22 12:58
Start Date: 03/Jul/22 12:58
Worklog Time Spent: 10m
Work Description: ZanderXu commented on PR #4524:
URL: https://github.com/apache/hadoop/pull/4524#issuecomment-1173080044
Thanks @ayushtkn for your good idea, and I have updated the patch.
About caching `availableNamespace`, there is a point that is not easy to
deal with, I'm looking for your help.
The available namespaces is dynamically changing along with RBF runs, such
as name services becomes unavailable, end user manually disable some name
services. If we want to cache available `FederationNamespaceInfos`, we need to
consider cache invalidation. For simple processing, so I removed the cache.
I'm looking for your help, thanks.
Issue Time Tracking
-------------------
Worklog Id: (was: 787398)
Time Spent: 3.5h (was: 3h 20m)
> RBF: improve renewLease() to call only a specific NameNode rather than make
> fan-out calls
> -----------------------------------------------------------------------------------------
>
> Key: HDFS-16283
> URL: https://issues.apache.org/jira/browse/HDFS-16283
> Project: Hadoop HDFS
> Issue Type: Sub-task
> Components: rbf
> Reporter: Aihua Xu
> Assignee: Aihua Xu
> Priority: Major
> Labels: pull-request-available
> Attachments: RBF_ improve renewLease() to call only a specific
> NameNode rather than make fan-out calls.pdf
>
> Time Spent: 3.5h
> Remaining Estimate: 0h
>
> Currently renewLease() against a router will make fan-out to all the
> NameNodes. Since renewLease() call is so frequent and if one of the NameNodes
> are slow, then eventually the router queues are blocked by all renewLease()
> and cause router degradation.
> We will make a change in the client side to keep track of NameNode Id in
> additional to current fileId so routers understand which NameNodes the client
> is renewing lease against.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
