[
https://issues.apache.org/jira/browse/HDFS-16283?focusedWorklogId=671048&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-671048
]
ASF GitHub Bot logged work on HDFS-16283:
-----------------------------------------
Author: ASF GitHub Bot
Created on: 27/Oct/21 21:27
Start Date: 27/Oct/21 21:27
Worklog Time Spent: 10m
Work Description: aihuaxu opened a new pull request #3595:
URL: https://github.com/apache/hadoop/pull/3595
HDFS-16283: RBF: improve renewLease() to call only a specific NameNode
rather than make fan-out calls
Currently renewLease() is called against all the target name services on
router while the file is only available on one name service and we only need to
renew lease against that name service.
The patch adds name service id (nsId) when a new file is created and it's
stored on the DFSClient project. A new API to renew lease against a particular
nsId is implemented so the router renews lease for that name service.
### How was this patch tested?
unit tests and cluster testing.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
Issue Time Tracking
-------------------
Worklog Id: (was: 671048)
Remaining Estimate: 0h
Time Spent: 10m
> RBF: improve renewLease() to call only a specific NameNode rather than make
> fan-out calls
> -----------------------------------------------------------------------------------------
>
> Key: HDFS-16283
> URL: https://issues.apache.org/jira/browse/HDFS-16283
> Project: Hadoop HDFS
> Issue Type: Sub-task
> Components: rbf
> Reporter: Aihua Xu
> Assignee: Aihua Xu
> Priority: Major
> Time Spent: 10m
> Remaining Estimate: 0h
>
> Currently renewLease() against a router will make fan-out to all the
> NameNodes. Since renewLease() call is so frequent and if one of the NameNodes
> are slow, then eventually the router queues are blocked by all renewLease()
> and cause router degradation.
> We will make a change in the client side to keep track of NameNode Id in
> additional to current fileId so routers understand which NameNodes the client
> is renewing lease against.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
