ZanderXu opened a new pull request, #4524:
URL: https://github.com/apache/hadoop/pull/4524

   ### Description of PR
   [HDFS-16283](https://issues.apache.org/jira/browse/HDFS-16283): RBF: improve 
renewLease() to call only a specific NameNode rather than make fan-out calls
   
   Currently RBF will forward the renewLease() rpc to all the available name 
services. So the forwarding efficiency will be affected by the unhealthy 
downstream name services. And along with as more as NSs are monitored by RBF, 
this problem will become more and more serious. 
   
   In our prod cluster, there are 70+ nameservices, the phenomenon that 
renewLease() rpc is blocked often occurs. 
   
   This patch is be used to fix this problem and work well on our cluster, and 
the main ideas is:
   - Carrying nsId to client when creating a new file
   - Store this nsId in DFSOutputStream
   - Client renewLease() rpc carries all nsIds of all DFSOutputStream to RBF
   - RBF parses the nsIds and forwards the renewLease rpc to the corresponding 
name services
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]


---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]

Reply via email to