runzhiwang opened a new pull request #1031:
URL: https://github.com/apache/hadoop-ozone/pull/1031


   
   
   ## What changes were proposed in this pull request?
   
   **What's the problem ?**
   I start a ozone cluster with 1000 datanodes and 10 s3gateway, and run two 
weeks with heavy workload, and perf om and scm.
   1. From om perf, getServiceList cost 63.75% cpu.
   
![image](https://user-images.githubusercontent.com/51938049/83937289-ed6b0600-a7fd-11ea-84a9-25f267abc759.png)
   
   2.From scm perf, queryNode come from om::getServiceList cost 33.20% cpu
   
![image](https://user-images.githubusercontent.com/51938049/83937299-fe1b7c00-a7fd-11ea-9fbf-768b269ef7a1.png)
   
   What's the reason ?
   Now s3g create a client for each request. when create each RpcClient, s3g 
will call `ozoneManagerClient.getServiceInfo()`, `getServiceInfo` will call 
`getServiceList`. Then om and scm are very busy with getServiceList.
   
   But s3g does not use the List<ServiceInfo> which got from getServiceList at 
all.
   
   
   ## What is the link to the Apache JIRA
   
   https://issues.apache.org/jira/browse/HDDS-3745
   
   ## How was this patch tested?
   
   Existed tests.
   


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
[email protected]



---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]

Reply via email to