kerneltime commented on PR #5288: URL: https://github.com/apache/ozone/pull/5288#issuecomment-2058242569
I would recommend the following: 1. Establish the absolute peak performance possible in the cluster by using ozone freon om-echo command, I want to see what the pure RPC performance that can be reached. Also, try bumping up the config `ipc.server.read.threadpool.size` to a value around 10 or more and see if the echo command does better. 2. Once the peak is established, we should run a pure read load, on a modern architecture with NVMe, it is fair to expect a performance for pure metadata reads be 150k+ ops/sec (`GetKeyInfo`). I have not run this against the latest master so not sure if there some regression but I have seen performance around 200k or better. The expectation here is to see that the CPU has reached utilization numbers higher than 50%. It is possible that we do not have enough client threads or client instances. 3. After we establish the peak performance that the cluster can hit, we should switch to measuring impact of reading from followers using Ratis. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
