elek commented on issue #578: HDDS-3053. Decrease the number of the chunk writer threads URL: https://github.com/apache/hadoop-ozone/pull/578#issuecomment-607772502 > Let's hold off committing this until we can discuss it further Let's discuss it further ;-) I am happy with **any** numbers (even with 60), if you can explain how the number is chosen. As you wrote earlier: > Can we make it a data driven decision? (yes) My questions: 1. What is the expected number of the disks (for default configuration, something like an average)? 2. What is the number of the threads per disks which are required to have the best performance? 3. What is the performance penalty of using too much thread (optimizing to big pool of disks) My answers: 1. 5 disk 2. 4 threads per disk (I am convinced to use 20 instead of 10 ;-) ) 3. 10% percent slowness (measured data, see my first link: using 10 threads was ~10% faster than using 60 threads)
---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] With regards, Apache Git Services --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
