szetszwo commented on PR #6613:
URL: https://github.com/apache/ozone/pull/6613#issuecomment-3598737857
With some change in HDDS-14035 (will submit a PR soon), the performance can
be further improved to 3.3 GB/s for larger buffer sizes:
```
---------------------------------------------------------
key8 with 256M (=268435456) bytes and 16k (=16384) bytesPerChecksum
createStreamKey: 145.00 MB/s ( 1.765 s, buffer 8MB (=8388608), keySize
256.00 MB, md5=9E 4E A5 A0 51 07 0A 17 5E E2 B2 07 09 60 95 6E)
readStreamKey: 3273.01 MB/s ( 0.078 s, buffer 32M (=33554432), keySize
256.00 MB, md5=null)
readStreamKey: 743.80 MB/s ( 0.344 s, buffer 32M (=33554432), keySize
256.00 MB, md5=9E 4E A5 A0 51 07 0A 17 5E E2 B2 07 09 60 95 6E)
readStreamKey: 3300.60 MB/s ( 0.078 s, buffer 8M (=8388608), keySize
256.00 MB, md5=null)
readStreamKey: 776.45 MB/s ( 0.330 s, buffer 8M (=8388608), keySize
256.00 MB, md5=9E 4E A5 A0 51 07 0A 17 5E E2 B2 07 09 60 95 6E)
readStreamKey: 2282.57 MB/s ( 0.112 s, buffer 1M (=1048576), keySize
256.00 MB, md5=null)
readStreamKey: 757.36 MB/s ( 0.338 s, buffer 1M (=1048576), keySize
256.00 MB, md5=9E 4E A5 A0 51 07 0A 17 5E E2 B2 07 09 60 95 6E)
readStreamKey: 2259.09 MB/s ( 0.113 s, buffer 4k (=4096), keySize
256.00 MB, md5=null)
readStreamKey: 751.97 MB/s ( 0.340 s, buffer 4k (=4096), keySize
256.00 MB, md5=9E 4E A5 A0 51 07 0A 17 5E E2 B2 07 09 60 95 6E)
```
All JIRAs in
https://github.com/apache/ozone/pull/6613#issuecomment-3564010448 have been
merged. Closing this ...
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
