jojochuang opened a new pull request, #4628: URL: https://github.com/apache/ozone/pull/4628
## What changes were proposed in this pull request? In this PR, Client removes ChunkInfo that are already sent in previous PutBlock requests. DataNode then append ChunkInfo to an existing block. The BlockManagerImpl refactors a bulk of code into a standalone method, updateDBForPutBlock(), but for the most part, it simply does what's described above. With this change, the client side overhead is dramatically reduced. The DataNode ratis log overhead is dramatically reduced too. However, there is still a lot of deserialization overhead because DataNode needs to read BlockData from rocksdb so it can append ChunkInfo. The caching mechanism that is similar to what OM has may be the solution. But that's a bigger change and I plan to pursue in a follow-up change. ## What is the link to the Apache JIRA https://issues.apache.org/jira/browse/HDDS-8047 ## How was this patch tested? This is performance optimization. Existing tests covers all. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
