szetszwo opened a new pull request, #4424: URL: https://github.com/apache/ozone/pull/4424
## What changes were proposed in this pull request? OM rocksdb uses a lot of space. This PR adds a cache in RDBBatchOperation for caching the put ops. When there are multiple ops with the same key, it will overwrite the previous op in the cache so the previous op won't be written into RocksDB. In a test, the cache can reduce the a single upload of 1000 parts from 755MB to 23MB. ## What is the link to the Apache JIRA https://issues.apache.org/jira/browse/HDDS-8128 ## How was this patch tested? The is an optimization. The existing test already has covered. Also have tested this with https://github.com/apache/ozone/compare/ozone-1.3...szetszwo:ozone:multipartUpload manually. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
