swamirishi opened a new pull request, #8101: URL: https://github.com/apache/ozone/pull/8101
Change-Id: I820e10912427c643b05d3e88a7c30094106fbd5a ## What changes were proposed in this pull request? Currently the Container mismatch API in recon loads up the entire ContainerMetaData from ContainerKeyPrefix table and figures out the container mismatches between OM & SCM. The implication is that the ContainerKeyPrefix table will have as many keys as there there in OM. In case there are too many keys even for loading a small page too many containers would be brought into memory and the result would be eventually discarded because of the page size limit. Instead of this we should implement an container iterator for the containerKeyPrefix table which would iterate on containers sequentially in a sorted fashion along with the scm containerManager iterator and diff would be figured out based on the merging these 2 container list. We can save on a lot of iops & improve the latency of this api by a lot. ## What is the link to the Apache JIRA https://issues.apache.org/jira/browse/HDDS-12619 ## How was this patch tested? Existing unit tests & adding more for the iterator -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
