Swaminathan Balachandran created HDDS-12064:
-----------------------------------------------
Summary: Optimize bootstrap logic to reduce loop while checking
file links
Key: HDDS-12064
URL: https://issues.apache.org/jira/browse/HDDS-12064
Project: Apache Ozone
Issue Type: Sub-task
Reporter: Swaminathan Balachandran
Assignee: Swaminathan Balachandran
Currently while checking file links, the exclude sst file list & files already
present in the current tarball is checked in the entries by sequentially
iterating through the entries, for each and every file in the om data directory
(snapshot directory, active om.db, compaction backup sst file). Now if the
exclude list or files present in the tarball is really long order of 1000s and
the total number of sst files are in the order of millions, the bootstrap is
going to read timeout and might take hours. We need to optimize and not perform
this unnecessary iteration to avoid this n^2 operation and do it in O(n)
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
