chungen0126 commented on PR #9932: URL: https://github.com/apache/ozone/pull/9932#issuecomment-4072702261
Thanks for the explanation. > We have a large bucket which contains a lot of keys (hundreds of millions) and we schedule lifecycle configuration to delete most of the keys, this generates millions of tombstones that were not compacted by RocksDB in a timely manner Regarding this point, since the object deletion triggered by the lifecycle is a periodic and internal Ozone operation, I have an idea: Is it possible to automatically trigger a compaction if we detect that the number of deleted objects exceeds a certain threshold? > I understand the concern and since the fake dir logic is based on the limitation of the OBS/LEGACY flat namespace, we had to contend with it. Another concern of mine is that this change might increase system instability. It could potentially lead to flaky tests, which would make the project much harder to maintain in the long run. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
