LsomeYeah opened a new pull request, #6245: URL: https://github.com/apache/paimon/pull/6245
<!-- Please specify the module before the PR name: [core] ... or [flink] ... --> ### Purpose <!-- Linking this pull request to the issue --> Linked issue: close #xxx <!-- What is the purpose of the change --> When trying to list all paimon file directories for orphan file cleaning, the memory usage can become quite high if there are too many directories. This pr introduced a new configration `'folder_based_check'` to limit the directories loading to memory. With this cofigured to true, only old directories will be loaded, but this may lead to some old orphan files not being cleaned up properly. ### Tests <!-- List UT and IT cases to verify this change --> ### API and Format <!-- Does this change affect API or storage format --> ### Documentation <!-- Does this change introduce a new feature --> -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
