RaguCS commented on issue #6389: URL: https://github.com/apache/paimon/issues/6389#issuecomment-3414119820
I'd like to take over this enhancement and start working on implementing the asynchronous bucket refresh mechanism for dynamic bucket mode. My plan: 1. Review the current PartitionIndex logic and how dynamic buckets are managed. 2. Implement the proposed async refresh logic using CompletableFuture to periodically scan and update available buckets. 3. Add configuration options for: > - dynamic-bucket.empty-bucket-threshold > - dynamic-bucket.refresh-interval 4. Write tests to verify that refreshed buckets are correctly reused and that the refresh operation doesn’t block assignment. Once the initial implementation is ready, I’ll open a PR for review and feedback. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
