lilei1128 commented on PR #8897: URL: https://github.com/apache/paimon/pull/8897#issuecomment-5117803823
> LGTM. We applied the same fix in our internal fork, which reduced a lot of memory consumption during commits involving large tables. Thanks for taking a look! Exactly, I ran into an issue where compacting a large table with tons of small files under tight resource limits was failing/OOMing. Glad to know this fix works well for your workloads as well! -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
