BalaMahesh commented on issue #9758: URL: https://github.com/apache/hudi/issues/9758#issuecomment-1767671730
@ad1happy2go / @codope - hoodie.metadata.compact.max.delta.commits=1 with this config I expect compaction to run after every metadata commit, but that is not happening and all the delta commits are being piled up on metadata path and after accumulating large number of files, compaction is being triggered and failing with OOM error. I didn't get enough time to go through the code flow for this metadata table. We can increase the memory fraction - if this the problem it should at least trigger the compaction after every delta commit and fail right with hoodie.metadata.compact.max.delta.commits set to 1. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
