nsivabalan commented on issue #11248: URL: https://github.com/apache/hudi/issues/11248#issuecomment-2347429415
can we try settting hoodie.cleaner.commits.retained to say 1000. and then get few data cleaned up. and then try 500. and after few runs, 300. and after few runs, 100. essentially reducing the amount of data to clean on every batch. looks like we are trying to clean pretty much most of past history in 1 shot. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
