parisni commented on PR #6815: URL: https://github.com/apache/hudi/pull/6815#issuecomment-1611601815
hi @nsivabalan ! is this supposed to be integrated in 0.14 ? As of 0.13.1, cleaning w/ MDT still is incredibly slow in this context: - huge number of partitions >= 100k - huge number of affected partitions >=10k OR incremental cleaning not kicks in b/c no files to clean at all We recently had a cleaning job w/ MDT running for 24h while dropping the MDT the job ended in few minutes. Thanks -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
