danny0405 commented on issue #5020: URL: https://github.com/apache/hudi/issues/5020#issuecomment-1120582884
> we have 3 files in requested, inflight and completed states. How about have a mechanism where after a certain threshold in terms of number of commits, we archive or simply delete only the requested and inflight state files and keep the completed state .commit file in the active timeline. We can do that, but what is the purpose here ? To reduce the pressure from the small files ? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
