RussellSpitzer opened a new pull request #3292: URL: https://github.com/apache/iceberg/pull/3292
Previously the rewrite action would ignore files which were below our target threshold if we could not combine them with a smaller file or piece of a larger file. This would preclude ever combining the piece of of medium sized file with several other medium sized files resulting in files of the correct size. To fix this we attempt to split up all files we are compacting to give a chance for pieces of medium sized files to be incorporated with each other. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
