davseitsev commented on issue #1286: URL: https://github.com/apache/iceberg/issues/1286#issuecomment-668078507
Thanks @HeartSaVioR for the answer. I've looked through the mailing list. I understand all the concerns which @rdblue describes. I configured metadata and manifest files compaction to keep acceptable number of files. It should not be an issue. Also I apply snapshots expiration to keep only a few latest snapshots and cleanup old files. In my opinion the cause of slow commit operation is that I keep my table on Amazon S3. I like the idea to implement my own logic on metadata operations, will try to do that. ---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
