JingsongLi commented on pull request #1669: URL: https://github.com/apache/iceberg/pull/1669#issuecomment-720930842
Thanks @simonsssu for your contribution. If you don't mind, can you write a design document? I think it is good to have a global design. I have some initial question: - When to do compaction? - Does compaction block checkpoint? If there are large number of files need to be compacted, that will lead to the timeout/failure of checkpoint. - How to do incremental compaction instead of compacting the whole table? - When to commit compaction? Does it support multiple streaming sinks? - in addition, can we reuse more codes in https://github.com/apache/iceberg/pull/1623 ? I think essentially they do the same job. ---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
