xloya edited a comment on pull request #3563: URL: https://github.com/apache/iceberg/pull/3563#issuecomment-971308599
Hi @kbendick , firstly thanks for your review! You did mention another usage scenario that I didn't think about. We generally do use an isolated spark job for compaction. So we need a spark job tells us no commit succeed by an exception to allows us to process in time without affecting query efficiency. It is also very normal to execute compaction after writing. Can we use a compromise method, such as adding an allow-no-commit-succeed configuration that defaults to true, and then customize this parameter in a spark job to choose whether to throw an exception? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
