xloya edited a comment on pull request #3563: URL: https://github.com/apache/iceberg/pull/3563#issuecomment-971308599
Hi @kbendick , firstly thanks for your review! You did mention another usage scenario that I didn't think about. We generally do use an isolated spark job for compaction. So we need a spark job tells us no commit succeeded by an exception to allows us to process in time without affecting query efficiency. It is also very normal to execute compaction after writing in the same one spark job. Can we use a compromise method, such as adding an `allow-no-commit-succeed` configuration that defaults to `true`, and then customize this parameter in a spark job to choose whether to throw an exception? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
