hantangwangd commented on PR #13434: URL: https://github.com/apache/iceberg/pull/13434#issuecomment-3294547561
@hsiang-c thanks for the link to PR #14083! It allowed me to catch up on the discussion here. I encountered a similar issue in a concurrent environment where the `HiveCatalog` is configured with lock disabled. When one operation is executing the commission of `registerTable`, another concurrent operation happens to commit a create-table for the same target table name. At this point, the `registerTable` operation fails due to an `AlreadyExistsException`. In this scenario, the source table becomes corrupted. This situation (along with some other cases maybe) does not seem to be entirely avoidable through pre-checks. In PR #14083, I implemented a solution aligned with the approach mentioned above. That is, the metadata file is only deleted upon failure if it was newly created by the register table operation. Could you please take a look when you have a moment @nastra @dramaticlly @stevenzwu @hsiang-c, thanks a lot! -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
