GitHub user cshuo added a comment to the discussion: RocksDB as The Replica of MDT/RLI
> Is there no way to make hudi commit first, and then flink proceeds to > checkpoint. @vinothchandar My previous explanation was addressing this question—why simply moving the Hudi commit before checkpoint completion would not be safe. > I heard the opposite, where checkpoint can complete, but hudi commit can > fail. Can that happen as well? Yes, with the current implementation based on flink standard two-phase commit, the checkpoint completes first and then Hudi commits afterward. It's possible that hudi commits can still fail after checkpoint has completed successfully. That failure does not invalidate the completed checkpoint. GitHub link: https://github.com/apache/hudi/discussions/18296#discussioncomment-18359781 ---- This is an automatically sent email for [email protected]. To unsubscribe, please send an email to: [email protected]
