voonhous commented on PR #14095: URL: https://github.com/apache/hudi/pull/14095#issuecomment-3409963608
FWIU, the issue is: 1. MDT compaction fails, compaction is never committed, there may be inflight compaction 2. `FlinkHoodieBackedTableMetadataWriter.commitInternal` -> `compactIfNecessary(writeClient, Option.empty()); `: This method would schedule and execute a NEW compaction, but it never completed pending compactions from previous failed attempts. The fix is to delegate to the parent class which invokes `writeClient.runAnyPendingCompactions` and which is mostly identical. Please CMIIW. Just curious, were there any considerations as to why the commitInternal was overwritten? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
