deepakpanda93 commented on issue #15772: URL: https://github.com/apache/hudi/issues/15772#issuecomment-4851580404
This is resolved. The flakiness came from the async HoodieIndexer and the regular ingestion writer both writing to the metadata table with eager rollbacks — one would roll back the other's MDT delta commit, and the other would then fail transitionRequestedToInflight on a now-missing .requested instant (IllegalArgumentException in transitionState). The fix is HUDI-5817 / [#8001](https://github.com/apache/hudi/pull/8001) ("Fix async indexer metadata writer to avoid eager rollback and failed write cleaning") — the approach @guoyihua outlined here — which shipped in 0.13.1 and is in all later releases, including 1.x. TestHoodieDeltaStreamer.testHoodieIndexer is enabled and stable in CI on current master. Closing as fixed. (Note: the separate testHoodieIndexerExecutionAfterCommit / testHoodieIndexerExecutionAfterClustering tests are disabled under HUDI-8951, and another indexer test under HUDI-6753 — those are tracked independently of this issue.) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
