[ https://issues.apache.org/jira/browse/HUDI-3648 ]
hehuiyuan deleted comment on HUDI-3648:
---------------------------------
was (Author: hehuiyuan):
org.apache.hudi.exception.HoodieIOException: Could not delete instant
[==>20230828170853930__compaction__INFLIGHT]
at
org.apache.hudi.common.table.timeline.HoodieActiveTimeline.deleteInstantFile(HoodieActiveTimeline.java:300)
at
org.apache.hudi.common.table.timeline.HoodieActiveTimeline.deleteInflight(HoodieActiveTimeline.java:237)
at
org.apache.hudi.common.table.timeline.HoodieActiveTimeline.revertInstantFromInflightToRequested(HoodieActiveTimeline.java:409)
at
org.apache.hudi.table.HoodieTable.rollbackInflightInstant(HoodieTable.java:634)
at
org.apache.hudi.table.HoodieTable.rollbackInflightCompaction(HoodieTable.java:607)
at
org.apache.hudi.table.HoodieTable.rollbackInflightCompaction(HoodieTable.java:591)
at
org.apache.hudi.util.CompactionUtil.lambda$rollbackCompaction$1(CompactionUtil.java:190)
at java.util.ArrayList.forEach(ArrayList.java:1257)
at
org.apache.hudi.util.CompactionUtil.rollbackCompaction(CompactionUtil.java:188)
at
org.apache.hudi.sink.compact.CompactionPlanOperator.open(CompactionPlanOperator.java:79)
at
org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.initializeStateAndOpenOperators(RegularOperatorChain.java:110)
at
org.apache.flink.streaming.runtime.tasks.StreamTask.restoreGates(StreamTask.java:711)
at
org.apache.flink.streaming.runtime.tasks.StreamTaskActionExecutor$1.call(StreamTaskActionExecutor.java:55)
at
org.apache.flink.streaming.runtime.tasks.StreamTask.restoreInternal(StreamTask.java:687)
at
org.apache.flink.streaming.runtime.tasks.StreamTask.restore(StreamTask.java:654)
at
org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:1062)
at
org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:1031)
at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:857)
at org.apache.flink.runtime.taskmanager.Task.run(Task.java:643)
at java.lang.Thread.run(Thread.java:748)
How to get the cause of reason?
> Failed to execute rollback due to HoodieIOException: Could not delete instant
> -----------------------------------------------------------------------------
>
> Key: HUDI-3648
> URL: https://issues.apache.org/jira/browse/HUDI-3648
> Project: Apache Hudi
> Issue Type: Bug
> Components: deltastreamer
> Reporter: Ethan Guo
> Assignee: Sagar Sumit
> Priority: Critical
> Labels: hudi-on-call
> Fix For: 0.14.0
>
>
> Deltastreamer continuous mode writing to COW table with async clustering and
> cleaning.
> {code:java}
> org.apache.hudi.exception.HoodieRollbackException: Failed to rollback
> file:/Users/ethan/Work/scripts/mt_rollout_testing/deploy_b_single_writer_async_services/b3_ds_cow_010mt_011mt_conf/test_table
> commits 20220314165647208
> at
> org.apache.hudi.client.BaseHoodieWriteClient.rollback(BaseHoodieWriteClient.java:695)
> at
> org.apache.hudi.client.BaseHoodieWriteClient.rollbackFailedWrites(BaseHoodieWriteClient.java:1037)
> at
> org.apache.hudi.client.BaseHoodieWriteClient.tryUpgrade(BaseHoodieWriteClient.java:1404)
> at
> org.apache.hudi.client.BaseHoodieWriteClient.initTable(BaseHoodieWriteClient.java:1302)
> at
> org.apache.hudi.client.SparkRDDWriteClient.insert(SparkRDDWriteClient.java:174)
> at
> org.apache.hudi.utilities.deltastreamer.DeltaSync.writeToSink(DeltaSync.java:574)
> at
> org.apache.hudi.utilities.deltastreamer.DeltaSync.syncOnce(DeltaSync.java:329)
> at
> org.apache.hudi.utilities.deltastreamer.HoodieDeltaStreamer$DeltaSyncService.lambda$startService$0(HoodieDeltaStreamer.java:656)
> at
> java.util.concurrent.CompletableFuture$AsyncSupply.run(CompletableFuture.java:1604)
> at
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
> at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
> at java.lang.Thread.run(Thread.java:748)
> Caused by: org.apache.hudi.exception.HoodieIOException: Could not delete
> instant [==>20220314165647208__commit__INFLIGHT]
> at
> org.apache.hudi.common.table.timeline.HoodieActiveTimeline.deleteInstantFile(HoodieActiveTimeline.java:250)
> at
> org.apache.hudi.common.table.timeline.HoodieActiveTimeline.deletePending(HoodieActiveTimeline.java:201)
> at
> org.apache.hudi.table.action.rollback.BaseRollbackActionExecutor.deleteInflightAndRequestedInstant(BaseRollbackActionExecutor.java:270)
> at
> org.apache.hudi.table.action.rollback.CopyOnWriteRollbackActionExecutor.executeRollback(CopyOnWriteRollbackActionExecutor.java:90)
> at
> org.apache.hudi.table.action.rollback.BaseRollbackActionExecutor.doRollbackAndGetStats(BaseRollbackActionExecutor.java:218)
> at
> org.apache.hudi.table.action.rollback.BaseRollbackActionExecutor.runRollback(BaseRollbackActionExecutor.java:115)
> at
> org.apache.hudi.table.action.rollback.BaseRollbackActionExecutor.execute(BaseRollbackActionExecutor.java:144)
> at
> org.apache.hudi.table.HoodieSparkCopyOnWriteTable.rollback(HoodieSparkCopyOnWriteTable.java:346)
> at
> org.apache.hudi.client.BaseHoodieWriteClient.rollback(BaseHoodieWriteClient.java:680)
> ... 11 more {code}
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
