GuanghuiCong opened a new issue, #19649: URL: https://github.com/apache/hudi/issues/19649
### Bug Description **Describe the problem** We encountered an issue with Hudi LSM Timeline archival when running a Flink streaming job. A transient HDFS replication failure occurred while Hudi was creating a new LSM timeline manifest file. Hudi created a temporary manifest file with the following name: manifest_114.a5e022a6-e5c9-4450-b9e5-9296262329b5 The HDFS file close operation failed because the last block did not have enough replicas. After the Flink job restarted, this temporary manifest file remained under: .hoodie/timeline/history/ On subsequent archive/clean operations, Hudi scanned this file and attempted to parse: 114.a5e022a6-e5c9-4450-b9e5-9296262329b5 as an integer manifest version. This caused: java.lang.NumberFormatException: For input string: "114.a5e022a6-e5c9-4450-b9e5-9296262329b5" The job then repeatedly failed every time timeline archival was triggered. The important point is that the original HDFS issue was transient, but the leftover temporary manifest made the Hudi table unable to recover automatically. ### Environment Hudi version:1.0.2 Flink version:1.18.1 Java:1.8.0_281 Table type:MERGE_ON_READ Storage:HDFS Hudi bundle:hudi-flink1.18-bundle-1.0.2.jar ### Logs and Stack Trace _No response_ -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
