GuanghuiCong opened a new issue, #19649:
URL: https://github.com/apache/hudi/issues/19649

   ### Bug Description
   
   **Describe the problem**
   
   We encountered an issue with Hudi LSM Timeline archival when running a Flink 
streaming job.
   
   A transient HDFS replication failure occurred while Hudi was creating a new 
LSM timeline manifest file.
   
   Hudi created a temporary manifest file with the following name:
   
   manifest_114.a5e022a6-e5c9-4450-b9e5-9296262329b5
   
   
   
   The HDFS file close operation failed because the last block did not have 
enough replicas.
   
   After the Flink job restarted, this temporary manifest file remained under:
   
   .hoodie/timeline/history/
   
   
   On subsequent archive/clean operations, Hudi scanned this file and attempted 
to parse:
   
   114.a5e022a6-e5c9-4450-b9e5-9296262329b5
   
   as an integer manifest version.
   
   This caused:
   
   java.lang.NumberFormatException:
   For input string: "114.a5e022a6-e5c9-4450-b9e5-9296262329b5"
   
   The job then repeatedly failed every time timeline archival was triggered.
   
   The important point is that the original HDFS issue was transient, but the 
leftover temporary manifest made the Hudi table unable to recover automatically.
   
   ### Environment
   
   Hudi version:1.0.2
   
   Flink version:1.18.1
   
   Java:1.8.0_281
   
   Table type:MERGE_ON_READ
   
   Storage:HDFS
   
   Hudi bundle:hudi-flink1.18-bundle-1.0.2.jar
   
   
   ### Logs and Stack Trace
   
   _No response_


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]

Reply via email to