KnightChess commented on issue #9615: URL: https://github.com/apache/hudi/issues/9615#issuecomment-1709480844
@yihua sorry, not save the detail log, I painted a picture to describe the situation at the time. In the picture, the main problem is that when the driver processing the metadata over and is ready to be closed, the speculatory task in executor is still executed, and it is not interrupted. The cloud frame has none detail time log to know their sequence, according to the final result phenomenon, I think there are two possibilities.  phenomenon: `datafile` exist and its `marker` file is not exist，datafile length is zero First assumption： 1. conflict check over in driver 2. speculate task begin create maker and datafile in executor 3. delete marker begin in driver  Second assumption： 1. speculate task begin create maker in executor 2. conflict check over in driver and delete ` fileA_0-1-1` current time in driver 3. speculate task create datafile right now in executor 4. delete marker in driver  -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
