danny0405 commented on PR #11187: URL: https://github.com/apache/hudi/pull/11187#issuecomment-2111382919
> @danny0405 sorry, I don't quite understand. For example, a write task create a new a_0-0-1.logfile, and this's speculation task also create a new a_0-0-2.logfile, these two files are the same and with tow marker log file. Now spark driver will recive one file meta stat which finish first, so other is orphaned file I think we need delete when solve file conflict use log marker file. And in next commit time, can use the file which has remaind to append. The two attempts appended to the same file. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
