majian1998 commented on PR #9472: URL: https://github.com/apache/hudi/pull/9472#issuecomment-1782170663
@bvaradar Your suggestion is reasonable, as it allows detecting most conflict situations at a lower cost. However, there may still be some issues with this PR. If we check for conflicts before generating the requested files, it won't completely avoid situations where two processes simultaneously reach this point without being aware of each other. On the other hand, if we check for conflicts after generating the requested files, and let the timeline act as a marker, even if we detect conflicts and terminate the final execution process, there will still be failed requested files left to handle, which might not be ideal. What is your perspective on this issue? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
