yihua commented on PR #5048: URL: https://github.com/apache/hudi/pull/5048#issuecomment-1097320642
@boneanxs is this more like a transient issue for readers? There could be cases where empty or partial complete instant file is left in the timeline. There are fixes to it: #4016 #5261 . Do they solve your problem? Given that HDFS is append-only, while cloud storage like S3 guarantees atomic file overwrites, it is better to put such different logic in file system abstraction and APIs, instead of leaking them into Hudi core logic like timeline, to make it easier to maintain and understand. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
