tustvold commented on issue #5130: URL: https://github.com/apache/arrow-datafusion/issues/5130#issuecomment-1450163199
> Aborted queries might result corrupted files. Aborted queries definitely could, but also the append operation itself is likely not atomic - it may take multiple calls to `write` to completely flush the payload. In the intervening time between these `write` calls any reader may see incomplete data, and any parallel writer would interleave its writes resulting in data corruption -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
