Github user gaborgsomogyi commented on the issue:
https://github.com/apache/spark/pull/20683
Don't really understand the issue itself. Which filesystem used this case?
Why is it not possible to use Hadoop-compatible filesystem like HDFS for
instance? This supports atomic rename. [See
here](https://hadoop.apache.org/docs/stable/hadoop-project-dist/hadoop-common/filesystem/introduction.html#Atomicity)
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
