Github user sihuazhou commented on the issue:
https://github.com/apache/flink/pull/5982
Hi, I met a problem here, for the Hadoop FileSystem when the
`schema='hdfs'`, we can't rename a file to a existing file. This means that it
hard(I'm not sure whether it's possible) to support the `WriteModel.OVERWRITE`
for `createAtomically()` with `schema='hdfs'`, if we work-around this by
firstly rename the existing file to a tmp file and then rename the pre-commit
file to the target file, then this two step operations is not atomic, which may
lead to a inconsistent result if the JVM crashes between this operations. I'm
running out of myself on this now...Do you have any suggestions for the
`createAtomically()` when `schema='hdfs'` and
`writeMode='WriteMode.OVERWRITE'`? @StephanEwen
---
