Thanks everyone. @chamikaramj - if we are to correctly support an OVERWRITE_EXISTING_FILES flag I think we'd either have to pass the flag down into the filesystem implementations themselves, or do like the HDFS one does now and always throw FileAlreadyExistsException (note a user reports that issue today on user@ with AvroIO and LocalFileSystem) when the target is in place. The later would require some of them to do a "does target exist" check before attempting the move. Do you have a preference on that?
[ Full content available at: https://github.com/apache/beam/pull/6289 ] This message was relayed via gitbox.apache.org for [email protected]
