Interesting question, it is ideal to define and document a clear default behavior for rename in all Beam filesystems (since there are no options allowed in the API). HDFS users probably will expect that the default rename behavior does NOT overwrite (as HDFS works), and also because this implies possible data loss, but I am not sure if there is a strong reason for other Filesystems to do overwrite by default (e.g. Local). cc @lukecwik too for eventual extra feedback since the original authors of Beam FileSystems are not in the project anymore.
[ Full content available at: https://github.com/apache/beam/pull/6289 ] This message was relayed via gitbox.apache.org for [email protected]
