comphead commented on code in PR #5584:
URL: https://github.com/apache/arrow-datafusion/pull/5584#discussion_r1137795180
##########
datafusion/core/src/physical_plan/file_format/mod.rs:
##########
@@ -541,6 +541,23 @@ pub(crate) fn get_output_ordering(
}).unwrap_or_else(|| None)
}
+/// Defines strategies for the saving behavior in the case when the saved
folder already exists
+#[derive(Debug, Clone, Copy)]
+pub enum FileWriterSaveMode {
+ /// Overwrite mode means that when saving a parquet file, if folder
already exists, existing data is expected to be overwritten.
+ /// If folder does not exist, the folder will be created. This is default
value.
+ Overwrite,
+ /// Append mode means that when saving a parquet file, if folder already
exists, new data is expected to be appended on top of the existing.
+ /// If folder does not exist, the folder will be created
+ Append,
Review Comment:
I see your point, will be trying to do writer properties more sbstract, so
each writer can implement its own save mode behaviuors
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
