DataPsycho opened a new issue, #4986:
URL: https://github.com/apache/arrow-datafusion/issues/4986
Problem:
While trying to write a csv (any type) file, I am getting the following
exception if the file already exists:
```
Error: Execution("Could not create directory data/processed/diabetes.csv: Os
{ code: 17, kind: AlreadyExists, message: \"File exists\" }")
```
But other frameworks like Polars, PySpark accept overriding either optional
or by default and it also possible to append existing files if selected.
Possible Solution:
I suggest having a `CsvWriteOptions` struct like `CsvReadOptions` struct
which must be passed during writing the file. For example `df.write_csv(path:
"my/precious/path", CsvWriteOptions::default()).await?` This family of write
options can also have all the configuration possibilities for json, parquet,
csv, table etc.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
