DDtKey opened a new issue, #7436: URL: https://github.com/apache/arrow-datafusion/issues/7436
### Describe the bug Methods `write_csv`, `write_parquet`, `write_json` and etc have been broken after switching to `object-store`. They produce files with wrong extension with additional suffix, for example: `filename_4.csv#1` The name seems to change [here](https://github.com/apache/arrow-rs/blob/cb793a5d54e155b121bc5c33534a37bf94651c84/object_store/src/local.rs#L658) and is not controlled directly by datafusion. I think this is more an issue of `object_store` for local file-system implementation, but the behavior have been broken for datafusion after switching so I raised the issue. ### To Reproduce ```rs let ctx = SessionContext::new(); // register any sources let data_frame = ctx.sql("...").await?; // any valid SQL data_frame.write_csv().await?; ``` ### Expected behavior Filenames should be with correct extension, without suffix of `#1`. `write_{format}` methods used to create file per thread (currently it's controlled by `per_thread_output: true`) with correct names and an index: `{filename}_{index}.{ext}`. ### Additional context _No response_ -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
