dadepo opened a new issue, #5383:
URL: https://github.com/apache/arrow-datafusion/issues/5383
**Is your feature request related to a problem or challenge? Please describe
what you are trying to do.**
Using either the `write_json` or `write_csv` on a data frame creates a
result that is a bit confusing.
For example this:
```
df.clone().write_csv("./data.csv").await;
df.clone().write_json("./data.json").await;
```
led to the following results
```
tree -h data.csv/
[ 320] data.csv/
├── [ 472] part-0.csv
├── [ 0] part-1.csv
├── [ 0] part-2.csv
├── [ 0] part-3.csv
├── [ 0] part-4.csv
├── [ 0] part-5.csv
├── [ 0] part-6.csv
└── [ 0] part-7.csv
```
and
```
tree -h data.json/
[ 320] data.json/
├── [ 939] part-0.json
├── [ 0] part-1.json
├── [ 0] part-2.json
├── [ 0] part-3.json
├── [ 0] part-4.json
├── [ 0] part-5.json
├── [ 0] part-6.json
└── [ 0] part-7.json
```
Where it is only the `part-0` file that has got the result, while the rest
of the files created in the directory are empty.
**Describe the solution you'd like**
Ideally a single file should be created with the results. If there is a
technically reason why this cannot be the case, perhaps the methods should be
documented on why it acts this way and if it is possible to modify this
behaviour and how to.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
