Carl Boettiger created ARROW-15104:
--------------------------------------
Summary: write_parquet() / write_csv_arrow() cannot stream a
dataset object back to S3
Key: ARROW-15104
URL: https://issues.apache.org/jira/browse/ARROW-15104
Project: Apache Arrow
Issue Type: Bug
Components: R
Affects Versions: 6.0.1
Reporter: Carl Boettiger
It seems we cannot send a dataset (table) object opened with `open_dataset()`
into `write_parquet()` or `write_csv_arrow()`. I realize that the former is a
'multi-file' representation and the latter two are not, but as both represent a
single table (single schema) it seems like this should still work. (It also
looks like write_csv_arrow() gives us more control over formatting details than
write_dataset() )
--
This message was sent by Atlassian Jira
(v8.20.1#820001)