Carl Boettiger created ARROW-15104:
--------------------------------------

             Summary: write_parquet() / write_csv_arrow() cannot stream a 
dataset object back to S3
                 Key: ARROW-15104
                 URL: https://issues.apache.org/jira/browse/ARROW-15104
             Project: Apache Arrow
          Issue Type: Bug
          Components: R
    Affects Versions: 6.0.1
            Reporter: Carl Boettiger


It seems we cannot send a dataset (table) object opened with `open_dataset()` 
into `write_parquet()` or `write_csv_arrow()`.  I realize that the former is a 
'multi-file' representation and the latter two are not, but as both represent a 
single table (single schema) it seems like this should still work.  (It also 
looks like write_csv_arrow() gives us more control over formatting details than 
write_dataset() )



--
This message was sent by Atlassian Jira
(v8.20.1#820001)

Reply via email to