Gabriel Bassett created ARROW-10426:
---------------------------------------
Summary: Arrow type large_string cannot be written to Parquet type
column descriptor
Key: ARROW-10426
URL: https://issues.apache.org/jira/browse/ARROW-10426
Project: Apache Arrow
Issue Type: Bug
Components: R
Affects Versions: 2.0.0
Environment: R 4.0.3 on OSX 10.15.7
Reporter: Gabriel Bassett
When trying to write a dataset in parquet format, arrow errors with the
message: "Arrow type large_string cannot be written to Parquet type column
descriptor"
{code:java}
arrow::write_dataset(
dataframe,
"/directory/",
"parquet",
"partitioning" = c("col1", "col2")
)
{code}
The dataframe in question is very large with one column containing the text of
message board posts encoded in HTML.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
