Gabriel Bassett created ARROW-10463:
---------------------------------------
Summary: readr_to_csv_parse_options() signature should match readr
Key: ARROW-10463
URL: https://issues.apache.org/jira/browse/ARROW-10463
Project: Apache Arrow
Issue Type: Bug
Components: R
Affects Versions: 2.0.0
Reporter: Gabriel Bassett
While read_csv_arrow()'s signature matches readr, the
readr_to_csv_parse_options() function (called by way of open_dataset()) only
appears to capture a subset of those options:
(https://github.com/apache/arrow/blob/883eb572bc64430307112895976ba79df10c8c7d/r/R/csv.R#L464)
{code:java}
readr_to_csv_parse_options <- function(delim = ",",
quote = '"',
escape_double = TRUE,
escape_backslash = FALSE,
skip_empty_rows = TRUE){code}
I ran into this trying to use a non-standard 'na' value:
{code:java}
open_dataset("/path/to/csv/directory/", schema = sch, partitioning=NULL,
format="csv", delim=";", na="\\N", escape_backslash=TRUE, escape_double=FALSE`)
Error in readr_to_csv_parse_options(...) : unused argument (na = "\\N")
{code}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
