[
https://issues.apache.org/jira/browse/ARROW-13278?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Nic Crane closed ARROW-13278.
-----------------------------
Resolution: Invalid
Never mind, I didn't look at my data properly ;)
> [R] open_dataset autodetects types wrong in fairly unambiguous data
> -------------------------------------------------------------------
>
> Key: ARROW-13278
> URL: https://issues.apache.org/jira/browse/ARROW-13278
> Project: Apache Arrow
> Issue Type: Bug
> Components: R
> Reporter: Nic Crane
> Assignee: Nic Crane
> Priority: Major
>
>
> {code:java}
> # Write some partitioned data to disk to read back in
> write_dataset(airquality, "airquality_partitioned", partitioning = c("Month",
> "Day"))
> # Read data from folder
> air_data <- open_dataset("airquality_partitioned", partitioning = c("Month",
> "Day"))
> > air_data
> FileSystemDataset with 153 Parquet files
> Ozone: int32
> Solar.R: int32
> Wind: double
> Temp: int32
> Month: string
> Day: string{code}
> Month and Day are integers and there are no NA values in these columns of the
> data so, given the docs for open_dataset say that partitioning can be
> supplied as "a character vector that defines the field names corresponding to
> those path segments (that is, you're providing the names that would
> correspond to a Schema but the types will be autodetected)", this looks like
> it might be a bug somewhere.
>
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
