horeees opened a new issue, #34062:
URL: https://github.com/apache/arrow/issues/34062
### Describe the usage question you have. Please include as many useful
details as possible.
Hello there,
When reading a parquet file using `read_parquet()` that contains int96
dates, I do this:
`props <- arrow::ParquetArrowReaderProperties$create()
props$set_coerce_int96_timestamp_unit(arrow::TimeUnit$MILLI)`
Then I pass props to the read_parquet function to read the correct date
format.
Example here:
`tf <- tempfile()
table <- Table$create(some_datetime = as.POSIXct("9999-12-31 00:00:00.000"))
write_parquet(table, tf, use_deprecated_int96_timestamps = TRUE)
props <- ParquetArrowReaderProperties$create()
props$set_coerce_int96_timestamp_unit(TimeUnit$MILLI)
result <- read_parquet(
tf,
as_data_frame = TRUE,
props = props
)
result`
When I'm working with arrow datasets, passing the props using the ... in the
`open_dataset()` function, I get
`
Error in ParquetFragmentScanOptions$create(...) :
unused argument (props = <environment>)
`
I went through the repo and couldn't find the
`set_coerce_int96_timestamp_unit` as an option in
`ParquetFragmentScanOptions$create(...)`.
How do I read parquet files using open_dataset() using
set_coerce_int96_timestamp_unit?
Thank you
Mike
### Component(s)
R
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
