Github user davies commented on the issue:
https://github.com/apache/spark/pull/15332
Paruqet support both millisecond and microseconds:
```
TIMESTAMP_MILLIS
TIMESTAMP_MILLIS is used for a combined logical date and time type, with
millisecond precision. It must annotate an int64 that stores the number of
milliseconds from the Unix epoch, 00:00:00.000 on 1 January 1970, UTC.
TIMESTAMP_MICROS
TIMESTAMP_MICROS is used for a combined logical date and time type with
microsecond precision. It must annotate an int64 that stores the number of
microseconds from the Unix epoch, 00:00:00.000000 on 1 January 1970, UTC.
```
We should be able to read both of them, but write it as TIMESTAMP_MICROS by
default?
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]