Re: Question about timestamps ...

2019-10-10 Thread David Boles
Joris, Thank you for the response. There's such a trail of stale information online w/r to the overall that it wasn't clear what the status was. For example, simple searches take you into the "INT96 is deprecated therefore suppport for nanoseconds is as well" cul-de-sac. Absence that confusing con

Re: Question about timestamps ...

2019-10-10 Thread Joris Van den Bossche
Hi David, This is intentional, see https://arrow.apache.org/docs/python/parquet.html#storing-timestamps for some explanation in the documentation. Basicly, the parquet format only supports ms and us resolution, and so nanosecond timestamps (which are supported by Arrow) are converted to one of tho