mroeschke opened a new issue, #49168:
URL: https://github.com/apache/arrow/issues/49168

   ### Describe the enhancement requested
   
   In https://github.com/apache/arrow/pull/35656, it appears that 
`pa.Date32/64.to_pandas_dtype` was specified to return `datetime64[ms]` instead 
of `datetime[s]` because of a limitation in parquet(?) xref 
https://github.com/apache/arrow/pull/35656#issuecomment-1579572612
   
   ```python
   In [1]: import pyarrow as pa
   
   In [2]: pa.__version__
   Out[2]: '23.0.0'
   
   In [3]: pa.date64().to_pandas_dtype()
   Out[3]: dtype('<M8[ms]')
   
   In [4]: pa.date32().to_pandas_dtype()
   Out[4]: dtype('<M8[ms]')
   ```
   
   I see that a `TIMESTAMP` with a `SECONDS` unit isn't still an official 
parquet type, https://parquet.apache.org/docs/file-format/types/logicaltypes/, 
but I was hoping that ideally this pandas conversion would ideally be 
de-coupled from this parquet limitation and return `datetime64[s]` for this 
API. 
   
   ### Component(s)
   
   Python


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]

Reply via email to