Hi, I am currently using pyarrow to store pandas datasets. Due to the very large amount of data it would be useful to use a lower precision for floats. I saw that it is implemented in the parquet standard but not currently available in pyarrow, since I get the following error:
ArrowNotImplementedError: Unhandled type for Arrow to Parquet schema conversion: halffloat [ Full content available at: https://github.com/apache/arrow/issues/2691 ] This message was relayed via gitbox.apache.org for [email protected]
