This is Vaishal from D. E. Shaw and Co. We are interested to use py-arrow/parquet for one of our projects, that deals with numpy arrays. Parquet provides API to store pandas dataframes on disk, but I could not find any support for storing numpy arrays. Since numpy is a trivial form to store data, I was surprised to find no function to store them in parquet format. Is there any way to store numpy array in parquet format, that I probably missed? Or can we expect this support in newer version of parquet?
Thanks, Vaishal