tustvold commented on issue #1915: URL: https://github.com/apache/arrow-rs/issues/1915#issuecomment-1164214873
Sorry for the slow response, I've been away for the last few days. My immediate hunch is that the writer is embedding a garbled arrow schema in the metadata. As part of the backwards compatibility logic documented in https://github.com/apache/parquet-format/blob/master/LogicalTypes.md#lists, the schema inference correctly interprets this as a list on read, which then errors because this doesn't match what has been written. This is a bug, which should be fixed, but I would also recommend writing a (LIST) type as documented in the link above - and not relying on a non-standard representation. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
