tustvold commented on issue #1459: URL: https://github.com/apache/arrow-rs/issues/1459#issuecomment-1098011307
I've created https://github.com/apache/arrow-rs/pull/1558 which adds an option to skip decoding the garbled arrow metadata, this seemed like the safest option for allowing people to read these files, without this coming back to bite us in a strange way down the line. I would recommend using `flavor='spark'`, `engine=fastparquet` or `version="2.4"` when writing these files as a better workaround, but I appreciate rewriting files may not be an option -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
