thisisnic commented on issue #44942: URL: https://github.com/apache/arrow/issues/44942#issuecomment-6770058251
There isn't enough here to investigate: the failing file wasn't attached, and files of this shape that I wrote with polars `sink_parquet()` using lz4 and zstd read fine on Linux with 17.0.0 and 26.0.1. The codec is taken from the file's own metadata, so a ZSTD error means the file being read is marked as zstd-compressed. Could you share a file that fails, or failing that, compare a checksum of it on the two machines and post the output of `pq.ParquetFile(path).metadata.row_group(0).column(0).compression`? As this issue is old, if there's no further information in the next month, I'll close this. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
