jorisvandenbossche commented on issue #38389: URL: https://github.com/apache/arrow/issues/38389#issuecomment-1823088250
> 1. Try again after https://github.com/apache/arrow/issues/38591 Note that I assume you were doing your initial benchmarks with pyarrow 13.0 (because 14.0 was not yet released when the thread started), and I think this is only a regression in 14.0 > 2. Try without snappy compression Antoine posted some numbers above (eg https://github.com/apache/arrow/issues/38389#issuecomment-1777406762) with default of snappy compression, with lz4, and uncompressed (snappy clearly being the slowest, but the actual difference depends on which encoding is being used) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
