abaranec opened a new pull request, #993: URL: https://github.com/apache/parquet-mr/pull/993
This PR improves the allocation behavior of SnappyCompressor. Previously when more buffer space was needed, it would only allocate enough for the new data to be written. Now, it will double the internal buffer size up to 8MB, and then afterwards increase size in 1MB increments. No additional unit tests are added, as the existing unit tests for SnappyCodec and other already verify correctness. I have personally verified the performance gains using JMH benchmarks. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
