pepijnve opened a new pull request, #26155: URL: https://github.com/apache/datafusion/pull/26155
## Which issue does this PR close? None yet ## Rationale for this change It can sometimes be useful to not spend CPU cycles compressing and decompressing data. The Arrow IPC write support currently only supports LZ4 compression even though the writer supports no compression and zstd. This PR adds config options to make the compression settings user configurable. ## What changes are included in this PR? - Add Arrow config options for compression type, compression level, and alignment - Add glue code to pass config options to the file format implementation ## What is the testing strategy for this PR? Added SLTs to cover new options ## Are there any user-facing changes? Yes, additional options become available, but the default behaviour remains the same. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
