pvary opened a new pull request, #6049: URL: https://github.com/apache/iceberg/pull/6049
Based on my performance tests using `snappy` codec to write out files is 40% more performant that writing with gzip. Since with Flink there is an additional compaction step which overwrites the original data files anyway, it would be useful to first write out the files with `snappy` and use the table codec only at the compaction time. To provide this functionality additional `FlinkWriteOptions` are added to modify the table default settings for: - compression-codec - compression-level - For Parquet and Avro formats - compression-strategy - For ORC formats -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
