GitHub user cshuo added a comment to the discussion: Use ZSTD as the default compression codec for Parquet files
Thanks for the feedback. I agree that these safeguards should be addressed before changing the default. Before upgrading parquet-java to 1.13.0, Iceberg introduced a scoped workaround for PARQUET-2160 to ensure ZSTD decompression streams are closed properly. We can follow a similar approach in Hudi for the affected Parquet 1.12.x versions: [apache/iceberg#5681](https://github.com/apache/iceberg/pull/5681). GitHub link: https://github.com/apache/hudi/discussions/19615#discussioncomment-17998760 ---- This is an automatically sent email for [email protected]. To unsubscribe, please send an email to: [email protected]
