GitHub user cshuo added a comment to the discussion: Use ZSTD as the default compression codec for Parquet files
Iceberg changed the default Parquet compression codec for new tables from GZIP to ZSTD in Iceberg 1.4.0. Existing tables retained their previous behavior to minimize compatibility impact (https://github.com/apache/iceberg/pull/8593). Delta Lake has adopted ZSTD as the protocol-level default. However, its Spark implementation is still transitioning and has not yet fully switched from SNAPPY to ZSTD. GitHub link: https://github.com/apache/hudi/discussions/19615#discussioncomment-17998747 ---- This is an automatically sent email for [email protected]. To unsubscribe, please send an email to: [email protected]
