GitHub user vadimpiven created a discussion: Support OpenZL compression for Parquet
Meta just published their new compression framework OpenZL <https://engineering.fb.com/2025/10/06/developer-tools/openzl-open-source-format-aware-compression-framework/> which provides very good compression for parquet (check figure 3). There is even an instruction on applying compression to parquet <https://github.com/facebook/openzl/blob/d177e9f32bd5ac037d54a2af5f7588b841aeb47d/doc/mkdocs/doc/getting-started/examples/cli/parquet.md> May be DataFusion can support this way of compression? GitHub link: https://github.com/apache/datafusion/discussions/17950 ---- This is an automatically sent email for [email protected]. To unsubscribe, please send an email to: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
