GitHub user jianlirong added a comment to the discussion: Add LZO compression support to gpfdist
Thanks for raising this question. We'd like to better understand your use case. Today, most modern data platforms have largely standardized on compression algorithms such as LZ4 and Zstandard (Zstd), which generally provide a better balance between compression ratio, decompression speed, and ecosystem support. As a result, they have become the default choice for many new deployments. LZO certainly played an important role historically, especially in some Hadoop-based ecosystems, but we're curious about the motivation for introducing LZO support in Apache Cloudberry today. Is your primary requirement: - compatibility with an existing data lake or Hadoop environment? - the ability to read legacy LZO-compressed data? - or is there another workload where LZO provides a specific advantage? Understanding the underlying use case would help us evaluate whether native LZO support is the right solution, or whether there might be a better alternative. We're always happy to discuss new features, but we'd first like to understand the problem we're trying to solve rather than focusing on a particular implementation. Lirong GitHub link: https://github.com/apache/cloudberry/discussions/1886#discussioncomment-17921758 ---- This is an automatically sent email for [email protected]. To unsubscribe, please send an email to: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
