hi folks,

(cross-posting to dev@arrow and dev@parquet since there are
stakeholders in both places)

It seems there are still problems at least with the C++ implementation
of LZ4 compression in Parquet files

https://issues.apache.org/jira/browse/PARQUET-1241
https://issues.apache.org/jira/browse/PARQUET-1878

If these problems cannot be resolved, I am going to recommend that we
disable use of LZ4 in the Parquet C++ library until these things can
be properly tested and validated across different implementations.
Thoughts? We're within weeks of the next Apache Arrow release so if
we're going to disable LZ4-for-Parquet it needs to happen soon.

Thanks
Wes

Reply via email to